2024-09-10T21:33:50.815 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T21:33:50.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T21:33:50.954 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899693' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPy3KeAaZsKiDT/lJQQLu/IXgMyoGLwtuwnv0tWm+FZS9GxsdngsiZRf6+oKWCFAavX7Za1AzZW2YVqvwyKJnr0= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpjZ8IaigXG9/wvXjF7cbgBfDT18uEYdBuDiemLuCvTdgA780j6/JdLwOzxYf0IV6FAKQbzqMJQ+62ObwsTcys= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH1K2sv8omVxajZTn4idFvBCa0VR4za6mJTSCRNc2F241hI5G1eY/KyvLyv5nU1Bl4ob7UWl9RYtQXG3LY9OfQc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T21:33:50.955 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T21:33:50.955 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T21:33:50.956 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T21:33:50.957 INFO:teuthology.task.internal:Checking packages... 2024-09-10T21:33:51.217 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T21:33:51.217 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T21:33:51.218 INFO:teuthology.packaging:ref: None 2024-09-10T21:33:51.218 INFO:teuthology.packaging:tag: None 2024-09-10T21:33:51.218 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:33:51.218 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:33:51.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:33:51.365 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T21:33:51.367 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T21:33:51.373 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T21:33:51.373 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T21:33:51.416 INFO:teuthology.task.internal:Saving configuration 2024-09-10T21:33:51.435 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T21:33:51.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T21:33:51.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:28:01.610806', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPy3KeAaZsKiDT/lJQQLu/IXgMyoGLwtuwnv0tWm+FZS9GxsdngsiZRf6+oKWCFAavX7Za1AzZW2YVqvwyKJnr0='} 2024-09-10T21:33:51.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:28:01.607418', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpjZ8IaigXG9/wvXjF7cbgBfDT18uEYdBuDiemLuCvTdgA780j6/JdLwOzxYf0IV6FAKQbzqMJQ+62ObwsTcys='} 2024-09-10T21:33:51.588 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:28:01.609276', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH1K2sv8omVxajZTn4idFvBCa0VR4za6mJTSCRNc2F241hI5G1eY/KyvLyv5nU1Bl4ob7UWl9RYtQXG3LY9OfQc='} 2024-09-10T21:33:51.589 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T21:33:51.646 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T21:33:51.646 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T21:33:51.646 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T21:33:51.646 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T21:33:51.890 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1564cd09d0>, signals=[15]) 2024-09-10T21:33:51.890 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T21:33:51.896 INFO:teuthology.task.internal:Opening connections... 2024-09-10T21:33:51.897 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T21:33:51.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:33:51.982 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T21:33:51.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:33:52.068 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-10T21:33:52.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:33:52.154 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T21:33:52.162 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-10T21:33:52.180 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-10T21:33:52.180 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-10T21:33:52.237 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:33:52.238 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:33:52.239 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-10T21:33:52.270 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-10T21:33:52.289 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-10T21:33:52.290 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:33:52.348 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:33:52.349 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:33:52.350 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-10T21:33:52.378 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-10T21:33:52.396 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-10T21:33:52.396 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-09-10T21:33:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:33:52.455 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:33:52.455 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:33:52.455 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:33:52.455 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:33:52.455 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:33:52.455 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-10T21:33:52.486 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T21:33:52.497 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T21:33:52.672 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T21:33:52.672 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:33:52.674 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:33:52.676 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:33:52.693 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T21:33:52.869 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T21:33:52.870 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:33:52.872 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:33:52.874 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:33:52.973 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T21:33:53.066 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T21:33:53.081 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T21:33:53.082 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T21:33:53.082 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T21:33:53.082 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:33:53.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:33:53.099 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-10T21:33:53.157 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-503.el9.x86_64 2024-09-10T21:33:53.158 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-503.el9.x86_64 2024-09-10T21:33:53.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-09-10T21:33:56.634 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T21:33:58.460 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-10T21:34:04.093 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-10T21:34:05.627 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-10T21:34:06.831 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T21:34:12.379 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T21:34:14.510 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T21:34:14.510 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T21:34:14.619 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-10T21:34:14.623 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-10T21:34:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-09-10T21:34:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:34:14.625 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 79 M 2024-09-10T21:34:14.625 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 126 M 2024-09-10T21:34:14.625 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-10T21:34:14.797 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 188 kB/s | 23 kB 00:00 2024-09-10T21:34:15.539 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-10T21:34:16.081 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-10T21:34:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-10T21:34:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:34:16.406 INFO:teuthology.orchestra.run.smithi039.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-10T21:34:17.113 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-10T21:34:17.491 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-10T21:34:17.492 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-10T21:34:18.498 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-10T21:34:18.498 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-10T21:34:21.069 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-10T21:34:21.740 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T21:34:21.822 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:34:24.615 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:34:24.753 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:34:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:34:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:34:35.065 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:35:14.063 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:35:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:35:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:35:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T21:35:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:35:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:35:15.318 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-10T21:35:15.674 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T21:35:15.770 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T21:35:15.771 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T21:35:15.771 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T21:35:15.771 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T21:35:15.772 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T21:35:15.772 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T21:35:15.772 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T21:35:15.830 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T21:35:15.830 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T21:35:15.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-09-10T21:35:15.868 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 82.el9 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8274670 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-09-10T21:35:15.869 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-09-10T21:35:15.870 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:35:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T21:35:15.873 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T21:35:15.873 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-505.el9.x86_64 2024-09-10T21:35:15.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T21:35:16.518 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-10T21:35:17.793 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T21:35:17.836 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-10T21:35:17.838 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-10T21:35:17.857 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.SJqNW43yMZ 2024-09-10T21:35:17.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SJqNW43yMZ 2024-09-10T21:35:17.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.SJqNW43yMZ 2024-09-10T21:35:18.067 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.SJqNW43yMZ is 6KB 2024-09-10T21:35:18.114 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.SJqNW43yMZ 2024-09-10T21:35:18.129 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T21:35:18.190 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T21:35:18.190 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T21:35:18.191 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T21:35:18.191 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T21:35:18.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T21:35:18.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-10T21:35:48.343 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T21:35:48.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:35:48.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:36:06.721 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-10T21:36:15.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:36:15.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:36:18.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-10T21:36:30.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:36:30.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:36:33.889 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-10T21:36:48.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:36:48.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:37:48.903 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T21:38:06.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:38:06.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:38:07.207 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-10T21:38:07.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:38:07.558 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T21:38:07.558 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-10T21:38:07.574 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-505.el9.x86_64 2024-09-10T21:38:07.575 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T21:38:07.575 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T21:38:07.575 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T21:38:08.576 DEBUG:teuthology.parallel:result is None 2024-09-10T21:38:08.576 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T21:38:08.585 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T21:38:08.586 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:38:08.588 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:38:08.591 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:38:08.610 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T21:38:08.718 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T21:38:08.843 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T21:38:08.843 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:38:08.846 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:38:08.848 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:38:09.098 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T21:38:09.110 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T21:38:09.110 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:38:09.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:38:09.127 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:38:09.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:38:09.145 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:38:09.147 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:38:09.170 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:38:09.212 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.218 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.230 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.234 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.247 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:38:09.268 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T21:38:09.280 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T21:38:09.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:38:09.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:38:09.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:38:09.313 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T21:38:09.326 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T21:38:09.327 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:38:09.352 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:38:09.355 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:38:09.371 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:09.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:09.499 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:09.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:09.626 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:38:09.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:38:09.693 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:09.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:09.790 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:09.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:09.917 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:38:09.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:38:09.984 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:10.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:38:10.083 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:10.177 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:38:10.212 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:38:10.212 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:38:10.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-10T21:38:10.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-10T21:38:10.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-10T21:38:10.324 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:38:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:38:10.359 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:38:10.784 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T21:38:10.791 INFO:teuthology.task.internal:Starting timer... 2024-09-10T21:38:10.791 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T21:38:10.871 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T21:38:10.992 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T21:38:10.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-09-10T21:38:11.050 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-09-10T21:38:11.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-10T21:38:11.115 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-10T21:38:11.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-09-10T21:38:11.173 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-09-10T21:38:11.175 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T21:38:11.175 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-09-10T21:38:11.201 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-09-10T21:38:11.201 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-10T21:38:11.229 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-10T21:38:11.229 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-09-10T21:38:11.253 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-09-10T21:38:11.253 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-09-10T21:38:11.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:38:11.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:38:11.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:38:11.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:38:11.312 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:38:11.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:38:11.340 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T21:38:11.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:38:11.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:38:11.422 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:38:11.466 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T21:38:11.476 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T21:38:11.491 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T21:38:11.646 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T21:38:11.675 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T21:38:11.676 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T21:42:05.368 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-10T21:42:05.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:42:05.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:42:05.457 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-10T21:42:05.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-10T21:42:05.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T21:42:05.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:42:05.627 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-10T21:42:05.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T21:42:05.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-10T21:42:05.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:42:05.793 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-10T21:42:05.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-10T21:42:05.872 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T21:42:05.886 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T21:42:05.886 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:42:05.887 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:42:05.889 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:42:05.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:42:05.891 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:42:05.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:42:05.920 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:42:05.921 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:42:05.935 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:42:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:42:05.942 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:42:05.958 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:42:05.960 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-10T21:42:05.964 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-09-10T21:42:05.972 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-10T21:42:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-09-10T21:42:05.984 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-09-10T21:42:05.987 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:42:05.992 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:42:05.995 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-09-10T21:42:06.001 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:42:06.007 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:42:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:42:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:42:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.067 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:42:06.071 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:42:06.072 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-10T21:42:06.072 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.072 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.072 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.072 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.078 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.082 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:42:06.083 INFO:teuthology.run_tasks:Running task install... 2024-09-10T21:42:06.091 DEBUG:teuthology.task.install:project ceph 2024-09-10T21:42:06.091 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T21:42:06.092 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T21:42:06.092 INFO:teuthology.task.install:Using flavor: default 2024-09-10T21:42:06.097 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T21:42:06.097 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T21:42:06.098 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:42:06.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:42:06.101 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:42:06.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:42:06.102 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:42:06.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:42:06.263 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:42:06.263 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:42:06.282 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:42:06.282 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:42:06.283 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:42:06.283 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:42:06.395 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:42:06.395 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:42:06.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:42:06.406 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:42:06.406 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:42:06.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:42:06.421 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:42:06.422 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:42:06.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:42:06.425 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:42:06.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:42:06.433 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:42:06.433 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:42:06.451 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:42:06.451 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:42:06.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:42:06.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:42:06.516 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:42:06.562 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:42:06.578 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:42:06.591 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:42:06.626 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-10T21:42:06.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-10T21:42:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-09-10T21:42:06.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-09-10T21:42:06.656 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-09-10T21:42:06.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-09-10T21:42:06.852 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-10T21:42:06.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:42:06.882 INFO:teuthology.orchestra.run.smithi173.stdout:45 files removed 2024-09-10T21:42:06.890 INFO:teuthology.orchestra.run.smithi039.stdout:45 files removed 2024-09-10T21:42:06.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:42:06.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:42:07.436 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-10T21:42:07.461 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-10T21:42:07.506 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 292 kB/s | 84 kB 00:00 2024-09-10T21:42:07.729 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 96 kB/s | 24 kB 00:00 2024-09-10T21:42:07.753 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T21:42:07.804 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 96 kB/s | 24 kB 00:00 2024-09-10T21:42:08.004 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T21:42:08.020 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-10T21:42:08.080 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T21:42:08.604 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T21:42:09.462 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-10T21:42:10.305 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.2 MB 00:02 2024-09-10T21:42:14.755 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-09-10T21:42:16.981 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 20 MB 00:05 2024-09-10T21:42:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-10T21:42:19.089 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-10T21:42:20.489 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-10T21:42:21.448 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T21:42:21.677 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T21:42:23.149 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-10T21:42:24.270 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T21:42:24.513 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-10T21:42:26.022 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-10T21:42:27.141 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-10T21:42:27.543 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-10T21:42:29.417 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:29.418 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:29.430 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:42:29.431 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:42:29.431 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:42:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:42:29.434 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:42:29.436 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:42:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:42:29.500 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:42:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:42:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:42:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:42:29.523 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:42:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:42:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:42:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:42:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:42:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:42:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:42:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:42:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:42:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout:Install 149 Packages 2024-09-10T21:42:29.533 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-09-10T21:42:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:42:29.534 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 240 M 2024-09-10T21:42:29.534 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-10T21:42:30.001 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T21:42:30.275 INFO:teuthology.orchestra.run.smithi070.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-10T21:42:30.467 INFO:teuthology.orchestra.run.smithi070.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-10T21:42:30.601 INFO:teuthology.orchestra.run.smithi070.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-10T21:42:30.626 INFO:teuthology.orchestra.run.smithi070.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 915 kB/s | 145 kB 00:00 2024-09-10T21:42:30.718 INFO:teuthology.orchestra.run.smithi070.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-10T21:42:30.802 INFO:teuthology.orchestra.run.smithi070.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-10T21:42:31.085 INFO:teuthology.orchestra.run.smithi070.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-10T21:42:31.352 INFO:teuthology.orchestra.run.smithi070.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 18 MB/s | 22 MB 00:01 2024-09-10T21:42:31.394 INFO:teuthology.orchestra.run.smithi070.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 607 kB/s | 25 kB 00:00 2024-09-10T21:42:31.795 INFO:teuthology.orchestra.run.smithi070.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 17 MB/s | 17 MB 00:00 2024-09-10T21:42:31.845 INFO:teuthology.orchestra.run.smithi070.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T21:42:31.911 INFO:teuthology.orchestra.run.smithi070.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 408 kB/s | 27 kB 00:00 2024-09-10T21:42:31.970 INFO:teuthology.orchestra.run.smithi070.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 545 kB/s | 32 kB 00:00 2024-09-10T21:42:32.045 INFO:teuthology.orchestra.run.smithi070.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 9.9 MB/s | 755 kB 00:00 2024-09-10T21:42:32.112 INFO:teuthology.orchestra.run.smithi070.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T21:42:32.179 INFO:teuthology.orchestra.run.smithi070.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T21:42:32.263 INFO:teuthology.orchestra.run.smithi070.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 6.0 MB/s | 507 kB 00:00 2024-09-10T21:42:32.431 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:32.432 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:32.446 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:42:32.447 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:42:32.448 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:42:32.449 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:42:32.451 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:42:32.454 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:42:32.455 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:42:32.522 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:42:32.545 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:42:32.546 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:42:32.547 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:42:32.548 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:42:32.549 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:42:32.550 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:42:32.551 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:42:32.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:42:32.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:42:32.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:42:32.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:42:32.556 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:42:32.557 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout:Install 149 Packages 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-09-10T21:42:32.558 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:42:32.559 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 240 M 2024-09-10T21:42:32.559 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-10T21:42:32.580 INFO:teuthology.orchestra.run.smithi070.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-10T21:42:32.697 INFO:teuthology.orchestra.run.smithi070.stdout:(19/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 6.8 MB/s | 11 MB 00:01 2024-09-10T21:42:32.722 INFO:teuthology.orchestra.run.smithi070.stdout:(20/157): python3-ceph-argparse-19.3.0-4854.g8f 318 kB/s | 45 kB 00:00 2024-09-10T21:42:32.747 INFO:teuthology.orchestra.run.smithi070.stdout:(21/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-10T21:42:32.773 INFO:teuthology.orchestra.run.smithi070.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-10T21:42:32.798 INFO:teuthology.orchestra.run.smithi070.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.2 MB/s | 321 kB 00:00 2024-09-10T21:42:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.9 MB/s | 306 kB 00:00 2024-09-10T21:42:32.849 INFO:teuthology.orchestra.run.smithi070.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T21:42:32.874 INFO:teuthology.orchestra.run.smithi070.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T21:42:32.924 INFO:teuthology.orchestra.run.smithi070.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T21:42:32.983 INFO:teuthology.orchestra.run.smithi070.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 589 kB/s | 34 kB 00:00 2024-09-10T21:42:32.991 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-09-10T21:42:33.050 INFO:teuthology.orchestra.run.smithi070.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-10T21:42:33.094 INFO:teuthology.orchestra.run.smithi039.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-09-10T21:42:33.109 INFO:teuthology.orchestra.run.smithi070.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.2 MB 00:00 2024-09-10T21:42:33.477 INFO:teuthology.orchestra.run.smithi039.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.3 MB/s | 900 kB 00:00 2024-09-10T21:42:33.544 INFO:teuthology.orchestra.run.smithi039.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T21:42:33.642 INFO:teuthology.orchestra.run.smithi070.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 22 MB/s | 50 MB 00:02 2024-09-10T21:42:33.693 INFO:teuthology.orchestra.run.smithi070.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T21:42:33.768 INFO:teuthology.orchestra.run.smithi070.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 661 kB/s | 49 kB 00:00 2024-09-10T21:42:33.835 INFO:teuthology.orchestra.run.smithi070.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 248 kB/s | 16 kB 00:00 2024-09-10T21:42:33.985 INFO:teuthology.orchestra.run.smithi070.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 15 MB/s | 14 MB 00:00 2024-09-10T21:42:34.028 INFO:teuthology.orchestra.run.smithi039.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.9 MB/s | 5.5 MB 00:01 2024-09-10T21:42:34.078 INFO:teuthology.orchestra.run.smithi039.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.5 MB/s | 2.4 MB 00:00 2024-09-10T21:42:34.086 INFO:teuthology.orchestra.run.smithi070.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 7.6 MB/s | 7.4 MB 00:00 2024-09-10T21:42:34.111 INFO:teuthology.orchestra.run.smithi070.stdout:(37/157): ceph-volume-19.3.0-4854.g8f219c47.el9 1.0 MB/s | 285 kB 00:00 2024-09-10T21:42:34.128 INFO:teuthology.orchestra.run.smithi070.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 439 kB/s | 18 kB 00:00 2024-09-10T21:42:34.161 INFO:teuthology.orchestra.run.smithi070.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 4.4 MB/s | 783 kB 00:00 2024-09-10T21:42:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-10T21:42:34.287 INFO:teuthology.orchestra.run.smithi070.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-10T21:42:34.312 INFO:teuthology.orchestra.run.smithi070.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-10T21:42:34.354 INFO:teuthology.orchestra.run.smithi070.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-10T21:42:34.379 INFO:teuthology.orchestra.run.smithi070.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-10T21:42:34.438 INFO:teuthology.orchestra.run.smithi070.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-10T21:42:34.463 INFO:teuthology.orchestra.run.smithi070.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 979 kB/s | 106 kB 00:00 2024-09-10T21:42:34.495 INFO:teuthology.orchestra.run.smithi039.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 4.8 MB 00:00 2024-09-10T21:42:34.497 INFO:teuthology.orchestra.run.smithi070.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-10T21:42:34.522 INFO:teuthology.orchestra.run.smithi070.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T21:42:34.555 INFO:teuthology.orchestra.run.smithi070.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T21:42:34.698 INFO:teuthology.orchestra.run.smithi070.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-09-10T21:42:34.740 INFO:teuthology.orchestra.run.smithi070.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-10T21:42:34.765 INFO:teuthology.orchestra.run.smithi070.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-10T21:42:34.798 INFO:teuthology.orchestra.run.smithi070.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-10T21:42:34.824 INFO:teuthology.orchestra.run.smithi070.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-10T21:42:34.857 INFO:teuthology.orchestra.run.smithi070.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T21:42:34.882 INFO:teuthology.orchestra.run.smithi070.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-10T21:42:34.899 INFO:teuthology.orchestra.run.smithi070.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-10T21:42:34.933 INFO:teuthology.orchestra.run.smithi070.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-10T21:42:35.009 INFO:teuthology.orchestra.run.smithi070.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-10T21:42:35.034 INFO:teuthology.orchestra.run.smithi070.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-10T21:42:35.050 INFO:teuthology.orchestra.run.smithi070.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-10T21:42:35.079 INFO:teuthology.orchestra.run.smithi039.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 17 MB 00:00 2024-09-10T21:42:35.084 INFO:teuthology.orchestra.run.smithi070.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-10T21:42:35.101 INFO:teuthology.orchestra.run.smithi070.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-10T21:42:35.121 INFO:teuthology.orchestra.run.smithi039.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 606 kB/s | 25 kB 00:00 2024-09-10T21:42:35.135 INFO:teuthology.orchestra.run.smithi070.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-10T21:42:35.152 INFO:teuthology.orchestra.run.smithi070.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-09-10T21:42:35.177 INFO:teuthology.orchestra.run.smithi070.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-10T21:42:35.194 INFO:teuthology.orchestra.run.smithi070.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 915 kB/s | 38 kB 00:00 2024-09-10T21:42:35.219 INFO:teuthology.orchestra.run.smithi070.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-10T21:42:35.288 INFO:teuthology.orchestra.run.smithi039.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 14 MB/s | 11 MB 00:00 2024-09-10T21:42:35.303 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:35.303 INFO:teuthology.orchestra.run.smithi070.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-10T21:42:35.304 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:42:35.317 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:42:35.318 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:42:35.319 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:42:35.320 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:42:35.322 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:42:35.324 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:42:35.328 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:42:35.370 INFO:teuthology.orchestra.run.smithi070.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T21:42:35.387 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:35.397 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:42:35.398 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:42:35.399 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:42:35.400 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:42:35.401 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:42:35.402 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:42:35.403 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:42:35.404 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:42:35.405 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:42:35.406 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:42:35.407 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:42:35.408 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:42:35.409 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout:Install 149 Packages 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 8 Packages 2024-09-10T21:42:35.410 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:42:35.411 INFO:teuthology.orchestra.run.smithi070.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-10T21:42:35.411 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 240 M 2024-09-10T21:42:35.411 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-10T21:42:35.429 INFO:teuthology.orchestra.run.smithi070.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T21:42:35.504 INFO:teuthology.orchestra.run.smithi070.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-10T21:42:35.513 INFO:teuthology.orchestra.run.smithi039.stdout:(11/157): ceph-common-19.3.0-4854.g8f219c47.el9 8.4 MB/s | 22 MB 00:02 2024-09-10T21:42:35.538 INFO:teuthology.orchestra.run.smithi039.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 899 kB/s | 225 kB 00:00 2024-09-10T21:42:35.546 INFO:teuthology.orchestra.run.smithi070.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-10T21:42:35.555 INFO:teuthology.orchestra.run.smithi039.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 648 kB/s | 27 kB 00:00 2024-09-10T21:42:35.571 INFO:teuthology.orchestra.run.smithi070.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T21:42:35.572 INFO:teuthology.orchestra.run.smithi039.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 952 kB/s | 32 kB 00:00 2024-09-10T21:42:35.622 INFO:teuthology.orchestra.run.smithi039.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.1 MB/s | 162 kB 00:00 2024-09-10T21:42:35.647 INFO:teuthology.orchestra.run.smithi039.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 8.0 MB/s | 755 kB 00:00 2024-09-10T21:42:35.663 INFO:teuthology.orchestra.run.smithi070.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-10T21:42:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T21:42:35.691 INFO:teuthology.orchestra.run.smithi070.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 511 kB/s | 61 kB 00:00 2024-09-10T21:42:35.717 INFO:teuthology.orchestra.run.smithi070.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.5 MB/s | 245 kB 00:00 2024-09-10T21:42:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 6.6 MB/s | 507 kB 00:00 2024-09-10T21:42:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-09-10T21:42:35.742 INFO:teuthology.orchestra.run.smithi070.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-10T21:42:35.760 INFO:teuthology.orchestra.run.smithi070.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 610 kB/s | 26 kB 00:00 2024-09-10T21:42:35.773 INFO:teuthology.orchestra.run.smithi039.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 908 kB/s | 45 kB 00:00 2024-09-10T21:42:35.784 INFO:teuthology.orchestra.run.smithi070.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 458 kB/s | 19 kB 00:00 2024-09-10T21:42:35.810 INFO:teuthology.orchestra.run.smithi070.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-10T21:42:35.827 INFO:teuthology.orchestra.run.smithi070.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 832 kB/s | 35 kB 00:00 2024-09-10T21:42:35.857 INFO:teuthology.orchestra.run.smithi039.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T21:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-10T21:42:35.935 INFO:teuthology.orchestra.run.smithi070.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T21:42:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.7 MB/s | 161 kB 00:00 2024-09-10T21:42:35.961 INFO:teuthology.orchestra.run.smithi070.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T21:42:35.986 INFO:teuthology.orchestra.run.smithi070.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T21:42:36.003 INFO:teuthology.orchestra.run.smithi070.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T21:42:36.037 INFO:teuthology.orchestra.run.smithi070.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-10T21:42:36.041 INFO:teuthology.orchestra.run.smithi039.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.4 MB/s | 321 kB 00:00 2024-09-10T21:42:36.062 INFO:teuthology.orchestra.run.smithi070.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-10T21:42:36.088 INFO:teuthology.orchestra.run.smithi070.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T21:42:36.104 INFO:teuthology.orchestra.run.smithi070.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T21:42:36.133 INFO:teuthology.orchestra.run.smithi039.stdout:(23/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-10T21:42:36.158 INFO:teuthology.orchestra.run.smithi039.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 2.6 MB/s | 306 kB 00:00 2024-09-10T21:42:36.180 INFO:teuthology.orchestra.run.smithi070.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-10T21:42:36.183 INFO:teuthology.orchestra.run.smithi039.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T21:42:36.205 INFO:teuthology.orchestra.run.smithi070.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-10T21:42:36.208 INFO:teuthology.orchestra.run.smithi039.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T21:42:36.230 INFO:teuthology.orchestra.run.smithi070.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-10T21:42:36.256 INFO:teuthology.orchestra.run.smithi070.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-10T21:42:36.259 INFO:teuthology.orchestra.run.smithi039.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T21:42:36.259 INFO:teuthology.orchestra.run.smithi173.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 900 kB 00:00 2024-09-10T21:42:36.281 INFO:teuthology.orchestra.run.smithi070.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T21:42:36.306 INFO:teuthology.orchestra.run.smithi070.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-10T21:42:36.331 INFO:teuthology.orchestra.run.smithi070.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-10T21:42:36.357 INFO:teuthology.orchestra.run.smithi070.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T21:42:36.376 INFO:teuthology.orchestra.run.smithi039.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 17 MB/s | 3.2 MB 00:00 2024-09-10T21:42:36.382 INFO:teuthology.orchestra.run.smithi070.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T21:42:36.401 INFO:teuthology.orchestra.run.smithi173.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.0 MB/s | 145 kB 00:00 2024-09-10T21:42:36.401 INFO:teuthology.orchestra.run.smithi039.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 241 kB/s | 34 kB 00:00 2024-09-10T21:42:36.407 INFO:teuthology.orchestra.run.smithi070.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T21:42:36.426 INFO:teuthology.orchestra.run.smithi039.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-10T21:42:36.433 INFO:teuthology.orchestra.run.smithi070.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T21:42:36.458 INFO:teuthology.orchestra.run.smithi070.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-10T21:42:36.566 INFO:teuthology.orchestra.run.smithi070.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-10T21:42:36.775 INFO:teuthology.orchestra.run.smithi070.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T21:42:36.809 INFO:teuthology.orchestra.run.smithi070.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-09-10T21:42:36.842 INFO:teuthology.orchestra.run.smithi070.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-10T21:42:36.884 INFO:teuthology.orchestra.run.smithi070.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-10T21:42:36.926 INFO:teuthology.orchestra.run.smithi070.stdout:(109/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-09-10T21:42:36.960 INFO:teuthology.orchestra.run.smithi070.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-09-10T21:42:36.985 INFO:teuthology.orchestra.run.smithi070.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 858 kB/s | 49 kB 00:00 2024-09-10T21:42:37.010 INFO:teuthology.orchestra.run.smithi070.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T21:42:37.044 INFO:teuthology.orchestra.run.smithi070.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T21:42:37.119 INFO:teuthology.orchestra.run.smithi070.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-10T21:42:37.153 INFO:teuthology.orchestra.run.smithi070.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-10T21:42:37.178 INFO:teuthology.orchestra.run.smithi070.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-09-10T21:42:37.204 INFO:teuthology.orchestra.run.smithi070.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 637 kB/s | 32 kB 00:00 2024-09-10T21:42:37.229 INFO:teuthology.orchestra.run.smithi070.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T21:42:37.254 INFO:teuthology.orchestra.run.smithi070.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T21:42:37.270 INFO:teuthology.orchestra.run.smithi173.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 3.3 MB/s | 5.5 MB 00:01 2024-09-10T21:42:37.305 INFO:teuthology.orchestra.run.smithi070.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-10T21:42:37.330 INFO:teuthology.orchestra.run.smithi070.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-10T21:42:37.363 INFO:teuthology.orchestra.run.smithi070.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T21:42:37.397 INFO:teuthology.orchestra.run.smithi070.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T21:42:37.418 INFO:teuthology.orchestra.run.smithi173.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-10T21:42:37.422 INFO:teuthology.orchestra.run.smithi070.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T21:42:37.481 INFO:teuthology.orchestra.run.smithi070.stdout:(125/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-10T21:42:37.485 INFO:teuthology.orchestra.run.smithi039.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 21 MB/s | 50 MB 00:02 2024-09-10T21:42:37.498 INFO:teuthology.orchestra.run.smithi070.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-09-10T21:42:37.510 INFO:teuthology.orchestra.run.smithi173.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-09-10T21:42:37.532 INFO:teuthology.orchestra.run.smithi070.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T21:42:37.549 INFO:teuthology.orchestra.run.smithi070.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-10T21:42:37.566 INFO:teuthology.orchestra.run.smithi070.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-10T21:42:37.568 INFO:teuthology.orchestra.run.smithi039.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.5 MB/s | 7.4 MB 00:01 2024-09-10T21:42:37.582 INFO:teuthology.orchestra.run.smithi070.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-10T21:42:37.594 INFO:teuthology.orchestra.run.smithi039.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.6 MB/s | 291 kB 00:00 2024-09-10T21:42:37.616 INFO:teuthology.orchestra.run.smithi070.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T21:42:37.619 INFO:teuthology.orchestra.run.smithi039.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 980 kB/s | 49 kB 00:00 2024-09-10T21:42:37.644 INFO:teuthology.orchestra.run.smithi039.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T21:42:37.667 INFO:teuthology.orchestra.run.smithi070.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-10T21:42:37.670 INFO:teuthology.orchestra.run.smithi039.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T21:42:37.692 INFO:teuthology.orchestra.run.smithi070.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-10T21:42:37.717 INFO:teuthology.orchestra.run.smithi070.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-10T21:42:37.728 INFO:teuthology.orchestra.run.smithi039.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-10T21:42:37.742 INFO:teuthology.orchestra.run.smithi070.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-10T21:42:37.754 INFO:teuthology.orchestra.run.smithi039.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 218 kB/s | 18 kB 00:00 2024-09-10T21:42:37.768 INFO:teuthology.orchestra.run.smithi173.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 4.8 MB 00:00 2024-09-10T21:42:37.776 INFO:teuthology.orchestra.run.smithi070.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-10T21:42:37.801 INFO:teuthology.orchestra.run.smithi070.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-10T21:42:37.827 INFO:teuthology.orchestra.run.smithi070.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T21:42:37.852 INFO:teuthology.orchestra.run.smithi070.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 825 kB/s | 90 kB 00:00 2024-09-10T21:42:37.885 INFO:teuthology.orchestra.run.smithi070.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-10T21:42:37.904 INFO:teuthology.orchestra.run.smithi039.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.4 MB/s | 14 MB 00:01 2024-09-10T21:42:37.910 INFO:teuthology.orchestra.run.smithi070.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-09-10T21:42:37.936 INFO:teuthology.orchestra.run.smithi070.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-10T21:42:37.961 INFO:teuthology.orchestra.run.smithi070.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-10T21:42:37.987 INFO:teuthology.orchestra.run.smithi070.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T21:42:38.012 INFO:teuthology.orchestra.run.smithi070.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T21:42:38.037 INFO:teuthology.orchestra.run.smithi070.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-10T21:42:38.063 INFO:teuthology.orchestra.run.smithi070.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T21:42:38.088 INFO:teuthology.orchestra.run.smithi070.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T21:42:38.177 INFO:teuthology.orchestra.run.smithi173.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 8.4 MB/s | 22 MB 00:02 2024-09-10T21:42:38.180 INFO:teuthology.orchestra.run.smithi070.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T21:42:38.227 INFO:teuthology.orchestra.run.smithi173.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 504 kB/s | 25 kB 00:00 2024-09-10T21:42:38.305 INFO:teuthology.orchestra.run.smithi070.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-09-10T21:42:38.372 INFO:teuthology.orchestra.run.smithi070.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.5 MB 00:00 2024-09-10T21:42:38.422 INFO:teuthology.orchestra.run.smithi070.stdout:(152/157): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-10T21:42:38.444 INFO:teuthology.orchestra.run.smithi173.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 16 MB/s | 11 MB 00:00 2024-09-10T21:42:38.447 INFO:teuthology.orchestra.run.smithi070.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 544 kB/s | 41 kB 00:00 2024-09-10T21:42:38.495 INFO:teuthology.orchestra.run.smithi173.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T21:42:38.513 INFO:teuthology.orchestra.run.smithi039.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 102 kB/s | 80 kB 00:00 2024-09-10T21:42:38.531 INFO:teuthology.orchestra.run.smithi070.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-10T21:42:38.561 INFO:teuthology.orchestra.run.smithi173.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 407 kB/s | 27 kB 00:00 2024-09-10T21:42:38.573 INFO:teuthology.orchestra.run.smithi070.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-10T21:42:38.620 INFO:teuthology.orchestra.run.smithi173.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 544 kB/s | 32 kB 00:00 2024-09-10T21:42:38.640 INFO:teuthology.orchestra.run.smithi070.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-10T21:42:38.695 INFO:teuthology.orchestra.run.smithi173.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 9.9 MB/s | 755 kB 00:00 2024-09-10T21:42:38.713 INFO:teuthology.orchestra.run.smithi039.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 236 kB/s | 191 kB 00:00 2024-09-10T21:42:38.771 INFO:teuthology.orchestra.run.smithi173.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-10T21:42:38.832 INFO:teuthology.orchestra.run.smithi070.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 4.4 MB/s | 3.2 MB 00:00 2024-09-10T21:42:38.838 INFO:teuthology.orchestra.run.smithi173.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T21:42:38.838 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:42:38.839 INFO:teuthology.orchestra.run.smithi070.stdout:Total 26 MB/s | 240 MB 00:09 2024-09-10T21:42:38.921 INFO:teuthology.orchestra.run.smithi173.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 5.9 MB/s | 507 kB 00:00 2024-09-10T21:42:39.330 INFO:teuthology.orchestra.run.smithi173.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 5.5 MB 00:00 2024-09-10T21:42:39.380 INFO:teuthology.orchestra.run.smithi039.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 292 kB/s | 253 kB 00:00 2024-09-10T21:42:39.380 INFO:teuthology.orchestra.run.smithi173.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 907 kB/s | 45 kB 00:00 2024-09-10T21:42:39.455 INFO:teuthology.orchestra.run.smithi173.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-10T21:42:39.463 INFO:teuthology.orchestra.run.smithi039.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 469 kB/s | 801 kB 00:01 2024-09-10T21:42:39.939 INFO:teuthology.orchestra.run.smithi173.stdout:(21/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 29 MB/s | 50 MB 00:01 2024-09-10T21:42:39.964 INFO:teuthology.orchestra.run.smithi173.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 317 kB/s | 161 kB 00:00 2024-09-10T21:42:39.990 INFO:teuthology.orchestra.run.smithi173.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T21:42:40.015 INFO:teuthology.orchestra.run.smithi173.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.9 MB/s | 306 kB 00:00 2024-09-10T21:42:40.040 INFO:teuthology.orchestra.run.smithi173.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T21:42:40.066 INFO:teuthology.orchestra.run.smithi173.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T21:42:40.071 INFO:teuthology.orchestra.run.smithi039.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 154 kB/s | 106 kB 00:00 2024-09-10T21:42:40.081 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-10T21:42:40.133 INFO:teuthology.orchestra.run.smithi173.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-10T21:42:40.180 INFO:teuthology.orchestra.run.smithi039.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 189 kB/s | 135 kB 00:00 2024-09-10T21:42:40.191 INFO:teuthology.orchestra.run.smithi173.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 21 MB/s | 3.2 MB 00:00 2024-09-10T21:42:40.217 INFO:teuthology.orchestra.run.smithi173.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 410 kB/s | 34 kB 00:00 2024-09-10T21:42:40.233 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-10T21:42:40.233 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-10T21:42:40.242 INFO:teuthology.orchestra.run.smithi173.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-10T21:42:40.559 INFO:teuthology.orchestra.run.smithi173.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 23 MB/s | 7.4 MB 00:00 2024-09-10T21:42:40.618 INFO:teuthology.orchestra.run.smithi173.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-10T21:42:40.684 INFO:teuthology.orchestra.run.smithi173.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 742 kB/s | 49 kB 00:00 2024-09-10T21:42:40.735 INFO:teuthology.orchestra.run.smithi173.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T21:42:40.772 INFO:teuthology.orchestra.run.smithi039.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-09-10T21:42:40.814 INFO:teuthology.orchestra.run.smithi039.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 597 kB/s | 1.2 MB 00:02 2024-09-10T21:42:40.877 INFO:teuthology.orchestra.run.smithi173.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 21 MB/s | 14 MB 00:00 2024-09-10T21:42:40.902 INFO:teuthology.orchestra.run.smithi173.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 285 kB 00:00 2024-09-10T21:42:40.944 INFO:teuthology.orchestra.run.smithi173.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 12 MB/s | 783 kB 00:00 2024-09-10T21:42:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 313 kB/s | 18 kB 00:00 2024-09-10T21:42:40.972 INFO:teuthology.orchestra.run.smithi039.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-10T21:42:41.014 INFO:teuthology.orchestra.run.smithi039.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-10T21:42:41.040 INFO:teuthology.orchestra.run.smithi039.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-10T21:42:41.065 INFO:teuthology.orchestra.run.smithi039.stdout:(51/157): python3-urllib3-1.26.5-6.el9.noarch.r 243 kB/s | 215 kB 00:00 2024-09-10T21:42:41.078 INFO:teuthology.orchestra.run.smithi173.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-10T21:42:41.082 INFO:teuthology.orchestra.run.smithi039.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-10T21:42:41.108 INFO:teuthology.orchestra.run.smithi039.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-10T21:42:41.120 INFO:teuthology.orchestra.run.smithi173.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-10T21:42:41.124 INFO:teuthology.orchestra.run.smithi039.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 793 kB/s | 33 kB 00:00 2024-09-10T21:42:41.141 INFO:teuthology.orchestra.run.smithi039.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 545 kB/s | 18 kB 00:00 2024-09-10T21:42:41.158 INFO:teuthology.orchestra.run.smithi039.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-09-10T21:42:41.170 INFO:teuthology.orchestra.run.smithi173.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T21:42:41.183 INFO:teuthology.orchestra.run.smithi039.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-10T21:42:41.208 INFO:teuthology.orchestra.run.smithi039.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T21:42:41.212 INFO:teuthology.orchestra.run.smithi173.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-10T21:42:41.225 INFO:teuthology.orchestra.run.smithi039.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-10T21:42:41.259 INFO:teuthology.orchestra.run.smithi039.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-10T21:42:41.271 INFO:teuthology.orchestra.run.smithi173.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-10T21:42:41.296 INFO:teuthology.orchestra.run.smithi173.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-10T21:42:41.301 INFO:teuthology.orchestra.run.smithi039.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-10T21:42:41.326 INFO:teuthology.orchestra.run.smithi039.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-10T21:42:41.351 INFO:teuthology.orchestra.run.smithi039.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T21:42:41.377 INFO:teuthology.orchestra.run.smithi039.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T21:42:41.381 INFO:teuthology.orchestra.run.smithi173.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T21:42:41.402 INFO:teuthology.orchestra.run.smithi039.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T21:42:41.427 INFO:teuthology.orchestra.run.smithi039.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-10T21:42:41.486 INFO:teuthology.orchestra.run.smithi039.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-10T21:42:41.531 INFO:teuthology.orchestra.run.smithi173.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 533 kB/s | 125 kB 00:00 2024-09-10T21:42:41.578 INFO:teuthology.orchestra.run.smithi039.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-10T21:42:41.580 INFO:teuthology.orchestra.run.smithi173.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-09-10T21:42:41.620 INFO:teuthology.orchestra.run.smithi039.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T21:42:41.662 INFO:teuthology.orchestra.run.smithi039.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-10T21:42:41.729 INFO:teuthology.orchestra.run.smithi039.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T21:42:41.747 INFO:teuthology.orchestra.run.smithi173.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-10T21:42:41.754 INFO:teuthology.orchestra.run.smithi039.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-10T21:42:41.789 INFO:teuthology.orchestra.run.smithi173.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-10T21:42:41.796 INFO:teuthology.orchestra.run.smithi039.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-10T21:42:41.814 INFO:teuthology.orchestra.run.smithi173.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-10T21:42:41.838 INFO:teuthology.orchestra.run.smithi039.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T21:42:41.840 INFO:teuthology.orchestra.run.smithi173.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-10T21:42:41.881 INFO:teuthology.orchestra.run.smithi173.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 788 kB/s | 33 kB 00:00 2024-09-10T21:42:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-10T21:42:41.915 INFO:teuthology.orchestra.run.smithi173.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-10T21:42:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-09-10T21:42:41.957 INFO:teuthology.orchestra.run.smithi173.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-10T21:42:41.963 INFO:teuthology.orchestra.run.smithi039.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-10T21:42:41.997 INFO:teuthology.orchestra.run.smithi039.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-10T21:42:42.008 INFO:teuthology.orchestra.run.smithi173.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 220 kB/s | 11 kB 00:00 2024-09-10T21:42:42.014 INFO:teuthology.orchestra.run.smithi039.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-10T21:42:42.031 INFO:teuthology.orchestra.run.smithi039.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-10T21:42:42.067 INFO:teuthology.orchestra.run.smithi173.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-10T21:42:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T21:42:42.090 INFO:teuthology.orchestra.run.smithi039.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-10T21:42:42.124 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-10T21:42:42.125 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-10T21:42:42.132 INFO:teuthology.orchestra.run.smithi039.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-10T21:42:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-10T21:42:42.225 INFO:teuthology.orchestra.run.smithi173.stdout:(57/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 3.6 MB/s | 17 MB 00:04 2024-09-10T21:42:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-10T21:42:42.250 INFO:teuthology.orchestra.run.smithi173.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 704 kB/s | 171 kB 00:00 2024-09-10T21:42:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T21:42:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T21:42:42.293 INFO:teuthology.orchestra.run.smithi173.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 711 kB/s | 160 kB 00:00 2024-09-10T21:42:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-10T21:42:42.326 INFO:teuthology.orchestra.run.smithi173.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-10T21:42:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T21:42:42.351 INFO:teuthology.orchestra.run.smithi173.stdout:(61/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 360 kB/s | 45 kB 00:00 2024-09-10T21:42:42.401 INFO:teuthology.orchestra.run.smithi039.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-10T21:42:42.417 INFO:teuthology.orchestra.run.smithi039.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 612 kB/s | 51 kB 00:00 2024-09-10T21:42:42.441 INFO:teuthology.orchestra.run.smithi173.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 214 kB/s | 24 kB 00:00 2024-09-10T21:42:42.461 INFO:teuthology.orchestra.run.smithi173.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-10T21:42:42.490 INFO:teuthology.orchestra.run.smithi039.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-10T21:42:42.494 INFO:teuthology.orchestra.run.smithi173.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.4 MB/s | 292 kB 00:00 2024-09-10T21:42:42.510 INFO:teuthology.orchestra.run.smithi039.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-10T21:42:42.519 INFO:teuthology.orchestra.run.smithi173.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2024-09-10T21:42:42.535 INFO:teuthology.orchestra.run.smithi039.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 948 kB/s | 42 kB 00:00 2024-09-10T21:42:42.545 INFO:teuthology.orchestra.run.smithi173.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-10T21:42:42.560 INFO:teuthology.orchestra.run.smithi039.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-10T21:42:42.586 INFO:teuthology.orchestra.run.smithi039.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T21:42:42.591 INFO:teuthology.orchestra.run.smithi173.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 401 kB/s | 38 kB 00:00 2024-09-10T21:42:42.611 INFO:teuthology.orchestra.run.smithi039.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-10T21:42:42.666 INFO:teuthology.orchestra.run.smithi039.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 591 kB/s | 47 kB 00:00 2024-09-10T21:42:42.695 INFO:teuthology.orchestra.run.smithi039.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-10T21:42:42.704 INFO:teuthology.orchestra.run.smithi173.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-10T21:42:42.720 INFO:teuthology.orchestra.run.smithi039.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T21:42:42.745 INFO:teuthology.orchestra.run.smithi039.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T21:42:42.770 INFO:teuthology.orchestra.run.smithi039.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T21:42:42.779 INFO:teuthology.orchestra.run.smithi173.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-10T21:42:42.795 INFO:teuthology.orchestra.run.smithi039.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-10T21:42:42.821 INFO:teuthology.orchestra.run.smithi173.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 6.9 MB/s | 1.6 MB 00:00 2024-09-10T21:42:42.846 INFO:teuthology.orchestra.run.smithi173.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T21:42:42.888 INFO:teuthology.orchestra.run.smithi173.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-10T21:42:42.930 INFO:teuthology.orchestra.run.smithi173.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T21:42:42.955 INFO:teuthology.orchestra.run.smithi173.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T21:42:43.005 INFO:teuthology.orchestra.run.smithi173.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T21:42:43.038 INFO:teuthology.orchestra.run.smithi039.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T21:42:43.089 INFO:teuthology.orchestra.run.smithi173.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-10T21:42:43.123 INFO:teuthology.orchestra.run.smithi173.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-10T21:42:43.138 INFO:teuthology.orchestra.run.smithi039.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T21:42:43.156 INFO:teuthology.orchestra.run.smithi173.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-10T21:42:43.182 INFO:teuthology.orchestra.run.smithi173.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-10T21:42:43.188 INFO:teuthology.orchestra.run.smithi039.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 6.1 MB/s | 309 kB 00:00 2024-09-10T21:42:43.207 INFO:teuthology.orchestra.run.smithi173.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-10T21:42:43.213 INFO:teuthology.orchestra.run.smithi039.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-10T21:42:43.232 INFO:teuthology.orchestra.run.smithi173.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-10T21:42:43.239 INFO:teuthology.orchestra.run.smithi039.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 48 kB/s | 22 kB 00:00 2024-09-10T21:42:43.257 INFO:teuthology.orchestra.run.smithi173.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-10T21:42:43.281 INFO:teuthology.orchestra.run.smithi039.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-09-10T21:42:43.306 INFO:teuthology.orchestra.run.smithi039.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T21:42:43.331 INFO:teuthology.orchestra.run.smithi039.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T21:42:43.341 INFO:teuthology.orchestra.run.smithi173.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T21:42:43.356 INFO:teuthology.orchestra.run.smithi039.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T21:42:43.366 INFO:teuthology.orchestra.run.smithi173.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T21:42:43.392 INFO:teuthology.orchestra.run.smithi173.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T21:42:43.417 INFO:teuthology.orchestra.run.smithi173.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T21:42:43.442 INFO:teuthology.orchestra.run.smithi173.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-10T21:42:43.456 INFO:teuthology.orchestra.run.smithi039.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T21:42:43.468 INFO:teuthology.orchestra.run.smithi173.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T21:42:43.493 INFO:teuthology.orchestra.run.smithi173.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T21:42:43.520 INFO:teuthology.orchestra.run.smithi173.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T21:42:43.523 INFO:teuthology.orchestra.run.smithi039.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-10T21:42:43.544 INFO:teuthology.orchestra.run.smithi173.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T21:42:43.549 INFO:teuthology.orchestra.run.smithi039.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T21:42:43.569 INFO:teuthology.orchestra.run.smithi173.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T21:42:43.582 INFO:teuthology.orchestra.run.smithi039.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-09-10T21:42:43.607 INFO:teuthology.orchestra.run.smithi039.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-10T21:42:43.641 INFO:teuthology.orchestra.run.smithi039.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-10T21:42:43.652 INFO:teuthology.orchestra.run.smithi173.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T21:42:43.678 INFO:teuthology.orchestra.run.smithi173.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-10T21:42:43.700 INFO:teuthology.orchestra.run.smithi039.stdout:(119/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-10T21:42:43.703 INFO:teuthology.orchestra.run.smithi173.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-10T21:42:43.728 INFO:teuthology.orchestra.run.smithi173.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T21:42:43.733 INFO:teuthology.orchestra.run.smithi039.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-10T21:42:43.753 INFO:teuthology.orchestra.run.smithi173.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-10T21:42:43.758 INFO:teuthology.orchestra.run.smithi039.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T21:42:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T21:42:43.784 INFO:teuthology.orchestra.run.smithi039.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T21:42:43.812 INFO:teuthology.orchestra.run.smithi173.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T21:42:43.818 INFO:teuthology.orchestra.run.smithi039.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T21:42:43.834 INFO:teuthology.orchestra.run.smithi039.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 649 kB/s | 11 kB 00:00 2024-09-10T21:42:43.846 INFO:teuthology.orchestra.run.smithi173.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 58 kB 00:00 2024-09-10T21:42:43.851 INFO:teuthology.orchestra.run.smithi039.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-09-10T21:42:43.868 INFO:teuthology.orchestra.run.smithi039.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T21:42:43.871 INFO:teuthology.orchestra.run.smithi173.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T21:42:43.894 INFO:teuthology.orchestra.run.smithi039.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 773 kB/s | 19 kB 00:00 2024-09-10T21:42:43.896 INFO:teuthology.orchestra.run.smithi173.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T21:42:43.911 INFO:teuthology.orchestra.run.smithi039.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T21:42:43.922 INFO:teuthology.orchestra.run.smithi173.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-10T21:42:43.986 INFO:teuthology.orchestra.run.smithi039.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-10T21:42:44.003 INFO:teuthology.orchestra.run.smithi039.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-10T21:42:44.028 INFO:teuthology.orchestra.run.smithi039.stdout:(131/157): protobuf-compiler-3.14.0-13.el9.x86_ 701 kB/s | 863 kB 00:01 2024-09-10T21:42:44.053 INFO:teuthology.orchestra.run.smithi039.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T21:42:44.095 INFO:teuthology.orchestra.run.smithi039.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-10T21:42:44.121 INFO:teuthology.orchestra.run.smithi039.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-10T21:42:44.146 INFO:teuthology.orchestra.run.smithi039.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 340 kB/s | 16 kB 00:00 2024-09-10T21:42:44.171 INFO:teuthology.orchestra.run.smithi039.stdout:(136/157): python3-natsort-7.1.1-5.el9.noarch.r 405 kB/s | 58 kB 00:00 2024-09-10T21:42:44.189 INFO:teuthology.orchestra.run.smithi173.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-10T21:42:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-10T21:42:44.222 INFO:teuthology.orchestra.run.smithi039.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-09-10T21:42:44.247 INFO:teuthology.orchestra.run.smithi039.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-10T21:42:44.256 INFO:teuthology.orchestra.run.smithi173.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T21:42:44.272 INFO:teuthology.orchestra.run.smithi039.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T21:42:44.297 INFO:teuthology.orchestra.run.smithi039.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T21:42:44.298 INFO:teuthology.orchestra.run.smithi173.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 7.2 MB/s | 309 kB 00:00 2024-09-10T21:42:44.323 INFO:teuthology.orchestra.run.smithi039.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T21:42:44.323 INFO:teuthology.orchestra.run.smithi173.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-10T21:42:44.340 INFO:teuthology.orchestra.run.smithi039.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-10T21:42:44.365 INFO:teuthology.orchestra.run.smithi039.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-10T21:42:44.390 INFO:teuthology.orchestra.run.smithi039.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-10T21:42:44.416 INFO:teuthology.orchestra.run.smithi039.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-10T21:42:44.441 INFO:teuthology.orchestra.run.smithi039.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T21:42:44.466 INFO:teuthology.orchestra.run.smithi039.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-10T21:42:44.615 INFO:teuthology.orchestra.run.smithi173.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-10T21:42:44.625 INFO:teuthology.orchestra.run.smithi039.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-10T21:42:44.665 INFO:teuthology.orchestra.run.smithi173.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-10T21:42:44.690 INFO:teuthology.orchestra.run.smithi173.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T21:42:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T21:42:44.752 INFO:teuthology.orchestra.run.smithi039.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-10T21:42:44.791 INFO:teuthology.orchestra.run.smithi173.stdout:(112/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-10T21:42:44.808 INFO:teuthology.orchestra.run.smithi039.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-10T21:42:44.816 INFO:teuthology.orchestra.run.smithi173.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-10T21:42:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-09-10T21:42:44.926 INFO:teuthology.orchestra.run.smithi173.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-10T21:42:44.950 INFO:teuthology.orchestra.run.smithi173.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-09-10T21:42:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2024-09-10T21:42:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-10T21:42:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T21:42:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T21:42:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T21:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:(122/157): protobuf-compiler-3.14.0-13.el9.x86_ 707 kB/s | 863 kB 00:01 2024-09-10T21:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-10T21:42:45.211 INFO:teuthology.orchestra.run.smithi173.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 424 kB/s | 11 kB 00:00 2024-09-10T21:42:45.236 INFO:teuthology.orchestra.run.smithi173.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 770 kB/s | 18 kB 00:00 2024-09-10T21:42:45.262 INFO:teuthology.orchestra.run.smithi173.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-10T21:42:45.295 INFO:teuthology.orchestra.run.smithi173.stdout:(127/157): python3-grpcio-tools-1.46.7-10.el9.x 957 kB/s | 144 kB 00:00 2024-09-10T21:42:45.320 INFO:teuthology.orchestra.run.smithi173.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-09-10T21:42:45.346 INFO:teuthology.orchestra.run.smithi173.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T21:42:45.371 INFO:teuthology.orchestra.run.smithi173.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T21:42:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T21:42:45.405 INFO:teuthology.orchestra.run.smithi173.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T21:42:45.430 INFO:teuthology.orchestra.run.smithi173.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T21:42:45.481 INFO:teuthology.orchestra.run.smithi173.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-10T21:42:45.514 INFO:teuthology.orchestra.run.smithi173.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T21:42:45.540 INFO:teuthology.orchestra.run.smithi173.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-10T21:42:45.573 INFO:teuthology.orchestra.run.smithi173.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-09-10T21:42:45.598 INFO:teuthology.orchestra.run.smithi173.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-10T21:42:45.624 INFO:teuthology.orchestra.run.smithi173.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 825 kB/s | 90 kB 00:00 2024-09-10T21:42:45.649 INFO:teuthology.orchestra.run.smithi173.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-10T21:42:45.674 INFO:teuthology.orchestra.run.smithi173.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T21:42:45.699 INFO:teuthology.orchestra.run.smithi173.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T21:42:45.725 INFO:teuthology.orchestra.run.smithi173.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T21:42:45.750 INFO:teuthology.orchestra.run.smithi173.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-10T21:42:45.776 INFO:teuthology.orchestra.run.smithi173.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T21:42:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T21:42:45.826 INFO:teuthology.orchestra.run.smithi173.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T21:42:45.851 INFO:teuthology.orchestra.run.smithi173.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T21:42:45.877 INFO:teuthology.orchestra.run.smithi173.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T21:42:45.977 INFO:teuthology.orchestra.run.smithi173.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T21:42:46.144 INFO:teuthology.orchestra.run.smithi173.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-10T21:42:46.186 INFO:teuthology.orchestra.run.smithi173.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-10T21:42:46.226 INFO:teuthology.orchestra.run.smithi039.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 296 kB/s | 249 kB 00:00 2024-09-10T21:42:46.236 INFO:teuthology.orchestra.run.smithi173.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 816 kB/s | 41 kB 00:00 2024-09-10T21:42:46.278 INFO:teuthology.orchestra.run.smithi173.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-10T21:42:46.303 INFO:teuthology.orchestra.run.smithi173.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-10T21:42:46.379 INFO:teuthology.orchestra.run.smithi173.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-10T21:42:46.437 INFO:teuthology.orchestra.run.smithi173.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-10T21:42:46.509 INFO:teuthology.orchestra.run.smithi039.stdout:(154/157): NetworkManager-1.49.90-1.el9.x86_64. 1.2 MB/s | 2.3 MB 00:01 2024-09-10T21:42:46.537 INFO:teuthology.orchestra.run.smithi173.stdout:(157/157): librados2-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 3.5 MB 00:00 2024-09-10T21:42:46.544 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:42:46.544 INFO:teuthology.orchestra.run.smithi173.stdout:Total 22 MB/s | 240 MB 00:11 2024-09-10T21:42:47.729 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-10T21:42:47.768 INFO:teuthology.orchestra.run.smithi039.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 612 kB/s | 1.8 MB 00:03 2024-09-10T21:42:47.884 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-10T21:42:47.884 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-10T21:42:48.384 INFO:teuthology.orchestra.run.smithi039.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 642 kB/s | 1.4 MB 00:02 2024-09-10T21:42:48.536 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-10T21:42:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:42:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:42:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:42:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:42:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:42:48.862 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:42:49.198 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:42:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:42:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:42:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:42:49.547 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:42:49.576 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:42:49.605 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:42:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:42:49.775 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-10T21:42:49.775 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-10T21:42:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:42:49.843 INFO:teuthology.orchestra.run.smithi039.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 735 kB/s | 2.4 MB 00:03 2024-09-10T21:42:49.850 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:42:49.850 INFO:teuthology.orchestra.run.smithi039.stdout:Total 14 MB/s | 240 MB 00:17 2024-09-10T21:42:49.852 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:42:49.957 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:42:49.995 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:42:50.057 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:42:50.088 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:42:50.109 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:42:50.273 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:42:50.410 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:42:50.520 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:42:50.620 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:50.911 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:42:51.067 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:42:51.102 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:42:51.126 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-10T21:42:51.175 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:42:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:42:51.260 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:42:51.301 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-10T21:42:51.301 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-10T21:42:51.303 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:42:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:42:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:42:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:42:51.511 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:42:51.542 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:42:51.577 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:42:51.655 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:42:51.688 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:42:51.731 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:42:51.760 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:42:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:42:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:42:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:42:52.161 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:42:52.699 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:42:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:42:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:42:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:42:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:42:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:42:53.091 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:42:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:42:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:42:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:42:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:42:53.433 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:42:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:42:53.516 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:42:53.553 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:42:53.596 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:42:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:42:53.682 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-10T21:42:53.683 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-10T21:42:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:42:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:42:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:42:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:42:53.998 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:42:54.041 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:42:54.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:42:54.091 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:42:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:42:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:42:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:42:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:42:54.386 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:42:54.526 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:42:54.750 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:42:54.779 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:42:54.814 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:42:54.847 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:42:54.890 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:42:54.923 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:42:55.015 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:42:55.062 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:42:55.101 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:42:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:42:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:42:55.985 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:42:56.032 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:42:56.074 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:42:56.181 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:42:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:42:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:42:56.362 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-10T21:42:56.370 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:42:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:42:56.516 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:42:56.563 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:42:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:42:56.616 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:42:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:42:56.650 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:42:56.684 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:42:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:42:56.743 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:42:57.078 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:42:57.193 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:42:57.323 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:42:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:42:57.353 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:42:57.444 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:42:57.473 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:42:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:42:57.503 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:42:57.653 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:42:57.713 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:42:57.741 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:42:57.829 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:42:57.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:42:57.896 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:42:57.918 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:42:57.941 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:42:58.102 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:42:58.235 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:42:58.350 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:42:58.452 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:58.526 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:58.702 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:42:58.748 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:42:58.789 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:42:58.817 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:42:58.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:42:58.861 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:42:58.897 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:42:58.932 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:42:59.014 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:42:59.067 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:42:59.107 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:42:59.150 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:42:59.172 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:42:59.183 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:42:59.210 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:42:59.222 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:42:59.280 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:42:59.322 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:42:59.341 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:42:59.352 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:42:59.375 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:42:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:42:59.410 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:42:59.497 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:42:59.538 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:42:59.581 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:42:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:42:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:42:59.724 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:42:59.798 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:42:59.879 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:42:59.917 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:42:59.937 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:43:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:43:00.016 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:43:00.208 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-10T21:43:00.322 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:43:00.370 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:43:00.423 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:43:00.465 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:43:00.489 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:43:00.534 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:43:00.539 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:43:00.613 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:43:00.643 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:43:00.678 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:43:00.715 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:43:00.757 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:43:00.898 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:43:00.952 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:43:00.971 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:43:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:43:01.073 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:43:01.115 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:43:01.179 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:43:01.199 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:43:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:43:01.233 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:43:01.248 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:43:01.303 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:43:01.309 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:43:01.340 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:43:01.345 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:43:01.383 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:43:01.385 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:43:01.424 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:43:01.566 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:43:01.567 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:43:01.610 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:43:01.650 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:43:01.651 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:43:01.679 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:43:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:43:01.786 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:43:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:43:01.814 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:43:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:43:01.872 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:43:01.898 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:43:01.920 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:43:02.084 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:43:02.091 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:43:02.135 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:43:02.213 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:43:02.254 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:43:02.337 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:43:02.391 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:43:02.397 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:43:02.419 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:43:02.453 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:43:02.492 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:43:02.524 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:43:02.524 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:43:02.554 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:43:02.588 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:43:02.598 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:43:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:02.622 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:43:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:02.663 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:43:02.698 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:43:02.783 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:43:02.828 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:43:02.836 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:43:02.868 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:43:02.941 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:43:02.968 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:43:02.969 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:43:03.004 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:43:03.040 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:43:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:43:03.131 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:43:03.171 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:43:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:03.214 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:43:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:03.247 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:43:03.274 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:43:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:03.334 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:43:03.334 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:43:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:03.346 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:43:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:03.407 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:43:03.441 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:43:03.480 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:43:03.561 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:43:03.598 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:43:03.642 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:43:03.670 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:43:03.723 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:43:03.744 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:43:03.768 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:43:03.793 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:43:03.801 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:43:03.879 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:43:03.907 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:43:03.965 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:43:04.009 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:43:04.025 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:43:04.080 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:43:04.096 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:43:04.137 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:43:04.320 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:43:04.344 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:43:04.421 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:43:04.638 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:43:04.727 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:43:04.761 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:43:04.805 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:43:04.843 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:43:04.889 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:43:05.049 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:43:05.059 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:43:05.121 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:43:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:43:05.216 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:43:05.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:43:05.351 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:43:05.389 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:43:05.425 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:43:05.473 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:43:05.507 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:43:05.551 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:43:05.593 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:43:05.737 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:43:05.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:43:05.820 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:43:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:43:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:43:06.008 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:43:06.043 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:43:06.084 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:43:06.192 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:43:06.325 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:43:06.358 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:43:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:43:06.386 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:43:06.430 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:43:06.447 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:43:06.468 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:43:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:43:06.508 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:43:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:43:06.537 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:43:06.564 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:43:06.597 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:43:06.639 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:43:06.673 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:43:06.764 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:43:06.812 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:43:06.827 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:43:06.843 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:43:06.871 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:43:06.950 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:43:06.987 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:43:07.012 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:43:07.017 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:43:07.053 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:43:07.544 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:43:07.582 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:43:07.637 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:43:07.675 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:43:07.776 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:43:07.824 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:43:07.858 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:43:07.969 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:43:08.022 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:43:08.067 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:43:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:43:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:43:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:43:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:43:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:43:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:43:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:43:10.019 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:10.047 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:10.595 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:10.634 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:10.650 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:43:10.725 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:10.726 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:43:10.726 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:43:10.726 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:10.748 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:43:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:10.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:43:10.809 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:43:11.157 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:43:11.197 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:43:11.289 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:43:11.318 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:43:11.355 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:43:11.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:43:11.991 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:43:12.046 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:43:12.076 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:43:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:43:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-10T21:43:15.288 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-10T21:43:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:43:15.290 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:43:15.290 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:43:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:15.465 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:15.482 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:15.482 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:15.482 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:43:15.482 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:16.977 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:17.004 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:17.703 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:17.727 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:17.833 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:43:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:43:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:43:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:43:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:43:18.256 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:43:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:43:18.486 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:43:18.529 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:43:18.561 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:43:18.589 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:43:19.061 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:43:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:43:19.210 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-09-10T21:43:22.562 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:22.738 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:22.753 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:22.753 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:22.754 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:43:22.754 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:43:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:43:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:43:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:43:24.266 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:24.292 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:24.292 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:24.292 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:43:24.292 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:24.292 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:24.293 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:24.525 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:24.548 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:24.548 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:24.548 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:43:24.549 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:24.549 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:24.549 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:24.954 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:43:24.981 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:25.001 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:25.023 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:25.024 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:25.024 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:43:25.024 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:25.024 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:25.024 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:25.072 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:25.072 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:43:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:25.131 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:25.187 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:43:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:43:25.425 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:43:25.449 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:25.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:43:25.545 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:43:25.633 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:43:25.771 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:43:25.810 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:43:25.842 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:43:25.869 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:43:26.233 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:26.268 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:26.300 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:43:26.365 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:43:26.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:27.548 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-09-10T21:43:27.549 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:27.732 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:27.749 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:43:27.749 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:27.749 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:43:27.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:43:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:29.557 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:43:29.611 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:29.611 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:43:29.611 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:29.611 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:43:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:29.614 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:43:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:30.136 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:43:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:43:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:43:30.227 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:43:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:43:30.287 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:43:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:43:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:43:30.500 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:43:30.542 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:43:30.542 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:43:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:43:30.576 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:30.587 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:43:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:43:30.605 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:43:30.668 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:43:30.718 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:30.758 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:43:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:43:30.900 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:43:30.908 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:30.931 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:30.932 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:30.932 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:43:30.932 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:30.932 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:30.932 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:30.937 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:43:30.968 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:43:30.975 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:30.987 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:31.005 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:43:31.085 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:43:31.132 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:43:31.221 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:31.263 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:31.344 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:31.370 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:43:31.402 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:43:31.471 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:43:31.501 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:32.088 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:43:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:43:32.119 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:32.142 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:32.143 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:32.143 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:43:32.143 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:32.143 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:32.143 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:32.187 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:43:32.209 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:32.209 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:32.209 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:43:32.209 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:32.241 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:43:32.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:32.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:43:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:43:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:43:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:43:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:32.514 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:32.515 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:32.588 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:32.611 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:43:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:34.865 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:43:34.932 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:35.948 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:43:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:36.094 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:43:36.260 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:43:36.293 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:36.318 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:43:36.318 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:36.318 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:43:36.318 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:36.319 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:43:36.319 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:36.368 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:36.381 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:43:36.483 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:43:36.542 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:43:37.300 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:43:37.341 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:43:37.382 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:43:37.414 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:43:37.441 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:43:37.550 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:43:37.579 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:43:37.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:37.611 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:43:37.647 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:37.655 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:43:37.671 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:43:37.671 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:37.671 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:43:37.671 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:37.685 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:43:37.715 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:43:37.722 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:43:37.747 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:37.747 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:43:37.747 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:37.747 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:43:37.748 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:37.752 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:43:38.073 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:43:38.098 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:38.288 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:38.325 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:38.345 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:39.170 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:43:39.263 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:43:39.303 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:43:39.383 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:43:39.416 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:43:39.441 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:43:39.467 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:43:39.467 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:43:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:43:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:43:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:43:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:43:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:43:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:43:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:43:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:43:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:43:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:43:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:43:39.526 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:43:39.527 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:43:39.528 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:43:39.529 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:43:39.530 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:43:39.530 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:43:39.530 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:43:39.530 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:43:39.559 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:39.559 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:39.643 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:39.669 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:43:39.673 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:39.673 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:39.853 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:39.854 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:39.938 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:40.000 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:43:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:43:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:43:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:43:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:43:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:43:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:43:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:43:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:43:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:43:42.254 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-10T21:43:42.710 DEBUG:teuthology.parallel:result is None 2024-09-10T21:43:43.069 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:43:43.110 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:43:43.151 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:43:43.191 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:43:43.219 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:43:43.433 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:43:43.473 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:43:43.504 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:43:43.533 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:43:43.571 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:43:44.258 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:44.294 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:44.315 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:43:45.218 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:43:45.324 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:43:45.370 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:43:45.461 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:43:45.493 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:43:45.519 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:43:45.553 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:43:45.553 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:45.629 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:43:45.629 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:45.704 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:43:45.729 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:43:45.735 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:45.735 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:45.923 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:43:45.923 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:46.016 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:43:46.083 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:43:46.867 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:43:46.868 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:43:46.869 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:43:46.870 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:43:46.871 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:43:46.872 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:43:46.873 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:43:46.874 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:43:46.875 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:43:46.876 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:43:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:43:46.878 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:43:46.879 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:43:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:43:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:43:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:43:46.880 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:49.646 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.647 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.648 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:43:49.649 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.650 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:43:49.651 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:49.652 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.653 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:43:49.654 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:43:49.655 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:43:49.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:43:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:43:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:43:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:43:49.660 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-10T21:43:50.094 DEBUG:teuthology.parallel:result is None 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:43:52.596 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:43:52.597 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:43:52.597 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:43:52.597 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:43:52.597 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:43:52.600 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:43:52.601 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:43:52.602 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:43:52.603 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:43:52.604 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:43:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:43:52.606 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:43:52.607 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:43:52.608 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:43:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:43:52.610 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:43:52.611 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:43:52.612 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:43:55.414 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.415 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.416 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:43:55.417 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:43:55.418 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:43:55.419 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:43:55.420 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:43:55.421 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:43:55.422 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:43:55.423 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:43:55.424 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:43:55.425 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:43:55.426 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:43:55.427 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:43:55.427 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:43:55.427 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-10T21:43:55.845 DEBUG:teuthology.parallel:result is None 2024-09-10T21:43:55.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:56.000 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:43:56.024 INFO:teuthology.orchestra.run.smithi039.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.025 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.025 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:43:56.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:56.194 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:43:56.222 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.222 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.222 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:43:56.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:56.373 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:43:56.399 INFO:teuthology.orchestra.run.smithi173.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.400 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:43:56.400 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:43:56.402 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T21:43:56.402 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:43:56.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:43:56.433 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:43:56.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:43:56.465 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:43:56.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:43:56.499 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T21:43:56.499 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:43:56.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:43:56.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:43:56.596 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:43:56.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:43:56.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:43:56.697 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:43:56.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:43:56.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:43:56.796 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T21:43:56.797 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:43:56.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:43:56.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:43:56.893 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:43:56.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:43:56.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:43:56.984 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:43:56.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:43:57.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:43:57.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T21:43:57.081 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:43:57.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:43:57.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:43:57.177 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:43:57.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:43:57.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:43:57.267 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:43:57.267 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:43:57.294 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:43:57.361 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T21:43:57.460 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T21:43:57.460 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:57.461 INFO:tasks.cephadm:Cluster fsid is c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:43:57.461 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T21:43:57.461 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.39', 'mon.b': '172.21.15.70', 'mon.c': '172.21.15.173'} 2024-09-10T21:43:57.461 INFO:tasks.cephadm:First mon is mon.a on smithi039 2024-09-10T21:43:57.461 INFO:tasks.cephadm:First mgr is x 2024-09-10T21:43:57.461 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T21:43:57.462 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2024-09-10T21:43:57.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-09-10T21:43:57.517 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-09-10T21:43:57.544 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T21:43:57.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:57.693 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T21:43:57.839 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:43:57.843 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T21:43:57.843 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T21:43:57.843 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:58.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:43 /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:58.229 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:58.614 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:43 /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:58.615 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:59.427 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:43 /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:59.427 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:59.449 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:59.471 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:43:59.514 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T21:43:59.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:43:59.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:43:59.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:44:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:44:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:44:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:44:30.695 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T21:44:30.696 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:44:30.696 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:44:30.696 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-09-10T21:44:30.696 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:44:30.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T21:44:30.697 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T21:44:31.603 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:44:31.603 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:44:31.604 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:44:31.604 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2024-09-10T21:44:31.604 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:44:31.604 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T21:44:31.604 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:44:36.419 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-10T21:44:36.420 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-10T21:44:36.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2024-09-10T21:44:36.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-09-10T21:44:36.514 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-09-10T21:44:36.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2024-09-10T21:44:36.572 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-09-10T21:44:36.602 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-09-10T21:44:36.627 INFO:tasks.cephadm:Writing seed config... 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T21:44:36.629 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T21:44:36.630 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T21:44:36.631 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T21:44:36.631 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T21:44:36.631 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T21:44:36.631 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T21:44:36.631 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T21:44:36.632 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:44:36.632 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T21:44:36.651 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c8786c20-6fbd-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T21:44:36.651 DEBUG:teuthology.orchestra.run.smithi039:mon.a> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T21:44:36.693 DEBUG:teuthology.orchestra.run.smithi039:mgr.x> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T21:44:36.736 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T21:44:36.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.39 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:44:36.955 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:44:36.955 INFO:teuthology.orchestra.run.smithi039.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.39', '--skip-admin-label'] 2024-09-10T21:44:36.955 INFO:teuthology.orchestra.run.smithi039.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T21:44:36.955 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying podman|docker is present... 2024-09-10T21:44:36.979 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-10T21:44:36.979 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying lvm2 is present... 2024-09-10T21:44:36.979 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying time synchronization is in place... 2024-09-10T21:44:36.988 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T21:44:36.989 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T21:44:36.994 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T21:44:36.994 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:44:37.001 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-10T21:44:37.007 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-10T21:44:37.007 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-10T21:44:37.008 INFO:teuthology.orchestra.run.smithi039.stdout:Repeating the final host check... 2024-09-10T21:44:37.030 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-10T21:44:37.031 INFO:teuthology.orchestra.run.smithi039.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T21:44:37.031 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl is present 2024-09-10T21:44:37.031 INFO:teuthology.orchestra.run.smithi039.stdout:lvcreate is present 2024-09-10T21:44:37.037 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T21:44:37.037 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T21:44:37.043 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T21:44:37.044 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:44:37.051 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-10T21:44:37.058 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Host looks OK 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Cluster fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Acquiring lock 140659165741936 on /run/cephadm/c8786c20-6fbd-11ef-bcea-c7b262605968.lock 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Lock 140659165741936 acquired on /run/cephadm/c8786c20-6fbd-11ef-bcea-c7b262605968.lock 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 3300 ... 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 6789 ... 2024-09-10T21:44:37.059 INFO:teuthology.orchestra.run.smithi039.stdout:Base mon IP(s) is [172.21.15.39:3300, 172.21.15.39:6789], mon addrv is [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-10T21:44:37.062 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.39 metric 100 2024-09-10T21:44:37.062 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.39 metric 100 2024-09-10T21:44:37.064 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T21:44:37.065 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T21:44:37.065 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1767sec hoplimit 64 pref medium 2024-09-10T21:44:37.067 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T21:44:37.067 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T21:44:37.067 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T21:44:37.067 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T21:44:37.067 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-10T21:44:37.068 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T21:44:37.068 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-10T21:44:37.068 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-10T21:44:37.068 INFO:teuthology.orchestra.run.smithi039.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T21:44:37.069 INFO:teuthology.orchestra.run.smithi039.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T21:44:37.069 INFO:teuthology.orchestra.run.smithi039.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:44:37.522 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T21:44:37.523 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T21:44:38.328 INFO:teuthology.orchestra.run.smithi039.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T21:44:38.328 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T21:44:38.328 INFO:teuthology.orchestra.run.smithi039.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T21:44:39.160 INFO:teuthology.orchestra.run.smithi039.stdout:stat: stdout 167 167 2024-09-10T21:44:39.160 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial keys... 2024-09-10T21:44:40.258 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQDHveBm861oJRAAFX3c7SnRJcWSIa95cpeijg== 2024-09-10T21:44:41.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQDIveBmfltaIhAAHGsv9xVGtgaz+Bl4+aFuXA== 2024-09-10T21:44:42.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQDJveBmlUmeHRAAbWZHMiFETzYv4W8qFCOCnw== 2024-09-10T21:44:42.129 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial monmap... 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool for a [v2:172.21.15.39:3300,v1:172.21.15.39:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: set fsid to c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T21:44:43.002 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:44:43.003 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mon... 2024-09-10T21:44:43.942 INFO:teuthology.orchestra.run.smithi039.stdout:create mon.a on 2024-09-10T21:44:44.156 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T21:44:44.337 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T21:44:44.928 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target. 2024-09-10T21:44:44.928 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target. 2024-09-10T21:44:45.721 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a 2024-09-10T21:44:45.721 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T21:44:46.122 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target.wants/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@.service. 2024-09-10T21:44:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:46 smithi039 podman[30487]: 2024-09-10 21:44:46.402315846 +0000 UTC m=+0.016350699 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:44:47.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:47 smithi039 podman[30487]: 2024-09-10 21:44:47.512478467 +0000 UTC m=+1.126513312 container create ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T21:44:49.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:49 smithi039 podman[30487]: 2024-09-10 21:44:49.304704703 +0000 UTC m=+2.918739548 container init ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T21:44:49.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:49 smithi039 podman[30487]: 2024-09-10 21:44:49.308998552 +0000 UTC m=+2.923033397 container start ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-10T21:44:49.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:49 smithi039 ceph-mon[30507]: mkfs c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:49.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:49 smithi039 ceph-mon[30507]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:44:50.083 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:44:50.084 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-10T21:44:50.092 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:44:50.092 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:44:50.092 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-10T21:44:50.092 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T21:44:50.093 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon to start... 2024-09-10T21:44:50.093 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon... 2024-09-10T21:44:50.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 bash[30487]: ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 2024-09-10T21:44:50.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 systemd[1]: Started Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:44:50.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:44:50.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: monmap epoch 1 2024-09-10T21:44:50.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:50.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: last_changed 2024-09-10T21:44:42.426463+0000 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: min_mon_release 19 (squid) 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: election_strategy: 1 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: fsmap 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T21:44:50.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:50 smithi039 ceph-mon[30507]: mgrmap e1: no daemons active 2024-09-10T21:44:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:53 smithi039 ceph-mon[30507]: from='client.? 172.21.15.39:0/2391835923' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout id: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout services: 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 3s) 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:57.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout data: 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:mon is available 2024-09-10T21:44:57.579 INFO:teuthology.orchestra.run.smithi039.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T21:44:58.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:58 smithi039 ceph-mon[30507]: from='client.? 172.21.15.39:0/4201217191' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T21:44:58.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:58 smithi039 ceph-mon[30507]: from='client.? 172.21.15.39:0/4201217191' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T21:44:58.584 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:58.584 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T21:44:58.584 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:44:58.584 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T21:44:58.584 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T21:44:58.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T21:44:58.586 INFO:teuthology.orchestra.run.smithi039.stdout:Generating new minimal ceph.conf... 2024-09-10T21:44:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:59 smithi039 ceph-mon[30507]: from='client.? 172.21.15.39:0/4242818271' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:44:59.614 INFO:teuthology.orchestra.run.smithi039.stdout:Restarting the monitor... 2024-09-10T21:44:59.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:59 smithi039 systemd[1]: Stopping Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:45:00.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a[30503]: 2024-09-10T21:44:59.880+0000 7f8c50b96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:45:00.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:44:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a[30503]: 2024-09-10T21:44:59.881+0000 7f8c50b96640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T21:45:00.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 podman[30749]: 2024-09-10 21:45:00.035078215 +0000 UTC m=+0.251597143 container died ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T21:45:00.533 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 podman[30749]: 2024-09-10 21:45:00.297717384 +0000 UTC m=+0.514236312 container cleanup ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T21:45:00.533 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 bash[30749]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a 2024-09-10T21:45:00.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 podman[30761]: 2024-09-10 21:45:00.532180477 +0000 UTC m=+0.496414061 container remove ce618dcc1c5e5a7254db5368361779e3e219c977a103f9c4b0e968acf74b2569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:45:00.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T21:45:00.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 systemd[1]: Stopped Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:45:00.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 systemd[1]: Starting Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:45:01.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 podman[30853]: 2024-09-10 21:45:00.78324559 +0000 UTC m=+0.016377835 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:45:01.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:00 smithi039 podman[30853]: 2024-09-10 21:45:00.882982189 +0000 UTC m=+0.116114427 container create 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T21:45:01.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 podman[30853]: 2024-09-10 21:45:01.110590519 +0000 UTC m=+0.343722755 container init 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T21:45:01.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 podman[30853]: 2024-09-10 21:45:01.113929274 +0000 UTC m=+0.347061512 container start 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T21:45:01.199 INFO:teuthology.orchestra.run.smithi039.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T21:45:01.419 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T21:45:01.419 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T21:45:01.419 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: pidfile_write: ignore empty --pid-file 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: load: jerasure load: lrc 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: RocksDB version: 7.9.2 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Git sha 0 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: DB SUMMARY 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: DB Session ID: 24OX88DD1VHJ3JE65KTE 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: CURRENT file: CURRENT 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T21:45:01.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96361 ; 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.error_if_exists: 0 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.create_if_missing: 0 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.paranoid_checks: 1 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.env: 0x55e8f1b76180 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.info_log: 0x55e8f2d0f700 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.statistics: (nil) 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.use_fsync: 0 2024-09-10T21:45:01.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_log_file_size: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_fallocate: 1 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.use_direct_reads: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.db_log_dir: 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.wal_dir: 2024-09-10T21:45:01.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T21:45:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.write_buffer_manager: 0x55e8f2d13b80 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.unordered_write: 0 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T21:45:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.row_cache: None 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.wal_filter: None 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.two_write_queues: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.wal_compression: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.atomic_flush: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T21:45:01.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.log_readahead_size: 0 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_background_jobs: 2 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_background_compactions: -1 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_subcompactions: 1 2024-09-10T21:45:01.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_open_files: -1 2024-09-10T21:45:01.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_background_flushes: -1 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Compression algorithms supported: 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kZSTD supported: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kXpressCompression supported: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kBZip2Compression supported: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kLZ4Compression supported: 1 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kZlibCompression supported: 1 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: kSnappyCompression supported: 1 2024-09-10T21:45:01.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.merge_operator: 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_filter: None 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e8f2d0f320) 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks: 1 2024-09-10T21:45:01.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_top_level_index_and_filter: 1 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_type: 0 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_index_type: 0 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_shortening: 1 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: checksum: 4 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: no_block_cache: 0 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache: 0x55e8f2d03610 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_name: BinnedLRUCache 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_options: 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: capacity : 536870912 2024-09-10T21:45:01.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_shard_bits : 4 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: strict_capacity_limit : 0 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: high_pri_pool_ratio: 0.000 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_compressed: (nil) 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: persistent_cache: (nil) 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size: 4096 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size_deviation: 10 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_restart_interval: 16 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_block_restart_interval: 1 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: metadata_block_size: 4096 2024-09-10T21:45:01.432 INFO:journalctl@ceph.mon.a.smithi039.stdout: partition_filters: 0 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: use_delta_encoding: 1 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: filter_policy: bloomfilter 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: whole_key_filtering: 1 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: verify_compression: 0 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: read_amp_bytes_per_bit: 0 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: format_version: 5 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_index_compression: 1 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_align: 0 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: max_auto_readahead_size: 262144 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: prepopulate_block_cache: 0 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: initial_auto_readahead_size: 8192 2024-09-10T21:45:01.433 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression: NoCompression 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.num_levels: 7 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T21:45:01.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T21:45:01.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T21:45:01.436 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T21:45:01.437 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.inplace_update_support: 0 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T21:45:01.438 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.bloom_locality: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.max_successive_merges: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.ttl: 2592000 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T21:45:01.439 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enable_blob_files: false 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.min_blob_size: 0 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T21:45:01.440 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8a596075-291a-435a-99fd-48c85f4cfd07 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004701141120, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004701142743, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92277, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 295, "table_properties": {"data_size": 90318, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11960, "raw_average_key_size": 47, "raw_value_size": 83584, "raw_average_value_size": 334, "num_data_blocks": 12, "num_entries": 250, "num_filter_entries": 250, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726004701, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8a596075-291a-435a-99fd-48c85f4cfd07", "db_session_id": "24OX88DD1VHJ3JE65KTE", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004701142883, "job": 1, "event": "recovery_finished"} 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e8f2d32e00 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: DB pointer 0x55e8f2e34000 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T21:45:01.441 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** DB Stats ** 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: L0 2/0 91.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:45:01.442 INFO:journalctl@ceph.mon.a.smithi039.stdout: Sum 2/0 91.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 85.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T21:45:01.443 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative compaction: 0.00 GB write, 17.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval compaction: 0.00 GB write, 17.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache BinnedLRUCache@0x55e8f2d03610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.444 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: starting mon.a rank 0 at public addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] at bind addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???) e1 preinit fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).mds e1 new map 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).mds e1 print_map 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: e1 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: btime 2024-09-10T21:44:49:362931+0000 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: legacy client fscid: -1 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout: No filesystems configured 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T21:45:01.445 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 bash[30853]: 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 systemd[1]: Started Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: monmap epoch 1 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: last_changed 2024-09-10T21:44:42.426463+0000 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: min_mon_release 19 (squid) 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: election_strategy: 1 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:45:01.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: fsmap 2024-09-10T21:45:01.447 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T21:45:01.447 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:01 smithi039 ceph-mon[30872]: mgrmap e1: no daemons active 2024-09-10T21:45:02.204 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T21:45:02.234 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:45:02.234 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mgr... 2024-09-10T21:45:02.235 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T21:45:02.235 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T21:45:02.505 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x 2024-09-10T21:45:02.505 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T21:45:02.669 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968.target.wants/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@.service. 2024-09-10T21:45:02.904 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:02 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3020618701' entity='client.admin' 2024-09-10T21:45:02.905 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:02 smithi039 systemd[1]: Starting Ceph mgr.x for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:45:03.174 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:02 smithi039 podman[31085]: 2024-09-10 21:45:02.80685724 +0000 UTC m=+0.016553470 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:45:04.129 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:03 smithi039 podman[31085]: 2024-09-10 21:45:03.817783109 +0000 UTC m=+1.027479329 container create b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T21:45:04.129 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:04 smithi039 podman[31085]: 2024-09-10 21:45:04.012099229 +0000 UTC m=+1.221795456 container init b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T21:45:04.129 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:04 smithi039 podman[31085]: 2024-09-10 21:45:04.015020167 +0000 UTC m=+1.224716385 container start b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T21:45:04.144 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:45:04.144 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-10T21:45:04.153 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:45:04.153 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:45:04.153 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-10T21:45:04.153 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T21:45:04.162 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:45:04.162 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-10T21:45:04.169 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:45:04.169 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:45:04.169 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-10T21:45:04.169 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T21:45:04.170 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr to start... 2024-09-10T21:45:04.170 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr... 2024-09-10T21:45:04.406 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:04 smithi039 bash[31085]: b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d 2024-09-10T21:45:04.406 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:04 smithi039 systemd[1]: Started Ceph mgr.x for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:45:05.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:04 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/835405404' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:45:05.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:45:05.184 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:45:05.185 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:45:05.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:45:05.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:45:05.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:45:05.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:44:49:362931+0000", 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:45:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:44:49.365122+0000", 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (1/15)... 2024-09-10T21:45:07.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:07 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1447606708' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:45:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:08.306 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:08.306 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T21:45:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:45:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:45:08.311 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.311 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:44:49:362931+0000", 2024-09-10T21:45:08.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:45:08.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:44:49.365122+0000", 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:08.314 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (2/15)... 2024-09-10T21:45:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: Activating manager daemon x 2024-09-10T21:45:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: mgrmap e2: x(active, starting, since 0.00495318s) 2024-09-10T21:45:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:45:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: Manager daemon x is now available 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' 2024-09-10T21:45:09.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:09 smithi039 ceph-mon[30872]: from='mgr.14100 172.21.15.39:0/738964770' entity='mgr.x' 2024-09-10T21:45:11.567 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:11 smithi039 ceph-mon[30872]: mgrmap e3: x(active, since 1.00974s) 2024-09-10T21:45:11.567 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:11 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1134567514' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:45:11.569 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:45:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:45:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:45:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:11.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:45:11.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:44:49:362931+0000", 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:45:11.578 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:44:49.365122+0000", 2024-09-10T21:45:11.579 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:45:11.580 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:45:11.580 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:45:11.580 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:11.580 INFO:teuthology.orchestra.run.smithi039.stdout:mgr is available 2024-09-10T21:45:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:12 smithi039 ceph-mon[30872]: mgrmap e4: x(active, since 2s) 2024-09-10T21:45:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3745068789' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T21:45:12.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T21:45:12.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T21:45:12.638 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling cephadm module... 2024-09-10T21:45:13.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:13 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3661603540' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T21:45:13.673 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ignoring --setuser ceph since I am not root 2024-09-10T21:45:13.673 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ignoring --setgroup ceph since I am not root 2024-09-10T21:45:14.498 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:14 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3661603540' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T21:45:14.498 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:14 smithi039 ceph-mon[30872]: mgrmap e5: x(active, since 4s) 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-10T21:45:15.041 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 5... 2024-09-10T21:45:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:15 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3908148783' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T21:45:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: Active manager daemon x restarted 2024-09-10T21:45:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: Activating manager daemon x 2024-09-10T21:45:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T21:45:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: mgrmap e6: x(active, starting, since 0.00795985s) 2024-09-10T21:45:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:45:18.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:45:18.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:45:18.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:45:18.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:45:18.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:18 smithi039 ceph-mon[30872]: Manager daemon x is now available 2024-09-10T21:45:20.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:20.123 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T21:45:20.123 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T21:45:20.123 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:20.123 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 5 is available 2024-09-10T21:45:20.123 INFO:teuthology.orchestra.run.smithi039.stdout:Setting orchestrator backend to cephadm... 2024-09-10T21:45:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: mgrmap e7: x(active, since 1.00541s) 2024-09-10T21:45:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: Found migration_current of "None". Setting to last migration. 2024-09-10T21:45:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:20.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:20.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:20.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:20.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:45:20.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:20 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:45:21.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:21 smithi039 ceph-mon[30872]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:21.908 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:21 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:21.908 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:21 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:21.908 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:21 smithi039 ceph-mon[30872]: mgrmap e8: x(active, since 2s) 2024-09-10T21:45:22.470 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T21:45:22.470 INFO:teuthology.orchestra.run.smithi039.stdout:Generating ssh key... 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-mon[30872]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:45:22.661+0000 7f859414e640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:21:45:22] ENGINE Error in HTTPServer.serve 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: Traceback (most recent call last): 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:45:22.871 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._connections.run(self.expiration_interval) 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._run(expiration_interval) 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: s = self.context.wrap_socket( 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: return self.sslsocket_class._create( 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self.do_handshake() 2024-09-10T21:45:22.872 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:45:22.873 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._sslobj.do_handshake() 2024-09-10T21:45:22.873 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:45:22.873 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:22 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:45:23.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:22] ENGINE Bus STARTING 2024-09-10T21:45:23.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:22] ENGINE Serving on https://172.21.15.39:7150 2024-09-10T21:45:23.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:22] ENGINE Error in HTTPServer.serve 2024-09-10T21:45:23.923 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-10T21:45:23.924 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:22] ENGINE Serving on http://172.21.15.39:8765 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:22] ENGINE Bus STARTED 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: Generating ssh key... 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:23.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: Generating public/private rsa key pair. 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: Your identification has been saved in /tmp/tmp4iz0ng01/key 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: Your public key has been saved in /tmp/tmp4iz0ng01/key.pub 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: The key fingerprint is: 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: SHA256:434SWuenA57nvs3r8tbharFkgnbVRDOC8/8qCTW1fQ4 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: The key's randomart image is: 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: +---[RSA 3072]----+ 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | ...+ | 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | o .oo | 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | o + o | 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | = E o| 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | S. o o o.| 2024-09-10T21:45:23.926 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | .*.= + o .| 2024-09-10T21:45:23.927 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | =.B = * o | 2024-09-10T21:45:23.927 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | ..+ *oB o .| 2024-09-10T21:45:23.927 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: | .*=@B+.. | 2024-09-10T21:45:23.927 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:23 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: +----[SHA256]-----+ 2024-09-10T21:45:25.326 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:25.326 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:45:25.326 INFO:teuthology.orchestra.run.smithi039.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T21:45:25.334 INFO:teuthology.orchestra.run.smithi039.stdout:Adding host smithi039... 2024-09-10T21:45:25.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:25 smithi039 ceph-mon[30872]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:26.605 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:26 smithi039 ceph-mon[30872]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:27.509 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:27 smithi039 ceph-mon[30872]: Deploying cephadm binary to smithi039 2024-09-10T21:45:30.303 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Added host 'smithi039' with addr '172.21.15.39' 2024-09-10T21:45:30.303 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mon service... 2024-09-10T21:45:30.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:30 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:30.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:30 smithi039 ceph-mon[30872]: Added host smithi039 2024-09-10T21:45:30.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:30 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:31.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T21:45:31.587 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mgr service... 2024-09-10T21:45:32.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:31 smithi039 ceph-mon[30872]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:32.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:31 smithi039 ceph-mon[30872]: Saving service mon spec with placement count:5 2024-09-10T21:45:32.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:31 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:33.288 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:33 smithi039 ceph-mon[30872]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:33.288 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:33 smithi039 ceph-mon[30872]: Saving service mgr spec with placement count:2 2024-09-10T21:45:33.288 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:33 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:33.288 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:33 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:33.533 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T21:45:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:34 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:34 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2205929489' entity='client.admin' 2024-09-10T21:45:36.262 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:35 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:36.262 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:35 smithi039 ceph-mon[30872]: from='mgr.14118 172.21.15.39:0/4014527168' entity='mgr.x' 2024-09-10T21:45:36.515 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling the dashboard module... 2024-09-10T21:45:37.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:37 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2933231736' entity='client.admin' 2024-09-10T21:45:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:38 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2583430899' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T21:45:38.423 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ignoring --setuser ceph since I am not root 2024-09-10T21:45:38.424 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ignoring --setgroup ceph since I am not root 2024-09-10T21:45:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:39 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2583430899' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T21:45:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:39 smithi039 ceph-mon[30872]: mgrmap e9: x(active, since 19s) 2024-09-10T21:45:39.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:39.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-10T21:45:39.785 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 9... 2024-09-10T21:45:40.050 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:40 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1830767126' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T21:45:43.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: Active manager daemon x restarted 2024-09-10T21:45:43.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: Activating manager daemon x 2024-09-10T21:45:43.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: mgrmap e10: x(active, starting, since 0.0126896s) 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:45:43.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:43 smithi039 ceph-mon[30872]: Manager daemon x is now available 2024-09-10T21:45:44.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:44.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:45:44.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:45:44.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:44 smithi039 ceph-mon[30872]: mgrmap e11: x(active, since 1.01188s) 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 9 is available 2024-09-10T21:45:44.849 INFO:teuthology.orchestra.run.smithi039.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T21:45:45.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-mon[30872]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T21:45:45.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-mon[30872]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:45:45.381+0000 7f6da6640640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:21:45:45] ENGINE Error in HTTPServer.serve 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: Traceback (most recent call last): 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._connections.run(self.expiration_interval) 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._run(expiration_interval) 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:45:45.666 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: s = self.context.wrap_socket( 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: return self.sslsocket_class._create( 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self.do_handshake() 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: self._sslobj.do_handshake() 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:45:45.667 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:45:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:45:46.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:45] ENGINE Bus STARTING 2024-09-10T21:45:46.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:45] ENGINE Serving on https://172.21.15.39:7150 2024-09-10T21:45:46.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:45] ENGINE Error in HTTPServer.serve 2024-09-10T21:45:46.673 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-10T21:45:46.673 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-10T21:45:46.674 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: mgrmap e12: x(active, since 2s) 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:45] ENGINE Serving on http://172.21.15.39:8765 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: [10/Sep/2024:21:45:45] ENGINE Bus STARTED 2024-09-10T21:45:46.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:47.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUQHwYu8UHxONGT2mI8uIELD6WazEwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIxNDU0N1oXDTM0\nMDkxMTIxNDU0N1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA0Ko9A9gQtCu+HSK3ZXsBnFeH/uRMoP6l5+CD\n/ihPWXpT1aXztiPhgqV4dyPObKUGBKeGygN+/4LPSNTA2rOwxgovSxrN8nzLD6Dl\nkT4on0NsKjpANXAey1mzlPq4EILTegfcI2ugaKZl/uJhtQmaENtodsQetXH5RlUf\nAZ81Ehj40ABT2xU2rm04B3r7JG5RfTA2dQXYLzWQpsgfQK97dVkReB8eEfBX/yLs\nycj3A7kn5lgUK+aGDedSY3SvCSkepsXinSOYx53ylItGjuAZ2Hjyl7oapJjsCBBC\ndRa6D77WoGcjo6OTkSFDBYKJpxE/jdbGii7cR7rfiPmP1AZvFp+VAwBEkU8Fyyzy\n6SGKxS8Ew87p9+nMY/ieBrSusiLaYdzUMrUTjryJeJ6bnz6W7BpKNX5KTOzh/sCV\nEOqAnatL0HceNWfLU9lVmPlEs/D4u0IsbYgC9tbCOB5l1plCatSsk+hAif4sF5qr\n9AKdxCvzKVAmWPDmhR/CurSx+j0uXx7VlPh8ywft3mIpx4qGor+RmonEVyL//RJ/\nnhIEXCEr7Urkwh/fk+VJ0yRAcOitB7bEdtvTimCzj1Tm/7q6C6MexV7tdvxlZF5j\nB0nVYW5aZw2jdQU/BT3EiDu4NYUAiqEtZXphtbF8kT/eLHpv1WJuYYbNWV1LBYjd\nfXR+XoMCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDM5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPJzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCg\nQxWrME3jpdBFkZC1EpSbXHWVRv1jXLVVsHJvVqVPsTuVgPPbBqkKnJqcuf34nOvX\n+wHsYzvrvbhOx+jmPeQiGPSZRQD2+zzzMUfvlcdMx+35QeHGDDW0B8dfkOK3+2Gp\nOwWzSt/q2HBbR1ZL34ZLUZYUqFIJRDSpKt6q47RIT0zPShDHB0estoPnFepkgMU6\nlqD6g3HA9bR9YlEdeIo4xz4pXui0xKNPU94lEKBXe6cjKGssLuHEkGr8DSJEwWTK\nn8firC7tk93s2+ZbEOZEI1O0/e0jTeNxfijVam4jMrOhoS5aLkkVzNUjBYjNrq6m\nyA3ds15XnYWzOBiejZO7KG0IgmQKs+QHsAV6jeUuTKdTRrDS5FGz0YBpCP+zm00Y\nZXtcKB1z4KmF+t33Q0EdIrP5XSP41FAV+C0Vvq5vEChvdlLYotzdbN/0FUNRV0uB\na1yy3nWgxRevS02R6KfcqRIy34ze5M8JEjiP882dFMFaMKaZJN5ofi9dILkZFqQ3\nfOvQllCeT9yT6B8vL2qgcCg5YASB77du9tOdtyMq/aRPEAtHNDOs25rNG+eBhXmc\nuXG+OQ0Eil9EMbCqkM/tr0S/QyrOLyN1gn+XnbgeIugcdVbEp9Y0iIt6X3BQTxWb\n+tGiHyCfUEMOWpRVnLvZJx6TC3pVcgn1vHs8VwZkyg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEA0Ko9A9gQtCu+HSK3ZXsBnFeH/uRMoP6l5+CD/ihPWXpT1aXz\ntiPhgqV4dyPObKUGBKeGygN+/4LPSNTA2rOwxgovSxrN8nzLD6DlkT4on0NsKjpA\nNXAey1mzlPq4EILTegfcI2ugaKZl/uJhtQmaENtodsQetXH5RlUfAZ81Ehj40ABT\n2xU2rm04B3r7JG5RfTA2dQXYLzWQpsgfQK97dVkReB8eEfBX/yLsycj3A7kn5lgU\nK+aGDedSY3SvCSkepsXinSOYx53ylItGjuAZ2Hjyl7oapJjsCBBCdRa6D77WoGcj\no6OTkSFDBYKJpxE/jdbGii7cR7rfiPmP1AZvFp+VAwBEkU8Fyyzy6SGKxS8Ew87p\n9+nMY/ieBrSusiLaYdzUMrUTjryJeJ6bnz6W7BpKNX5KTOzh/sCVEOqAnatL0Hce\nNWfLU9lVmPlEs/D4u0IsbYgC9tbCOB5l1plCatSsk+hAif4sF5qr9AKdxCvzKVAm\nWPDmhR/CurSx+j0uXx7VlPh8ywft3mIpx4qGor+RmonEVyL//RJ/nhIEXCEr7Urk\nwh/fk+VJ0yRAcOitB7bEdtvTimCzj1Tm/7q6C6MexV7tdvxlZF5jB0nVYW5aZw2j\ndQU/BT3EiDu4NYUAiqEtZXphtbF8kT/eLHpv1WJuYYbNWV1LBYjdfXR+XoMCAwEA\nAQKCAgAM32OyOAMXylcJHxonRYZc6b13CQh9Khh8DIq4BC6Y+4XueTVmuCHyWFjt\nKKVUaH3NjbQwBDUyeBRnjtBy7YDrRreSL44i9nXkee2Pn0EMSjGDDWLmqQsNSnRc\nrXbrddasAY4gFUSpEBLcvYR/kZ8SiSaRpRmr4eMZ5qhqBjNU8XtwAYUqz802x4Ac\nXgbeQXv/eBjz8S9cAjbxQwlCiVDZdWwxd+H4A1a6Y6It9JrgfOysNiTQbIE6nFml\nzw35R7MfYLfRL9/9+I19gnYQ3Fxb0WJN3+pC2zg8axxecs95pzFAZfx53N5+pomm\n7l2lk9fS3TwUTD3Eow+lOJgZ4We65fqJoK/nwvk9Xnhb+2SRs5Q7gBp36ml7jJ5P\nDRb5Dykci4i2x9wEBld92l/9CzGUsiMyIMM3VKhFtLPejx7AH9k1kl8eYuwLHeHe\nmycAqdmQtT1Uy1LUDnDn90VaEPfGD4LK+po7A7J4RrQcFUK9ABds+7kpR7PBwCIo\nFikcyo1jHUbMFwnR+z8qSHENBBauovemDmCr41IiTo1njyvk4oCRQuwIkSa78Iow\nymsr9iIeS1aWnwTcvtjGp6PT0GqxvlI/vosZ3eBDs2jwbRJdeXnp9DuCm8TXLj65\n+fPY+DCwR8pGvtNE/ZWMw5oMYDAPya+38S2Mv+fwB1S+vimIOQKCAQEA9ztpgpA6\ny3y1k3IAH1KD8VkBGhvUBMNULXp+xwb02sCVWzmwQjDc/f+i0s5dwiRIsNnGzvCH\nAsHXqUTUol3DsR+EXQGtTM4ikg/J9jGCkYofdP0Wr7yq5jMkwFHKPiROuIxE0eN6\n11UAbpy8aRNXk+UYskhy/oikFwoe2jssb7JkNR2mmaOUlySDDVQ0WnAgmpPhSxhD\nrb1lYci6iyn7jrw2NrIbO4Z+NTVcGbxchG8OfKAwTZatHDWOyvkOCeQXhP7nDRQb\nomdQZP4qrIBQ6QXK/FjhGIR0Iam3ivSDhPnPNPY4LgwKyzdn2cZ0/ssW9ZRuvjyg\nxD9xkG0NRJGkDQKCAQEA2BCuPtuhfdYvg/4AIstW8zYr6/VVav5tLuAuHcbBpGjX\nCiq7JYWvgWcPfQrm/cUGFMnCVRlO4dsclOcLpzjfAT5hRvYMgOfqLO7G599Yk6fw\nydOWYD680isBX6QkRTgh2pmZBO/7+HW1BCTSlP43/IQGKNfyLQ+23s9DYE76p2sI\nGsvqtVkuA84CRBjKhSUW1ydSqnV6Wjisy6S1hT3I9eHlFL/CfM1FGL0QPDlWuxxz\nV1bezNR3NxlK6aNDCmaAXnUXktMP8I655DRu0XURzBjPF/lJMLSOAHCphCKt4cgE\nJXPdwz9T2D4MQyb6ZYRz2drr85dfy5gGPqy2qt+YzwKCAQBcn7SaxsBQRiuczuP+\n2CI4hHjmODDJjAh4dWET3aZUYjxSjh1b3wScYG62/bugpYlaQGy8UN60CL1sXC4x\nmmFbdYxYb+1mTgAjqqimhMv/DLlWUg9yzYNVdSm6p6nWeDHJ8DtESy5ViDH+PthT\noXx5GyaSfJQgij63pwICDpNKUZI7WB13iBJ+QZ6bmsV2cHW2k9qfELsiV0epR9Oj\nmZn2UssY2MddGLkl5BTaS3h54UWTKUyPdPjsDaCuqHo6+GpbWEhl3Pexc3VqMNL6\nB6TIeHQg8Id8cPs1NWlfNNYlNpYLqIdJsRdGJT7SFwj0AFBctzx6Jyqv+3jnfAOx\ngcLtAoIBAQCESgJFnjfMUh2ZlSUEKLe+Bcbym62G6uxyrPPPa2gYf9BZ+zvGh4mj\nkzRafRhc/ArzI20GqY4wnvVq/eOWqS1xF3578h5JtrUceb3zLj6PeV3mVNRXbVIy\n4/3dTySd9PZVX4HfEgiWYYtJVDpS2yvwQe17iGxQxrRSy1gXWYQCiXfW4E9+ZXHV\nBodApmUpDEJlzT/B+lfFcbnqnZg+Ukv+sCaQg7BStWO+99M+7GR7/7lnGlsj0lqD\ns8q4LivX7FZgfxTF4tB5mwmZ/bh0KleRPQdfSFRVq9bd0h0YOBt6h/px6/U1nEp7\ntdHQM8dP7L75/h5FcMNIZnY8XYciK/DlAoIBAQC4nl5dXqorIKQ2ktfNAzxn6ZJz\nr2li1fIQPmCGdDleHclWr2sb2MKDRgzC3cZerxv6OmhUjGkLonMFMO/mdm6+Tn7z\nogWGsmse9GwNdI+IoZVjawThYVnr2fDnYCEprhIb5Z72Ph977HHQdb+0z/sWrkN0\niWHh7T0FD5FjY0WJFDQPJffeTgxfvWyrLAiRpNrui8tAilOEMo0QHGNWTEXlvzc7\nD3Gx0N4JgVeEG2/mSe7vc/9UyXD4lj3XyTz35SVcqopqcOcT5tjK5/VowCIwt5J+\nSGsyivXZM7pkRO9hogs16vrDgfhCTe4eEUxpbGhmEOPjCTIpOgRoLv0bgtl/\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T21:45:47.808 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:49.552 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:49 smithi039 ceph-mon[30872]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:49.552 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:49.555 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T21:45:50.803 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T21:45:50.803 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial admin user... 2024-09-10T21:45:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:51 smithi039 ceph-mon[30872]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:52.285 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.7J3RgFSVOLi0y2tc.17v.6KvX/k.Pgifgb1GVNyaRg0RGFSW0nZi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726004751, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T21:45:52.285 INFO:teuthology.orchestra.run.smithi039.stdout:Fetching dashboard port number... 2024-09-10T21:45:52.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:52 smithi039 ceph-mon[30872]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:52.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:53.449 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T21:45:53.460 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:45:53.460 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-10T21:45:53.468 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:45:53.468 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-10T21:45:53.468 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-10T21:45:53.468 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph Dashboard is now available at: 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout: URL: https://smithi039.front.sepia.ceph.com:8443/ 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout: User: admin 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout: Password: 3swan8mcim 2024-09-10T21:45:53.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:53.471 INFO:teuthology.orchestra.run.smithi039.stdout:Saving cluster configuration to /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config directory 2024-09-10T21:45:54.120 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:53 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1884671322' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T21:45:54.680 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T21:45:54.680 INFO:teuthology.orchestra.run.smithi039.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T21:45:54.680 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.680 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: ceph telemetry on 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout:For more information see: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:45:54.681 INFO:teuthology.orchestra.run.smithi039.stdout:Bootstrap complete. 2024-09-10T21:45:54.721 INFO:tasks.cephadm:Fetching config... 2024-09-10T21:45:54.721 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:45:54.721 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T21:45:54.739 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T21:45:54.739 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:45:54.739 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T21:45:54.796 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T21:45:54.796 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:45:54.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T21:45:54.862 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T21:45:54.862 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:45:54.862 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T21:45:54.918 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T21:45:54.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:45:54.997 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:55.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:45:55.050 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:55.063 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:45:55.104 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LkgwVV9ZXV2YNMenHrwYMZnDged40/I/+l3WUJSMhZXQngg4LR6YSUFqDFlMEIF1HZbR3dSpBnMmukzHbfbfRLKELvh7VpYxR82nfo1h7Q1LTB+WLaivXbfgXuD0PcYf5aS+nXTGbRmuCTbm6rxyz/ZyHXbu+TG90sySCqsw1nFfLKrTfzp1lKFBxA/l/g4+YWg4edMeG6VbBozpkwOdtJvfyzEGVTSw2EdO6wYEzEy0KknneCrgeedQ12/5oRkHopxZbtEzUgQwwcYa+hm0z585hH/91DcezhzwRCLwK+ob20fs2EmxyxhIwH21zMFASgOk/0ft7Nfkwbe0JbxksawgQp3GZQvpaJMyATwy/wtWYpe+68pUFEtKNg6a3G815MdyZbg0pqAtMLYIhwn5jxBjEdn+k2V2qzvFxl2SWsPvZk8dtBcDd5L4GAuVtQo4Fiv0LUg0EXwAYwR8GTlozsQg9aOsC59d570mXSdLOz6N5/1eLOk+D43vVRHgu2k= ceph-c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:45:55.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T21:45:55.374 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:45:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:55 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1032730242' entity='client.admin' 2024-09-10T21:45:56.996 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T21:45:56.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1886159190' entity='client.admin' 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: mgrmap e13: x(active, since 12s) 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"} : dispatch 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:57.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:45:58.800 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi070 2024-09-10T21:45:58.800 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:45:58.800 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/etc/ceph/ceph.conf 2024-09-10T21:45:58.822 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:45:58.822 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:45:58.882 INFO:tasks.cephadm:Adding host smithi070 to orchestrator... 2024-09-10T21:45:58.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch host add smithi070 2024-09-10T21:45:59.389 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:45:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: Updating smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: Updating smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:45:59.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:45:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:00 smithi039 ceph-mon[30872]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:02 smithi039 ceph-mon[30872]: Deploying cephadm binary to smithi070 2024-09-10T21:46:03.890 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi070' with addr '172.21.15.70' 2024-09-10T21:46:04.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T21:46:04.664 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:05.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:05.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:05.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: Added host smithi070 2024-09-10T21:46:05.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:05.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:05.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:46:05.238 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}] 2024-09-10T21:46:05.862 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-09-10T21:46:05.862 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:46:05.862 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-09-10T21:46:05.882 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:46:05.882 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:05.941 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-09-10T21:46:05.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch host add smithi173 2024-09-10T21:46:06.194 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:06.560 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:06.560 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:06 smithi039 ceph-mon[30872]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:46:06.560 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:06 smithi039 ceph-mon[30872]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:07.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:07 smithi039 ceph-mon[30872]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:09.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:09.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: Deploying cephadm binary to smithi173 2024-09-10T21:46:09.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:09.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:10.325 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:10 smithi039 ceph-mon[30872]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:10.325 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:10 smithi039 ceph-mon[30872]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:10.325 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:10 smithi039 ceph-mon[30872]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:10.709 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-09-10T21:46:11.257 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:11 smithi039 ceph-mon[30872]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:11.257 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:11.257 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:11.257 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:11.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T21:46:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:12.176 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:46:12.176 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-09-10T21:46:12.177 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:12 smithi039 ceph-mon[30872]: Added host smithi173 2024-09-10T21:46:12.177 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:12.177 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:12.732 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T21:46:12.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T21:46:12.986 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:13.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:13 smithi039 ceph-mon[30872]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-09-10T21:46:14.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:14 smithi039 ceph-mon[30872]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:46:14.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:14 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T21:46:14.660 INFO:tasks.cephadm:Adding mon.a on smithi039 2024-09-10T21:46:14.660 INFO:tasks.cephadm:Adding mon.b on smithi070 2024-09-10T21:46:14.660 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-09-10T21:46:14.661 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c' 2024-09-10T21:46:14.903 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T21:46:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T21:46:15.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"} : dispatch 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:15.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:15 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:15.668 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-09-10T21:46:16.313 DEBUG:teuthology.orchestra.run.smithi070:mon.b> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T21:46:16.316 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T21:46:16.318 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:46:16.318 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:46:16.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:16.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:16.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:16.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:16.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:16.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:16.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:17.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:17.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c;count:3 2024-09-10T21:46:17.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:17 smithi039 ceph-mon[30872]: Deploying daemon mon.c on smithi173 2024-09-10T21:46:18.329 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:46:18.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:18 smithi039 ceph-mon[30872]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:19.158 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:46:19.158 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","modified":"2024-09-10T21:44:42.426463Z","created":"2024-09-10T21:44:42.426463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T21:46:19.158 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-09-10T21:46:19.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:19 smithi173 systemd[1]: Starting Ceph mon.c for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:46:19.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:19 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/2383918826' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:20.253 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:19 smithi173 podman[35275]: 2024-09-10 21:46:19.991636481 +0000 UTC m=+0.110437202 container create c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:46:20.253 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:19 smithi173 podman[35275]: 2024-09-10 21:46:19.901032447 +0000 UTC m=+0.019833182 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 podman[35275]: 2024-09-10 21:46:20.2022916 +0000 UTC m=+0.321092320 container init c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 podman[35275]: 2024-09-10 21:46:20.205324557 +0000 UTC m=+0.324125272 container start c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pidfile_write: ignore empty --pid-file 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: load: jerasure load: lrc 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: RocksDB version: 7.9.2 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Git sha 0 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T21:46:20.254 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: DB SUMMARY 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: DB Session ID: O5HD8MCSAWIGX0Q6BT3N 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: CURRENT file: CURRENT 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.error_if_exists: 0 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.create_if_missing: 0 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.paranoid_checks: 1 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.env: 0x5639f5dd9180 2024-09-10T21:46:20.255 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.info_log: 0x5639f7d5d700 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.statistics: (nil) 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.use_fsync: 0 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_log_file_size: 0 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_fallocate: 1 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T21:46:20.256 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.use_direct_reads: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.db_log_dir: 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.wal_dir: 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.write_buffer_manager: 0x5639f7d61b80 2024-09-10T21:46:20.257 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.unordered_write: 0 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T21:46:20.258 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.row_cache: None 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.wal_filter: None 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.two_write_queues: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.wal_compression: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.atomic_flush: 0 2024-09-10T21:46:20.259 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.log_readahead_size: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T21:46:20.260 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_background_jobs: 2 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_background_compactions: -1 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_subcompactions: 1 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_open_files: -1 2024-09-10T21:46:20.261 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_background_flushes: -1 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Compression algorithms supported: 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kZSTD supported: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kXpressCompression supported: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kBZip2Compression supported: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kLZ4Compression supported: 1 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kZlibCompression supported: 1 2024-09-10T21:46:20.262 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: kSnappyCompression supported: 1 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.merge_operator: 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_filter: None 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T21:46:20.263 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5639f7d5d320) 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 4 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x5639f7d51610 2024-09-10T21:46:20.264 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2024-09-10T21:46:20.265 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2024-09-10T21:46:20.266 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2024-09-10T21:46:20.266 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2024-09-10T21:46:20.267 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2024-09-10T21:46:20.267 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2024-09-10T21:46:20.267 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2024-09-10T21:46:20.267 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2024-09-10T21:46:20.267 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: bloomfilter 2024-09-10T21:46:20.268 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2024-09-10T21:46:20.268 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2024-09-10T21:46:20.268 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-09-10T21:46:20.268 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 5 2024-09-10T21:46:20.268 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2024-09-10T21:46:20.269 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2024-09-10T21:46:20.269 INFO:journalctl@ceph.mon.c.smithi173.stdout: max_auto_readahead_size: 262144 2024-09-10T21:46:20.269 INFO:journalctl@ceph.mon.c.smithi173.stdout: prepopulate_block_cache: 0 2024-09-10T21:46:20.269 INFO:journalctl@ceph.mon.c.smithi173.stdout: initial_auto_readahead_size: 8192 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression: NoCompression 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T21:46:20.270 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.num_levels: 7 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T21:46:20.271 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T21:46:20.272 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T21:46:20.273 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:46:20.273 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T21:46:20.273 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T21:46:20.273 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T21:46:20.273 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T21:46:20.274 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T21:46:20.275 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T21:46:20.276 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T21:46:20.277 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T21:46:20.277 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T21:46:20.277 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T21:46:20.277 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T21:46:20.277 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T21:46:20.278 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T21:46:20.278 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.inplace_update_support: 0 2024-09-10T21:46:20.278 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T21:46:20.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T21:46:20.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T21:46:20.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.bloom_locality: 0 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.max_successive_merges: 0 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T21:46:20.281 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T21:46:20.282 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.ttl: 2592000 2024-09-10T21:46:20.282 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T21:46:20.282 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T21:46:20.282 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T21:46:20.282 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enable_blob_files: false 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.min_blob_size: 0 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T21:46:20.283 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T21:46:20.284 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T21:46:20.284 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T21:46:20.284 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T21:46:20.284 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T21:46:20.284 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dcb403a8-6c6a-44bd-ab8f-d99149e2c361 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004780232168, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004780232580, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726004780, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dcb403a8-6c6a-44bd-ab8f-d99149e2c361", "db_session_id": "O5HD8MCSAWIGX0Q6BT3N", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004780232673, "job": 1, "event": "recovery_finished"} 2024-09-10T21:46:20.285 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5639f7d80e00 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: DB pointer 0x5639f7e82000 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T21:46:20.286 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:46:20.287 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.288 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache BinnedLRUCache@0x5639f7d51610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T21:46:20.289 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: using public_addr v2:172.21.15.173:0/0 -> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(???) e0 preinit fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: btime 2024-09-10T21:44:49:362931+0000 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T21:46:20.290 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:20.291 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Added host smithi173 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"} : dispatch 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:20.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:20.295 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c;count:3 2024-09-10T21:46:20.296 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: Deploying daemon mon.c on smithi173 2024-09-10T21:46:20.296 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.296 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/2383918826' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:20.296 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.296 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 ceph-mon[35294]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T21:46:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:20 smithi039 ceph-mon[30872]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 bash[35275]: c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 2024-09-10T21:46:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:20 smithi173 systemd[1]: Started Ceph mon.c for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:46:20.763 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:46:20.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:46:21.015 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:46:25.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: mon.a calling monitor election 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: mon.c calling monitor election 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: monmap epoch 2 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: last_changed 2024-09-10T21:46:20.256882+0000 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: min_mon_release 19 (squid) 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: election_strategy: 1 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: fsmap 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: mgrmap e13: x(active, since 41s) 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: overall HEALTH_OK 2024-09-10T21:46:25.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:25.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:25.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: mon.a calling monitor election 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: mon.c calling monitor election 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T21:46:25.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: monmap epoch 2 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: last_changed 2024-09-10T21:46:20.256882+0000 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: min_mon_release 19 (squid) 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: election_strategy: 1 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: fsmap 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: mgrmap e13: x(active, since 41s) 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: overall HEALTH_OK 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:25.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:25.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:26.097 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:46:26.097 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","modified":"2024-09-10T21:46:20.256882Z","created":"2024-09-10T21:44:42.426463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T21:46:26.097 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-10T21:46:26.417 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:26 smithi173 ceph-mon[35294]: Deploying daemon mon.b on smithi070 2024-09-10T21:46:26.418 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:26 smithi173 ceph-mon[35294]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:26.418 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:26 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/2669021925' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:26.418 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:26 smithi039 ceph-mon[30872]: Deploying daemon mon.b on smithi070 2024-09-10T21:46:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:26 smithi039 ceph-mon[30872]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:26 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/2669021925' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:27.714 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:46:27.714 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:46:27.965 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:46:28.654 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:46:28.655 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","modified":"2024-09-10T21:46:20.256882Z","created":"2024-09-10T21:44:42.426463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T21:46:28.655 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-10T21:46:28.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:28 smithi173 ceph-mon[35294]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:28 smithi039 ceph-mon[30872]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.083 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_filter: None 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dba129b320) 2024-09-10T21:46:29.084 INFO:journalctl@ceph.mon.b.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: index_type: 0 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: data_block_index_type: 0 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: index_shortening: 1 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: checksum: 4 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: no_block_cache: 0 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_cache: 0x55dba128f610 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-09-10T21:46:29.085 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_cache_options: 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: capacity : 536870912 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: num_shard_bits : 4 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: strict_capacity_limit : 0 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_cache_compressed: (nil) 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: persistent_cache: (nil) 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_size: 4096 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_size_deviation: 10 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_restart_interval: 16 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: index_block_restart_interval: 1 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: metadata_block_size: 4096 2024-09-10T21:46:29.086 INFO:journalctl@ceph.mon.b.smithi070.stdout: partition_filters: 0 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: use_delta_encoding: 1 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: filter_policy: bloomfilter 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: whole_key_filtering: 1 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: verify_compression: 0 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: format_version: 5 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: enable_index_compression: 1 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: block_align: 0 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: max_auto_readahead_size: 262144 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: prepopulate_block_cache: 0 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: initial_auto_readahead_size: 8192 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T21:46:29.087 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression: NoCompression 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.num_levels: 7 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T21:46:29.088 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T21:46:29.089 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T21:46:29.090 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T21:46:29.091 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T21:46:29.091 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T21:46:29.091 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T21:46:29.091 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T21:46:29.092 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.inplace_update_support: 0 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T21:46:29.093 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.bloom_locality: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.max_successive_merges: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.ttl: 2592000 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T21:46:29.094 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.enable_blob_files: false 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.min_blob_size: 0 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3440bd10-100c-4fb9-b777-b7806adfdceb 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004789080654, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T21:46:29.095 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004789081061, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726004789, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3440bd10-100c-4fb9-b777-b7806adfdceb", "db_session_id": "F66QFSKEXPHZO0ZGAJ3E", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726004789081155, "job": 1, "event": "recovery_finished"} 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dba12bee00 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: DB pointer 0x55dba13c0000 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout: ** DB Stats ** 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:29.096 INFO:journalctl@ceph.mon.b.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.097 INFO:journalctl@ceph.mon.b.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:46:29.098 INFO:journalctl@ceph.mon.b.smithi070.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout: Block cache BinnedLRUCache@0x55dba128f610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: using public_addr v2:172.21.15.70:0/0 -> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-10T21:46:29.099 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: starting mon.b rank -1 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(???) e0 preinit fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout: e1 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout: btime 2024-09-10T21:44:49:362931+0000 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:46:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout: legacy client fscid: -1 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout: 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout: No filesystems configured 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Added host smithi173 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2436513221' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"} : dispatch 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c;count:3 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Deploying daemon mon.c on smithi173 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.410 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/2383918826' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.a calling monitor election 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.c calling monitor election 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.411 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: monmap epoch 2 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: last_changed 2024-09-10T21:46:20.256882+0000 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: min_mon_release 19 (squid) 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: election_strategy: 1 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: fsmap 2024-09-10T21:46:29.412 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mgrmap e13: x(active, since 41s) 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: overall HEALTH_OK 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: Deploying daemon mon.b on smithi070 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/2669021925' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:29.413 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 ceph-mon[34909]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T21:46:29.414 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 bash[34890]: 1e1fc8e6cc957fe64485611654cb0c1bbd2276a281b0c67ff24e0f07a3ff53a1 2024-09-10T21:46:29.414 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:29 smithi070 systemd[1]: Started Ceph mon.b for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:46:30.228 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:46:30.229 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:46:30.481 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:46:34.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: mon.a calling monitor election 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: mon.c calling monitor election 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.495 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.495 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: mon.b calling monitor election 2024-09-10T21:46:34.495 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.495 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: monmap epoch 3 2024-09-10T21:46:34.496 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: last_changed 2024-09-10T21:46:29.107245+0000 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: min_mon_release 19 (squid) 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: election_strategy: 1 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:34.497 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: 2: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: fsmap 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: mgrmap e13: x(active, since 50s) 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: overall HEALTH_OK 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.498 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: mon.a calling monitor election 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: mon.c calling monitor election 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: mon.b calling monitor election 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: monmap epoch 3 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: last_changed 2024-09-10T21:46:29.107245+0000 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: min_mon_release 19 (squid) 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: election_strategy: 1 2024-09-10T21:46:34.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: 2: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: fsmap 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: mgrmap e13: x(active, since 50s) 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: overall HEALTH_OK 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:46:34.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: mon.a calling monitor election 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: mon.c calling monitor election 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: mon.b calling monitor election 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:34.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: monmap epoch 3 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: last_changed 2024-09-10T21:46:29.107245+0000 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: created 2024-09-10T21:44:42.426463+0000 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: min_mon_release 19 (squid) 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: election_strategy: 1 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: 2: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: fsmap 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: mgrmap e13: x(active, since 50s) 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: overall HEALTH_OK 2024-09-10T21:46:34.675 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.676 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:34.763 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:46:34.763 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","modified":"2024-09-10T21:46:29.107245Z","created":"2024-09-10T21:44:42.426463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T21:46:34.763 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2024-09-10T21:46:35.391 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:35.391 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:35 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/3738529951' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:35.391 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:35.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:35.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:35 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/3738529951' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:35.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:35.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:35.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:35 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/3738529951' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:46:35.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:46:36.023 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T21:46:36.023 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Updating smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:36 smithi039 ceph-mon[30872]: Reconfiguring daemon mon.a on smithi039 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:36.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Updating smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.658 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:36 smithi070 ceph-mon[34909]: Reconfiguring daemon mon.a on smithi039 2024-09-10T21:46:36.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Updating smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:36.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:36 smithi173 ceph-mon[35294]: Reconfiguring daemon mon.a on smithi039 2024-09-10T21:46:37.175 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:37.796 INFO:teuthology.orchestra.run.smithi039.stdout:# minimal ceph.conf for c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:37.797 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-09-10T21:46:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:46:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: mon_host = [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-10T21:46:38.267 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T21:46:38.267 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:46:38.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:46:38.296 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:46:38.296 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:38.363 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:46:38.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:46:38.395 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:46:38.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: Reconfiguring daemon mon.b on smithi070 2024-09-10T21:46:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:38 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/427046681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.443 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.443 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.443 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: Reconfiguring daemon mon.b on smithi070 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:38.444 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:38 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/427046681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.461 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:46:38.461 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: Reconfiguring daemon mon.b on smithi070 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:38.489 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:38 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/427046681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:38.493 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:46:38.493 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:46:38.561 INFO:tasks.cephadm:Adding mgr.x on smithi039 2024-09-10T21:46:38.561 INFO:tasks.cephadm:Adding mgr.y on smithi070 2024-09-10T21:46:38.561 INFO:tasks.cephadm:Adding mgr.z on smithi173 2024-09-10T21:46:38.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi039=x;smithi070=y;smithi173=z' 2024-09-10T21:46:39.430 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: Reconfiguring daemon mon.c on smithi173 2024-09-10T21:46:39.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: Reconfiguring daemon mon.c on smithi173 2024-09-10T21:46:39.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: Reconfiguring daemon mon.c on smithi173 2024-09-10T21:46:39.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:40.512 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2024-09-10T21:46:41.067 DEBUG:teuthology.orchestra.run.smithi070:mgr.y> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T21:46:41.069 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T21:46:41.072 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T21:46:41.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T21:46:41.075 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T21:46:41.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T21:46:41.120 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T21:46:41.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T21:46:41.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:41.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:41.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.145 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T21:46:41.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T21:46:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:41.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:41.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.189 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T21:46:41.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T21:46:41.233 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T21:46:41.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:41.277 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T21:46:41.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T21:46:41.321 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T21:46:41.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T21:46:41.364 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T21:46:41.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T21:46:41.417 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T21:46:41.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T21:46:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:41.447 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T21:46:41.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T21:46:41.505 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T21:46:41.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T21:46:41.506 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:41.548 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T21:46:41.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T21:46:41.592 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T21:46:41.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T21:46:41.655 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T21:46:41.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T21:46:41.656 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:41.700 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T21:46:41.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T21:46:41.744 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T21:46:41.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T21:46:41.788 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T21:46:41.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T21:46:41.840 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T21:46:41.840 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T21:46:41.890 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T21:46:41.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T21:46:41.934 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T21:46:41.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T21:46:41.990 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T21:46:41.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T21:46:41.991 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:41 smithi039 ceph-mon[30872]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi070=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:41.991 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:41 smithi039 ceph-mon[30872]: Saving service mgr spec with placement smithi039=x;smithi070=y;smithi173=z;count:3 2024-09-10T21:46:41.991 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:41 smithi039 ceph-mon[30872]: Deploying daemon mgr.z on smithi173 2024-09-10T21:46:42.036 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T21:46:42.036 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi039') 2024-09-10T21:46:42.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:41 smithi070 ceph-mon[34909]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi070=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:42.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:41 smithi070 ceph-mon[34909]: Saving service mgr spec with placement smithi039=x;smithi070=y;smithi173=z;count:3 2024-09-10T21:46:42.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:41 smithi070 ceph-mon[34909]: Deploying daemon mgr.z on smithi173 2024-09-10T21:46:42.182 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:41 smithi173 ceph-mon[35294]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi070=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:46:42.182 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:41 smithi173 ceph-mon[35294]: Saving service mgr spec with placement smithi039=x;smithi070=y;smithi173=z;count:3 2024-09-10T21:46:42.183 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:41 smithi173 ceph-mon[35294]: Deploying daemon mgr.z on smithi173 2024-09-10T21:46:42.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:42 smithi039 ceph-mon[30872]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:42.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:42 smithi039 ceph-mon[30872]: from='client.? ' entity='client.admin' 2024-09-10T21:46:42.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:42 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1857077887' entity='client.admin' 2024-09-10T21:46:42.886 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:42 smithi173 podman[36889]: 2024-09-10 21:46:42.835175382 +0000 UTC m=+0.144162863 container create a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:46:43.102 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi039') 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:42 smithi173 ceph-mon[35294]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:42 smithi173 ceph-mon[35294]: from='client.? ' entity='client.admin' 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:42 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1857077887' entity='client.admin' 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:43 smithi173 podman[36889]: 2024-09-10 21:46:43.054290849 +0000 UTC m=+0.363278288 container init a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:43 smithi173 podman[36889]: 2024-09-10 21:46:43.057104244 +0000 UTC m=+0.366091686 container start a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T21:46:43.138 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:43 smithi173 ceph-mgr[36908]: -- 172.21.15.173:0/3056241318 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55611e43f0e0 con 0x55611e41d400 2024-09-10T21:46:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:42 smithi070 ceph-mon[34909]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:42 smithi070 ceph-mon[34909]: from='client.? ' entity='client.admin' 2024-09-10T21:46:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:42 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1857077887' entity='client.admin' 2024-09-10T21:46:43.492 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:43 smithi173 bash[36889]: a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 2024-09-10T21:46:43.492 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 21:46:43 smithi173 systemd[1]: Started Ceph mgr.z for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:46:43.641 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi039') 2024-09-10T21:46:43.789 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.250 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.250 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.251 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.255 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.256 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.256 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.256 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.261 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.264 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.305 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: Deploying daemon mgr.y on smithi070 2024-09-10T21:46:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:44 smithi070 ceph-mon[34909]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:44.465 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.465 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.465 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: Deploying daemon mgr.y on smithi070 2024-09-10T21:46:44.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:44 smithi039 ceph-mon[30872]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:44.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdd5c03f510 msgr2=0x7fdd5c0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdd5c03f510 0x7fdd5c0419d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd68004770 tx=0x7fdd68000bc0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd74101910 msgr2=0x7fdd74198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd74101910 0x7fdd74198b90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400e9f0 tx=0x7fdd6400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 shutdown_connections 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdd5c03f510 0x7fdd5c0419d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd74103430 0x7fdd74199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102a70 0x7fdd741991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.485+0000 7fdd79180640 1 --2- 172.21.15.39:0/4173705946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd74101910 0x7fdd74198b90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.486+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 >> 172.21.15.39:0/4173705946 conn(0x7fdd740fd1e0 msgr2=0x7fdd740fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.486+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 shutdown_connections 2024-09-10T21:46:44.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:44.486+0000 7fdd79180640 1 -- 172.21.15.39:0/4173705946 wait complete. 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: Deploying daemon mgr.y on smithi070 2024-09-10T21:46:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:44 smithi173 ceph-mon[35294]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:45.157 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 systemd[1]: Starting Ceph mgr.y for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4173705946' entity='client.admin' 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 podman[36060]: 2024-09-10 21:46:45.257937977 +0000 UTC m=+0.104666952 container create 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 podman[36060]: 2024-09-10 21:46:45.169059861 +0000 UTC m=+0.015788832 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 podman[36060]: 2024-09-10 21:46:45.50227733 +0000 UTC m=+0.349006301 container init 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 podman[36060]: 2024-09-10 21:46:45.505275592 +0000 UTC m=+0.352004563 container start 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T21:46:45.530 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 ceph-mgr[36079]: -- 172.21.15.70:0/1167852685 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564de09070e0 con 0x564de08e5000 2024-09-10T21:46:45.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4173705946' entity='client.admin' 2024-09-10T21:46:45.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4173705946' entity='client.admin' 2024-09-10T21:46:45.905 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 bash[36060]: 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a 2024-09-10T21:46:45.905 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 21:46:45 smithi070 systemd[1]: Started Ceph mgr.y for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 -- 172.21.15.39:0/3604333582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660101910 msgr2=0x7f2660101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 --2- 172.21.15.39:0/3604333582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660101910 0x7f2660101d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f265c009930 tx=0x7f265c02a420 comp rx=0 tx=0).stop 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 -- 172.21.15.39:0/3604333582 shutdown_connections 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 --2- 172.21.15.39:0/3604333582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660103430 0x7f2660109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 --2- 172.21.15.39:0/3604333582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660102a70 0x7f2660102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:45.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 --2- 172.21.15.39:0/3604333582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660101910 0x7f2660101d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:45.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 -- 172.21.15.39:0/3604333582 >> 172.21.15.39:0/3604333582 conn(0x7f26600fd1e0 msgr2=0x7f26600ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:45.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 -- 172.21.15.39:0/3604333582 shutdown_connections 2024-09-10T21:46:45.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.975+0000 7f2667ed9640 1 -- 172.21.15.39:0/3604333582 wait complete. 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 Processor -- start 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 -- start start 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 0x7f2660198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 0x7f2660199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f266010d2f0 con 0x7f2660103430 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f266010d170 con 0x7f2660102a70 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2667ed9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f266010d470 con 0x7f2660101910 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2666476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:45.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2665c75640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 0x7f2660198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2666476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53982/0 (socket says 172.21.15.39:53982) 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2666476640 1 -- 172.21.15.39:0/2178144506 learned_addr learned my addr 172.21.15.39:0/2178144506 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.976+0000 7f2665474640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 0x7f2660199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 -- 172.21.15.39:0/2178144506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 msgr2=0x7f2660198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 0x7f2660198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 -- 172.21.15.39:0/2178144506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 msgr2=0x7f2660199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 0x7f2660199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 -- 172.21.15.39:0/2178144506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266019a770 con 0x7f2660103430 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2665474640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 0x7f2660199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2665c75640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 0x7f2660198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:45.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2666476640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f265800eaa0 tx=0x7f265800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265800cdb0 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266019aa60 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f2658005020 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26580116d0 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.977+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26601a1140 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.978+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f265800f040 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.978+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266010dab0 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.978+0000 7f2656ffd640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 0x7f264c0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.978+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2658053bd0 con 0x7f2660103430 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.979+0000 7f2665c75640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 0x7f264c0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:45.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.979+0000 7f2665c75640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 0x7f264c0419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265c004770 tx=0x7f265c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:45.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.983+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2658016030 con 0x7f2660103430 2024-09-10T21:46:46.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.188+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f26601a1310 con 0x7f2660103430 2024-09-10T21:46:46.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.191+0000 7f2656ffd640 1 -- 172.21.15.39:0/2178144506 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f26580103d0 con 0x7f2660103430 2024-09-10T21:46:46.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 msgr2=0x7f264c0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 0x7f264c0419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265c004770 tx=0x7f265c0058d0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 msgr2=0x7f2660199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f265800eaa0 tx=0x7f265800ef60 comp rx=0 tx=0).stop 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 shutdown_connections 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f264c03f510 0x7f264c0419d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2660103430 0x7f2660199ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2660102a70 0x7f2660199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 --2- 172.21.15.39:0/2178144506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2660101910 0x7f2660198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.193+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 >> 172.21.15.39:0/2178144506 conn(0x7f26600fd1e0 msgr2=0x7f266006aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.194+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 shutdown_connections 2024-09-10T21:46:46.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.194+0000 7f2667ed9640 1 -- 172.21.15.39:0/2178144506 wait complete. 2024-09-10T21:46:46.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- 172.21.15.39:0/2956541249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8102a70 msgr2=0x7f71c8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 --2- 172.21.15.39:0/2956541249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8102a70 0x7f71c8102ef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009930 tx=0x7f71b402a420 comp rx=0 tx=0).stop 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- 172.21.15.39:0/2956541249 shutdown_connections 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 --2- 172.21.15.39:0/2956541249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 0x7f71c8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 --2- 172.21.15.39:0/2956541249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8102a70 0x7f71c8102ef0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 --2- 172.21.15.39:0/2956541249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8101910 0x7f71c8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- 172.21.15.39:0/2956541249 >> 172.21.15.39:0/2956541249 conn(0x7f71c80fd1e0 msgr2=0x7f71c80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- 172.21.15.39:0/2956541249 shutdown_connections 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- 172.21.15.39:0/2956541249 wait complete. 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 Processor -- start 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.430+0000 7f71cecbb640 1 -- start start 2024-09-10T21:46:46.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 0x7f71c819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 0x7f71c81a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810d310 con 0x7f71c8101910 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810d190 con 0x7f71c8103430 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810d490 con 0x7f71c8102a70 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54022/0 (socket says 172.21.15.39:54022) 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 -- 172.21.15.39:0/1550252170 learned_addr learned my addr 172.21.15.39:0/1550252170 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cd258640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 0x7f71c81a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71c7fff640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 0x7f71c819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 -- 172.21.15.39:0/1550252170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 msgr2=0x7f71c819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 0x7f71c819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 -- 172.21.15.39:0/1550252170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 msgr2=0x7f71c81a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 0x7f71c81a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 -- 172.21.15.39:0/1550252170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c81a2a30 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71c7fff640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 0x7f71c819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cca57640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e9f0 tx=0x7f71bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00cd80 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c81a2d20 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f71bc005490 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.431+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc010430 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.432+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c81a31b0 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.433+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c8101d10 con 0x7f71c8101910 2024-09-10T21:46:46.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.433+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f71bc0105d0 con 0x7f71c8101910 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.433+0000 7f71c5ffb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 0x7f71b80419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.433+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f71bc0542d0 con 0x7f71c8101910 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.433+0000 7f71c7fff640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 0x7f71b80419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.434+0000 7f71c7fff640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 0x7f71b80419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.442+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f71bc016330 con 0x7f71c8101910 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.654+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f71c8063d50 con 0x7f71c8101910 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.660+0000 7f71c5ffb640 1 -- 172.21.15.39:0/1550252170 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f71bc019e00 con 0x7f71c8101910 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 msgr2=0x7f71b80419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 0x7f71b80419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4005a20 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 msgr2=0x7f71c806b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e9f0 tx=0x7f71bc00edf0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 shutdown_connections 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b803f510 0x7f71b80419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8103430 0x7f71c81a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c8102a70 0x7f71c819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 --2- 172.21.15.39:0/1550252170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8101910 0x7f71c806b350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 >> 172.21.15.39:0/1550252170 conn(0x7f71c80fd1e0 msgr2=0x7f71c8105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 shutdown_connections 2024-09-10T21:46:46.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.663+0000 7f71cecbb640 1 -- 172.21.15.39:0/1550252170 wait complete. 2024-09-10T21:46:46.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2771697134' entity='client.admin' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2178144506' entity='client.admin' 2024-09-10T21:46:46.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:46 smithi039 ceph-mon[30872]: from='client.? ' entity='client.admin' 2024-09-10T21:46:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2771697134' entity='client.admin' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2178144506' entity='client.admin' 2024-09-10T21:46:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:46 smithi070 ceph-mon[34909]: from='client.? ' entity='client.admin' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2771697134' entity='client.admin' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2178144506' entity='client.admin' 2024-09-10T21:46:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:46 smithi173 ceph-mon[35294]: from='client.? ' entity='client.admin' 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 -- 172.21.15.39:0/613800684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 msgr2=0x7f6d84109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613800684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84109de0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009cd0 tx=0x7f6d7c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 -- 172.21.15.39:0/613800684 shutdown_connections 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613800684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84109de0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613800684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84102aa0 0x7f6d84102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613800684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84101940 0x7f6d84101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 -- 172.21.15.39:0/613800684 >> 172.21.15.39:0/613800684 conn(0x7f6d840fd210 msgr2=0x7f6d840ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 -- 172.21.15.39:0/613800684 shutdown_connections 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.320+0000 7f6d89b44640 1 -- 172.21.15.39:0/613800684 wait complete. 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 Processor -- start 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 -- start start 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 0x7f6d84198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8410e510 con 0x7f6d84103460 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8410e390 con 0x7f6d84102aa0 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d89b44640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8410e690 con 0x7f6d84101940 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d83fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:41504/0 (socket says 172.21.15.39:41504) 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d83fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54004/0 (socket says 172.21.15.39:54004) 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d837fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 0x7f6d84198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.321+0000 7f6d7affd640 1 -- 172.21.15.39:0/613521550 learned_addr learned my addr 172.21.15.39:0/613521550 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 -- 172.21.15.39:0/613521550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 msgr2=0x7f6d84198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 0x7f6d84198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 -- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 msgr2=0x7f6d84199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 -- 172.21.15.39:0/613521550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8419a7b0 con 0x7f6d84102aa0 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d837fe640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 0x7f6d84198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d83fff640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d7affd640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d950 tx=0x7f6d6c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c017070 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f6d6c009c30 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8419aaa0 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00f620 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.322+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d841a1180 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.323+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8410ec70 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.323+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f6d6c00f7c0 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.323+0000 7f6d817fa640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 0x7f6d700419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.324+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6d6c0539a0 con 0x7f6d84102aa0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.324+0000 7f6d837fe640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 0x7f6d700419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.324+0000 7f6d837fe640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 0x7f6d700419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d74005d00 tx=0x7f6d7400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.328+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6d6c010e20 con 0x7f6d84102aa0 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.524+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f6d8402e860 con 0x7f6d84102aa0 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.530+0000 7f6d817fa640 1 -- 172.21.15.39:0/613521550 <== mon.2 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7f6d6c01c5b0 con 0x7f6d84102aa0 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 msgr2=0x7f6d700419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 0x7f6d700419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d74005d00 tx=0x7f6d7400b410 comp rx=0 tx=0).stop 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 msgr2=0x7f6d841992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d950 tx=0x7f6d6c00de10 comp rx=0 tx=0).stop 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 shutdown_connections 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d7003f510 0x7f6d700419d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d84103460 0x7f6d84199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102aa0 0x7f6d841992d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 --2- 172.21.15.39:0/613521550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d84101940 0x7f6d84198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:47.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 >> 172.21.15.39:0/613521550 conn(0x7f6d840fd210 msgr2=0x7f6d84105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:47.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 shutdown_connections 2024-09-10T21:46:47.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.534+0000 7f6d89b44640 1 -- 172.21.15.39:0/613521550 wait complete. 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1550252170' entity='client.admin' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='client.? ' entity='client.admin' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:46:47.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:47.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:47.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:47.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:47 smithi039 ceph-mon[30872]: Reconfiguring daemon mgr.x on smithi039 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1550252170' entity='client.admin' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='client.? ' entity='client.admin' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:47.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:47 smithi173 ceph-mon[35294]: Reconfiguring daemon mgr.x on smithi039 2024-09-10T21:46:48.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1550252170' entity='client.admin' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='client.? ' entity='client.admin' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:46:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:46:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:46:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:46:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:47 smithi070 ceph-mon[34909]: Reconfiguring daemon mgr.x on smithi039 2024-09-10T21:46:48.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.247+0000 7f0670360640 1 -- 172.21.15.39:0/756603952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 msgr2=0x7f0668102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.247+0000 7f0670360640 1 --2- 172.21.15.39:0/756603952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668102e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0658009cd0 tx=0x7f065802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 -- 172.21.15.39:0/756603952 shutdown_connections 2024-09-10T21:46:48.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 --2- 172.21.15.39:0/756603952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 0x7f066810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 --2- 172.21.15.39:0/756603952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 --2- 172.21.15.39:0/756603952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668102e50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 -- 172.21.15.39:0/756603952 >> 172.21.15.39:0/756603952 conn(0x7f06680fe320 msgr2=0x7f0668100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 -- 172.21.15.39:0/756603952 shutdown_connections 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 -- 172.21.15.39:0/756603952 wait complete. 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 Processor -- start 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 -- start start 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.248+0000 7f0670360640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 0x7f0668075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f066810e480 con 0x7f0668102a50 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f066810e300 con 0x7f0668103bb0 2024-09-10T21:46:48.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f066810e600 con 0x7f0668104570 2024-09-10T21:46:48.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54042/0 (socket says 172.21.15.39:54042) 2024-09-10T21:46:48.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 -- 172.21.15.39:0/2891631718 learned_addr learned my addr 172.21.15.39:0/2891631718 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:48.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066d8fb640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e8fd640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 0x7f0668075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 -- 172.21.15.39:0/2891631718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 msgr2=0x7f0668075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 0x7f0668075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 -- 172.21.15.39:0/2891631718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 msgr2=0x7f0668075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 -- 172.21.15.39:0/2891631718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0668076340 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066d8fb640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f066e0fc640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0658000f80 tx=0x7f0658003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658004450 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f0658003e50 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06681a2ce0 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658030eb0 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.249+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681a3190 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.250+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f065804e070 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.250+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668102e50 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.251+0000 7f06677fe640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 0x7f06500419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.251+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f065802e030 con 0x7f0668102a50 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.251+0000 7f066d8fb640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 0x7f06500419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.251+0000 7f066d8fb640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 0x7f06500419d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fc0 tx=0x7f065c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.255+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f065804b060 con 0x7f0668102a50 2024-09-10T21:46:48.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.444+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f06681a3af0 con 0x7f0668102a50 2024-09-10T21:46:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.450+0000 7f06677fe640 1 -- 172.21.15.39:0/2891631718 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7f0658041230 con 0x7f0668102a50 2024-09-10T21:46:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.453+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 msgr2=0x7f06500419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.453+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 0x7f06500419d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fc0 tx=0x7f065c005f90 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.453+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 msgr2=0x7f0668076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.453+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0658000f80 tx=0x7f0658003ba0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 shutdown_connections 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f065003f510 0x7f06500419d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0668104570 0x7f0668075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0668103bb0 0x7f0668075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 --2- 172.21.15.39:0/2891631718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0668102a50 0x7f0668076cd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 >> 172.21.15.39:0/2891631718 conn(0x7f06680fe320 msgr2=0x7f0668104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 shutdown_connections 2024-09-10T21:46:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.454+0000 7f0670360640 1 -- 172.21.15.39:0/2891631718 wait complete. 2024-09-10T21:46:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.533+0000 7f51dcd5c640 1 -- 172.21.15.39:0/2264856751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8104580 msgr2=0x7f51d810af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.533+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/2264856751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8104580 0x7f51d810af00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009930 tx=0x7f51c802a420 comp rx=0 tx=0).stop 2024-09-10T21:46:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 -- 172.21.15.39:0/2264856751 shutdown_connections 2024-09-10T21:46:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/2264856751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8104580 0x7f51d810af00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/2264856751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/2264856751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8102a60 0x7f51d8102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 -- 172.21.15.39:0/2264856751 >> 172.21.15.39:0/2264856751 conn(0x7f51d80fe350 msgr2=0x7f51d8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 -- 172.21.15.39:0/2264856751 shutdown_connections 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 -- 172.21.15.39:0/2264856751 wait complete. 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 Processor -- start 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.534+0000 7f51dcd5c640 1 -- start start 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8104580 0x7f51d819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e4b0 con 0x7f51d8102a60 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e330 con 0x7f51d8103bc0 2024-09-10T21:46:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e630 con 0x7f51d8104580 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54080/0 (socket says 172.21.15.39:54080) 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 -- 172.21.15.39:0/1617683540 learned_addr learned my addr 172.21.15.39:0/1617683540 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d5d9b640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d6d9d640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8104580 0x7f51d819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 -- 172.21.15.39:0/1617683540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8104580 msgr2=0x7f51d819c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8104580 0x7f51d819c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 -- 172.21.15.39:0/1617683540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 msgr2=0x7f51d819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 -- 172.21.15.39:0/1617683540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d819c960 con 0x7f51d8102a60 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d5d9b640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51d659c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51d000eb90 tx=0x7f51d000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0004d20 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f51d000ee90 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d819cc50 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.535+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0010690 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.536+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d81a3330 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.536+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f51d0010830 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.537+0000 7f51cf7fe640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 0x7f51c40419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.537+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f51d00542e0 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.537+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d8102e60 con 0x7f51d8102a60 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.537+0000 7f51d5d9b640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 0x7f51c40419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.537+0000 7f51d5d9b640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 0x7f51c40419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009fc0 tx=0x7f51c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.542+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51d0016330 con 0x7f51d8102a60 2024-09-10T21:46:48.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.731+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f51d81a3620 con 0x7f51d8102a60 2024-09-10T21:46:48.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.736+0000 7f51cf7fe640 1 -- 172.21.15.39:0/1617683540 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7f51d0019d50 con 0x7f51d8102a60 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 msgr2=0x7f51c40419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 0x7f51c40419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009fc0 tx=0x7f51c0005f90 comp rx=0 tx=0).stop 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 msgr2=0x7f51d819ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51d000eb90 tx=0x7f51d000c6a0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 shutdown_connections 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f51c403f510 0x7f51c40419d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d8104580 0x7f51d819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51d8103bc0 0x7f51d819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 --2- 172.21.15.39:0/1617683540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51d8102a60 0x7f51d819ae30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:48.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 >> 172.21.15.39:0/1617683540 conn(0x7f51d80fe350 msgr2=0x7f51d8109350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:48.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 shutdown_connections 2024-09-10T21:46:48.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.738+0000 7f51dcd5c640 1 -- 172.21.15.39:0/1617683540 wait complete. 2024-09-10T21:46:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: Standby manager daemon z started 2024-09-10T21:46:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:46:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2891631718' entity='client.admin' 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3630985329' entity='client.admin' 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1617683540' entity='client.admin' 2024-09-10T21:46:49.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:48 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: Standby manager daemon z started 2024-09-10T21:46:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2891631718' entity='client.admin' 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3630985329' entity='client.admin' 2024-09-10T21:46:49.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1617683540' entity='client.admin' 2024-09-10T21:46:49.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:48 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:49.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 -- 172.21.15.39:0/3543125768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050101910 msgr2=0x7fb050101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:49.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 --2- 172.21.15.39:0/3543125768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050101910 0x7fb050101d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb040009930 tx=0x7fb04002a420 comp rx=0 tx=0).stop 2024-09-10T21:46:49.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 -- 172.21.15.39:0/3543125768 shutdown_connections 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 --2- 172.21.15.39:0/3543125768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050103430 0x7fb050109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 --2- 172.21.15.39:0/3543125768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050102a70 0x7fb050102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 --2- 172.21.15.39:0/3543125768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050101910 0x7fb050101d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.614+0000 7fb05493c640 1 -- 172.21.15.39:0/3543125768 >> 172.21.15.39:0/3543125768 conn(0x7fb0500fd1e0 msgr2=0x7fb0500ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- 172.21.15.39:0/3543125768 shutdown_connections 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- 172.21.15.39:0/3543125768 wait complete. 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 Processor -- start 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- start start 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 0x7fb050198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010d360 con 0x7fb050103430 2024-09-10T21:46:49.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010d1e0 con 0x7fb050102a70 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.615+0000 7fb05493c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010d4e0 con 0x7fb050101910 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 0x7fb050198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:41526/0 (socket says 172.21.15.39:41526) 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 -- 172.21.15.39:0/1040978233 learned_addr learned my addr 172.21.15.39:0/1040978233 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 0x7fb050198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:56170/0 (socket says 172.21.15.39:56170) 2024-09-10T21:46:49.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54036/0 (socket says 172.21.15.39:54036) 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 -- 172.21.15.39:0/1040978233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 msgr2=0x7fb050198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 0x7fb050198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 -- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 msgr2=0x7fb050199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 -- 172.21.15.39:0/1040978233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05019a7b0 con 0x7fb050102a70 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04ed9d640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:49.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb04dd9b640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e9f0 tx=0x7fb04400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04400cd80 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fb044005490 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.616+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05019aaa0 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.617+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044010430 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.617+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a1180 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.617+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fb044005000 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.618+0000 7fb03f7fe640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 0x7fb0380419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.618+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb044054220 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.618+0000 7fb04e59c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 0x7fb0380419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.618+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05010db20 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.618+0000 7fb04e59c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 0x7fb0380419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb040005ab0 tx=0x7fb040005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.623+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0440046c0 con 0x7fb050102a70 2024-09-10T21:46:49.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.857+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb0501a1730 con 0x7fb050102a70 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.862+0000 7fb03f7fe640 1 -- 172.21.15.39:0/1040978233 <== mon.2 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7fb044021440 con 0x7fb050102a70 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 msgr2=0x7fb0380419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 0x7fb0380419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb040005ab0 tx=0x7fb040005a40 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 msgr2=0x7fb0501992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e9f0 tx=0x7fb04400edf0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 shutdown_connections 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb03803f510 0x7fb0380419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb050103430 0x7fb050199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb050102a70 0x7fb0501992d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 --2- 172.21.15.39:0/1040978233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb050101910 0x7fb050198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 >> 172.21.15.39:0/1040978233 conn(0x7fb0500fd1e0 msgr2=0x7fb0500fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 shutdown_connections 2024-09-10T21:46:49.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.865+0000 7fb05493c640 1 -- 172.21.15.39:0/1040978233 wait complete. 2024-09-10T21:46:49.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: Standby manager daemon z started 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.173:0/3802638886' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2891631718' entity='client.admin' 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3630985329' entity='client.admin' 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1617683540' entity='client.admin' 2024-09-10T21:46:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:48 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 -- 172.21.15.39:0/3100958648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 msgr2=0x7f9004101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 --2- 172.21.15.39:0/3100958648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004101d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009930 tx=0x7f8ff402a420 comp rx=0 tx=0).stop 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 -- 172.21.15.39:0/3100958648 shutdown_connections 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 --2- 172.21.15.39:0/3100958648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004103430 0x7f9004109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 --2- 172.21.15.39:0/3100958648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004102a70 0x7f9004102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 --2- 172.21.15.39:0/3100958648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004101d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 -- 172.21.15.39:0/3100958648 >> 172.21.15.39:0/3100958648 conn(0x7f90040fd1e0 msgr2=0x7f90040ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 -- 172.21.15.39:0/3100958648 shutdown_connections 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.857+0000 7f90089cd640 1 -- 172.21.15.39:0/3100958648 wait complete. 2024-09-10T21:46:50.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 Processor -- start 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 -- start start 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004102a70 0x7f90041992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004103430 0x7f9004199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f900410d2f0 con 0x7f9004101910 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f900410d170 con 0x7f9004103430 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f90089cd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f900410d470 con 0x7f9004102a70 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f900259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f900259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53952/0 (socket says 172.21.15.39:53952) 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f900259c640 1 -- 172.21.15.39:0/2771697134 learned_addr learned my addr 172.21.15.39:0/2771697134 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.858+0000 7f9001d9b640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004102a70 0x7f90041992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f9002d9d640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004103430 0x7f9004199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 -- 172.21.15.39:0/2771697134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004102a70 msgr2=0x7f90041992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004102a70 0x7f90041992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 -- 172.21.15.39:0/2771697134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004103430 msgr2=0x7f9004199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004103430 0x7f9004199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 -- 172.21.15.39:0/2771697134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900419a780 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f900259c640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005940 tx=0x7f8ff40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff403f070 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f8ff4031d40 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4035030 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900419aa10 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.859+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a1150 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.860+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f8ff4004fd0 con 0x7f9004101910 2024-09-10T21:46:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.860+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900410dab0 con 0x7f9004101910 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.861+0000 7f8ff37fe640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 0x7f8fec0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.861+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8ff4074920 con 0x7f9004101910 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.861+0000 7f9001d9b640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 0x7f8fec0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.861+0000 7f9001d9b640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 0x7f8fec0419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009bd0 tx=0x7f8ff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:45.865+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8ff4003930 con 0x7f9004101910 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.059+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f90041a1720 con 0x7f9004101910 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.064+0000 7f8ff37fe640 1 -- 172.21.15.39:0/2771697134 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f8ff403add0 con 0x7f9004101910 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 msgr2=0x7f8fec0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 0x7f8fec0419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009bd0 tx=0x7f8ff8005f90 comp rx=0 tx=0).stop 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 msgr2=0x7f9004198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005940 tx=0x7f8ff40042f0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 shutdown_connections 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8fec03f510 0x7f8fec0419d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9004103430 0x7f9004199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9004102a70 0x7f90041992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 --2- 172.21.15.39:0/2771697134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9004101910 0x7f9004198c50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 >> 172.21.15.39:0/2771697134 conn(0x7f90040fd1e0 msgr2=0x7f900406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 shutdown_connections 2024-09-10T21:46:50.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:46.066+0000 7f90089cd640 1 -- 172.21.15.39:0/2771697134 wait complete. 2024-09-10T21:46:50.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:49 smithi039 ceph-mon[30872]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T21:46:50.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:46:50.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:49 smithi173 ceph-mon[35294]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T21:46:50.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- 172.21.15.39:0/199532192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c06c0c0 msgr2=0x7fe21c105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 --2- 172.21.15.39:0/199532192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c06c0c0 0x7fe21c105630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009900 tx=0x7fe20c02a410 comp rx=0 tx=0).stop 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- 172.21.15.39:0/199532192 shutdown_connections 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 --2- 172.21.15.39:0/199532192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c10ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 --2- 172.21.15.39:0/199532192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c105bc0 0x7fe21c108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 --2- 172.21.15.39:0/199532192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c06c0c0 0x7fe21c105630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- 172.21.15.39:0/199532192 >> 172.21.15.39:0/199532192 conn(0x7fe21c0fd200 msgr2=0x7fe21c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- 172.21.15.39:0/199532192 shutdown_connections 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- 172.21.15.39:0/199532192 wait complete. 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 Processor -- start 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.419+0000 7fe221926640 1 -- start start 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c06c0c0 0x7fe21c102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c10e440 con 0x7fe21c105bc0 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c10e2c0 con 0x7fe21c108770 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe221926640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c10e5c0 con 0x7fe21c06c0c0 2024-09-10T21:46:50.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54056/0 (socket says 172.21.15.39:54056) 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 -- 172.21.15.39:0/3630985329 learned_addr learned my addr 172.21.15.39:0/3630985329 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21b7fe640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21affd640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c06c0c0 0x7fe21c102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 -- 172.21.15.39:0/3630985329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c06c0c0 msgr2=0x7fe21c102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c06c0c0 0x7fe21c102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 -- 172.21.15.39:0/3630985329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 msgr2=0x7fe21c101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 -- 172.21.15.39:0/3630985329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c1023d0 con 0x7fe21c105bc0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21b7fe640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.420+0000 7fe21a7fc640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe21000d770 tx=0x7fe21000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.421+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210017070 con 0x7fe21c105bc0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.421+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fe210009c30 con 0x7fe21c105bc0 2024-09-10T21:46:50.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.421+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c1a2d40 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.421+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21000f3c0 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.421+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c1a31f0 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.422+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c106020 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.422+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fe210010460 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.422+0000 7fe220924640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 0x7fe2040419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.422+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe210053af0 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.422+0000 7fe21affd640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 0x7fe2040419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.423+0000 7fe21affd640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 0x7fe2040419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009230 tx=0x7fe20c005700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.427+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe210009de0 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.627+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe21c063d50 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.630+0000 7fe220924640 1 -- 172.21.15.39:0/3630985329 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7fe21000f560 con 0x7fe21c105bc0 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 msgr2=0x7fe2040419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 0x7fe2040419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009230 tx=0x7fe20c005700 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 msgr2=0x7fe21c1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe21000d770 tx=0x7fe21000dc30 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 shutdown_connections 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe20403f510 0x7fe2040419d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe21c108770 0x7fe21c101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe21c105bc0 0x7fe21c1015d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 --2- 172.21.15.39:0/3630985329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe21c06c0c0 0x7fe21c102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 >> 172.21.15.39:0/3630985329 conn(0x7fe21c0fd200 msgr2=0x7fe21c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 shutdown_connections 2024-09-10T21:46:50.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:48.633+0000 7fe221926640 1 -- 172.21.15.39:0/3630985329 wait complete. 2024-09-10T21:46:50.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:49 smithi070 ceph-mon[34909]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T21:46:50.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 -- 172.21.15.39:0/762731985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 msgr2=0x7f2f6c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 --2- 172.21.15.39:0/762731985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c104010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009930 tx=0x7f2f5402a420 comp rx=0 tx=0).stop 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 -- 172.21.15.39:0/762731985 shutdown_connections 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 --2- 172.21.15.39:0/762731985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c104550 0x7f2f6c10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 --2- 172.21.15.39:0/762731985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c104010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 --2- 172.21.15.39:0/762731985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c102a30 0x7f2f6c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 -- 172.21.15.39:0/762731985 >> 172.21.15.39:0/762731985 conn(0x7f2f6c0fe320 msgr2=0x7f2f6c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 -- 172.21.15.39:0/762731985 shutdown_connections 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 -- 172.21.15.39:0/762731985 wait complete. 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.907+0000 7f2f71523640 1 Processor -- start 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 -- start start 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c102a30 0x7f2f6c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c104550 0x7f2f6c199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c10e430 con 0x7f2f6c103b90 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c10e2b0 con 0x7f2f6c102a30 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f71523640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c10e5b0 con 0x7f2f6c104550 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50540/0 (socket says 172.21.15.39:50540) 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 -- 172.21.15.39:0/969616922 learned_addr learned my addr 172.21.15.39:0/969616922 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6affd640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c102a30 0x7f2f6c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6b7fe640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c104550 0x7f2f6c199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 -- 172.21.15.39:0/969616922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c104550 msgr2=0x7f2f6c199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c104550 0x7f2f6c199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 -- 172.21.15.39:0/969616922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c102a30 msgr2=0x7f2f6c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c102a30 0x7f2f6c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.908+0000 7f2f6a7fc640 1 -- 172.21.15.39:0/969616922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c19a770 con 0x7f2f6c103b90 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f6a7fc640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f54005940 tx=0x7f2f540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5403f070 con 0x7f2f6c103b90 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f2f54031d40 con 0x7f2f6c103b90 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6c19aa00 con 0x7f2f6c103b90 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54035030 con 0x7f2f6c103b90 2024-09-10T21:46:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.909+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6c1a0f70 con 0x7f2f6c103b90 2024-09-10T21:46:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.910+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6c102e30 con 0x7f2f6c103b90 2024-09-10T21:46:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.911+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f2f54004fd0 con 0x7f2f6c103b90 2024-09-10T21:46:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.911+0000 7f2f63fff640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 0x7f2f5807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.911+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2f540bc9e0 con 0x7f2f6c103b90 2024-09-10T21:46:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.912+0000 7f2f6affd640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 0x7f2f5807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.912+0000 7f2f6affd640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 0x7f2f5807c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c005c40 tx=0x7f2f5c00a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:50.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.916+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2f54085040 con 0x7f2f6c103b90 2024-09-10T21:46:50.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:50.934+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f2f540812b0 con 0x7f2f6c103b90 2024-09-10T21:46:51.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.108+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f2f6c063d50 con 0x7f2f6c103b90 2024-09-10T21:46:51.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.115+0000 7f2f63fff640 1 -- 172.21.15.39:0/969616922 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7f2f540ba510 con 0x7f2f6c103b90 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 msgr2=0x7f2f5807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 0x7f2f5807c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c005c40 tx=0x7f2f5c00a570 comp rx=0 tx=0).stop 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 msgr2=0x7f2f6c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f54005940 tx=0x7f2f540042f0 comp rx=0 tx=0).stop 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 shutdown_connections 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2f5807a3b0 0x7f2f5807c870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f6c104550 0x7f2f6c199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f6c103b90 0x7f2f6c199290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 --2- 172.21.15.39:0/969616922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c102a30 0x7f2f6c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 >> 172.21.15.39:0/969616922 conn(0x7f2f6c0fe320 msgr2=0x7f2f6c107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 shutdown_connections 2024-09-10T21:46:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.118+0000 7f2f71523640 1 -- 172.21.15.39:0/969616922 wait complete. 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: Standby manager daemon y started 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:46:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:50 smithi039 ceph-mon[30872]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: Standby manager daemon y started 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:46:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:50 smithi173 ceph-mon[35294]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: Standby manager daemon y started 2024-09-10T21:46:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:46:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:46:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:46:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:50 smithi070 ceph-mon[34909]: from='mgr.? 172.21.15.70:0/3275582051' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:46:51.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:51 smithi039 ceph-mon[30872]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T21:46:51.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:46:51.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:51 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/969616922' entity='client.admin' 2024-09-10T21:46:52.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:51 smithi173 ceph-mon[35294]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T21:46:52.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:46:52.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:51 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/969616922' entity='client.admin' 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 -- 172.21.15.39:0/113719729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d806b6e0 msgr2=0x7ff1d81055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/113719729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d806b6e0 0x7ff1d81055f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009900 tx=0x7ff1d402a410 comp rx=0 tx=0).stop 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 -- 172.21.15.39:0/113719729 shutdown_connections 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/113719729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8108730 0x7ff1d810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/113719729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d8105b80 0x7ff1d8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/113719729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d806b6e0 0x7ff1d81055f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 -- 172.21.15.39:0/113719729 >> 172.21.15.39:0/113719729 conn(0x7ff1d80fd1e0 msgr2=0x7ff1d80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 -- 172.21.15.39:0/113719729 shutdown_connections 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.299+0000 7ff1e06f3640 1 -- 172.21.15.39:0/113719729 wait complete. 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 Processor -- start 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 -- start start 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 0x7ff1d8198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8105b80 0x7ff1d8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810e480 con 0x7ff1d8108730 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810e300 con 0x7ff1d806b6e0 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1e06f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810e600 con 0x7ff1d8105b80 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1dec90640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1dec90640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50582/0 (socket says 172.21.15.39:50582) 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1dec90640 1 -- 172.21.15.39:0/2537766488 learned_addr learned my addr 172.21.15.39:0/2537766488 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1ddc8e640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8105b80 0x7ff1d8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.300+0000 7ff1de48f640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 0x7ff1d8198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 -- 172.21.15.39:0/2537766488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8105b80 msgr2=0x7ff1d8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8105b80 0x7ff1d8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 -- 172.21.15.39:0/2537766488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 msgr2=0x7ff1d8198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 0x7ff1d8198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 -- 172.21.15.39:0/2537766488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d819a770 con 0x7ff1d8108730 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1de48f640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 0x7ff1d8198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1dec90640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000eaa0 tx=0x7ff1d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000cdb0 con 0x7ff1d8108730 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff1d0005020 con 0x7ff1d8108730 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d819aa60 con 0x7ff1d8108730 2024-09-10T21:46:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00116d0 con 0x7ff1d8108730 2024-09-10T21:46:52.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.301+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d81a1140 con 0x7ff1d8108730 2024-09-10T21:46:52.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.302+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d8105fe0 con 0x7ff1d8108730 2024-09-10T21:46:52.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.303+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7ff1d000f040 con 0x7ff1d8108730 2024-09-10T21:46:52.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.304+0000 7ff1cf7fe640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 0x7ff1c40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:52.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.304+0000 7ff1de48f640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 0x7ff1c40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:52.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.304+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff1d00e4110 con 0x7ff1d8108730 2024-09-10T21:46:52.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.305+0000 7ff1de48f640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 0x7ff1c40b7710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4000c00 tx=0x7ff1d4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:52.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.307+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1d0016030 con 0x7ff1d8108730 2024-09-10T21:46:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:51 smithi070 ceph-mon[34909]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T21:46:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:46:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:51 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/969616922' entity='client.admin' 2024-09-10T21:46:52.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.496+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff1d80fecd0 con 0x7ff1d8108730 2024-09-10T21:46:52.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.500+0000 7ff1cf7fe640 1 -- 172.21.15.39:0/2537766488 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7ff1d80fecd0 con 0x7ff1d8108730 2024-09-10T21:46:52.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 msgr2=0x7ff1c40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:52.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 0x7ff1c40b7710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4000c00 tx=0x7ff1d4005a40 comp rx=0 tx=0).stop 2024-09-10T21:46:52.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 msgr2=0x7ff1d8199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:52.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000eaa0 tx=0x7ff1d000ef60 comp rx=0 tx=0).stop 2024-09-10T21:46:52.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 shutdown_connections 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1c40b5250 0x7ff1c40b7710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1d8108730 0x7ff1d8199ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1d8105b80 0x7ff1d8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 --2- 172.21.15.39:0/2537766488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d806b6e0 0x7ff1d8198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 >> 172.21.15.39:0/2537766488 conn(0x7ff1d80fd1e0 msgr2=0x7ff1d8103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.502+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 shutdown_connections 2024-09-10T21:46:52.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.503+0000 7ff1e06f3640 1 -- 172.21.15.39:0/2537766488 wait complete. 2024-09-10T21:46:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:52 smithi173 ceph-mon[35294]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/187696237' entity='client.admin' 2024-09-10T21:46:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2537766488' entity='client.admin' 2024-09-10T21:46:53.358 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:52 smithi039 ceph-mon[30872]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:53.358 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/187696237' entity='client.admin' 2024-09-10T21:46:53.358 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2537766488' entity='client.admin' 2024-09-10T21:46:53.386 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi039') 2024-09-10T21:46:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:52 smithi070 ceph-mon[34909]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/187696237' entity='client.admin' 2024-09-10T21:46:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2537766488' entity='client.admin' 2024-09-10T21:46:53.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 -- 172.21.15.39:0/1454925539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 msgr2=0x7f6d6c10ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:53.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 --2- 172.21.15.39:0/1454925539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c10ce30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009ca0 tx=0x7f6d6402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 -- 172.21.15.39:0/1454925539 shutdown_connections 2024-09-10T21:46:53.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 --2- 172.21.15.39:0/1454925539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c10ce30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 --2- 172.21.15.39:0/1454925539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c107f60 0x7f6d6c10a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 --2- 172.21.15.39:0/1454925539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c06bfb0 0x7f6d6c107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 -- 172.21.15.39:0/1454925539 >> 172.21.15.39:0/1454925539 conn(0x7f6d6c0fd210 msgr2=0x7f6d6c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 -- 172.21.15.39:0/1454925539 shutdown_connections 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.980+0000 7f6d72e68640 1 -- 172.21.15.39:0/1454925539 wait complete. 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 Processor -- start 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 -- start start 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c06bfb0 0x7f6d6c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:53.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c107f60 0x7f6d6c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:53.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:53.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c1105f0 con 0x7f6d6c10a970 2024-09-10T21:46:53.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c110470 con 0x7f6d6c06bfb0 2024-09-10T21:46:53.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d72e68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c110770 con 0x7f6d6c107f60 2024-09-10T21:46:53.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.981+0000 7f6d71405640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50556/0 (socket says 172.21.15.39:50556) 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 -- 172.21.15.39:0/187696237 learned_addr learned my addr 172.21.15.39:0/187696237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d70c04640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c06bfb0 0x7f6d6c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d63fff640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c107f60 0x7f6d6c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 -- 172.21.15.39:0/187696237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c107f60 msgr2=0x7f6d6c19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:53.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c107f60 0x7f6d6c19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 -- 172.21.15.39:0/187696237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c06bfb0 msgr2=0x7f6d6c19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c06bfb0 0x7f6d6c19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 -- 172.21.15.39:0/187696237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c19c8d0 con 0x7f6d6c10a970 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d71405640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d64003ba0 tx=0x7f6d64003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64004040 con 0x7f6d6c10a970 2024-09-10T21:46:53.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f6d64004650 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6c19cb60 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64030d70 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.982+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6c1a32a0 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.984+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6c107a20 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.985+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f6d640041e0 con 0x7f6d6c10a970 2024-09-10T21:46:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.986+0000 7f6d61ffb640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 0x7f6d540b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.986+0000 7f6d70c04640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 0x7f6d540b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.986+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6d64105670 con 0x7f6d6c10a970 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.986+0000 7f6d70c04640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 0x7f6d540b7790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d680058c0 tx=0x7f6d6800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:51.989+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6d640ce200 con 0x7f6d6c10a970 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.181+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6d6c0fed00 con 0x7f6d6c10a970 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.185+0000 7f6d61ffb640 1 -- 172.21.15.39:0/187696237 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f6d6c0fed00 con 0x7f6d6c10a970 2024-09-10T21:46:53.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 msgr2=0x7f6d540b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 0x7f6d540b7790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d680058c0 tx=0x7f6d6800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 msgr2=0x7f6d6c19c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d64003ba0 tx=0x7f6d64003bd0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 shutdown_connections 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6d540b52d0 0x7f6d540b7790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d6c10a970 0x7f6d6c19c030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d6c107f60 0x7f6d6c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.187+0000 7f6d72e68640 1 --2- 172.21.15.39:0/187696237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d6c06bfb0 0x7f6d6c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:53.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.188+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 >> 172.21.15.39:0/187696237 conn(0x7f6d6c0fd210 msgr2=0x7f6d6c108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:53.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.188+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 shutdown_connections 2024-09-10T21:46:53.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:52.188+0000 7f6d72e68640 1 -- 172.21.15.39:0/187696237 wait complete. 2024-09-10T21:46:54.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.543+0000 7efc116f1640 1 -- 172.21.15.39:0/595983872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c101920 msgr2=0x7efc0c101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.543+0000 7efc116f1640 1 --2- 172.21.15.39:0/595983872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c101920 0x7efc0c101d20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009930 tx=0x7efbfc02a420 comp rx=0 tx=0).stop 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 -- 172.21.15.39:0/595983872 shutdown_connections 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 --2- 172.21.15.39:0/595983872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c103440 0x7efc0c109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 --2- 172.21.15.39:0/595983872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 0x7efc0c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 --2- 172.21.15.39:0/595983872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c101920 0x7efc0c101d20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 -- 172.21.15.39:0/595983872 >> 172.21.15.39:0/595983872 conn(0x7efc0c0fd210 msgr2=0x7efc0c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 -- 172.21.15.39:0/595983872 shutdown_connections 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 -- 172.21.15.39:0/595983872 wait complete. 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 Processor -- start 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 -- start start 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c101920 0x7efc0c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.544+0000 7efc116f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 0x7efc0c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:54.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d350 con 0x7efc0c103440 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d1d0 con 0x7efc0c101920 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10d4d0 con 0x7efc0c102a80 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50600/0 (socket says 172.21.15.39:50600) 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 -- 172.21.15.39:0/2344990974 learned_addr learned my addr 172.21.15.39:0/2344990974 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc027fc640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 0x7efc0c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0affd640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c101920 0x7efc0c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 -- 172.21.15.39:0/2344990974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 msgr2=0x7efc0c19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 0x7efc0c19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 -- 172.21.15.39:0/2344990974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c101920 msgr2=0x7efc0c19ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c101920 0x7efc0c19ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 -- 172.21.15.39:0/2344990974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c19c9c0 con 0x7efc0c103440 2024-09-10T21:46:54.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc0b7fe640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc0400eaa0 tx=0x7efc0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400cdb0 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7efc04005020 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040116d0 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c19ccb0 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.545+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c1a3390 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.547+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c101d20 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.548+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7efc0400f040 con 0x7efc0c103440 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.549+0000 7efc08ff9640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 0x7efbf80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.550+0000 7efc0affd640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 0x7efbf80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:54.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.550+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efc040e4020 con 0x7efc0c103440 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.550+0000 7efc0affd640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 0x7efbf80b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efbfc005ab0 tx=0x7efbfc005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.552+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc04016030 con 0x7efc0c103440 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.738+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7efc0c1a3ad0 con 0x7efc0c103440 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.742+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7efc040ac5e0 con 0x7efc0c103440 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.742+0000 7efc08ff9640 1 -- 172.21.15.39:0/2344990974 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efc04005a30 con 0x7efc0c103440 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 msgr2=0x7efbf80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 0x7efbf80b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efbfc005ab0 tx=0x7efbfc005a40 comp rx=0 tx=0).stop 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 msgr2=0x7efc0c19c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc0400eaa0 tx=0x7efc0400ef60 comp rx=0 tx=0).stop 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 shutdown_connections 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efbf80b52d0 0x7efbf80b7790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0c103440 0x7efc0c19c120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c102a80 0x7efc0c19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 --2- 172.21.15.39:0/2344990974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc0c101920 0x7efc0c19ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:54.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 >> 172.21.15.39:0/2344990974 conn(0x7efc0c0fd210 msgr2=0x7efc0c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:54.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 shutdown_connections 2024-09-10T21:46:54.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:53.744+0000 7efc116f1640 1 -- 172.21.15.39:0/2344990974 wait complete. 2024-09-10T21:46:55.044 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:54 smithi173 ceph-mon[35294]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:55.044 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:54 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2344990974' entity='client.admin' 2024-09-10T21:46:55.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:54 smithi039 ceph-mon[30872]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:55.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:54 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2344990974' entity='client.admin' 2024-09-10T21:46:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:54 smithi070 ceph-mon[34909]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:54 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2344990974' entity='client.admin' 2024-09-10T21:46:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 -- 172.21.15.39:0/301048803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 msgr2=0x7f09e8107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 --2- 172.21.15.39:0/301048803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8107ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009900 tx=0x7f09d802a410 comp rx=0 tx=0).stop 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 -- 172.21.15.39:0/301048803 shutdown_connections 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 --2- 172.21.15.39:0/301048803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e8108730 0x7f09e810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 --2- 172.21.15.39:0/301048803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8107ff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 --2- 172.21.15.39:0/301048803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e806b6e0 0x7f09e81055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 -- 172.21.15.39:0/301048803 >> 172.21.15.39:0/301048803 conn(0x7f09e80fd1e0 msgr2=0x7f09e80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 -- 172.21.15.39:0/301048803 shutdown_connections 2024-09-10T21:46:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.496+0000 7f09f0727640 1 -- 172.21.15.39:0/301048803 wait complete. 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 Processor -- start 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 -- start start 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 0x7f09e8102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e8108730 0x7f09e8101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09e810e540 con 0x7f09e8105b80 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09e810e3c0 con 0x7f09e806b6e0 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09f0727640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09e810e6c0 con 0x7f09e8108730 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.497+0000 7f09edcc2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 0x7f09e8102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09edcc2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50630/0 (socket says 172.21.15.39:50630) 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09edcc2640 1 -- 172.21.15.39:0/2119128687 learned_addr learned my addr 172.21.15.39:0/2119128687 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09eecc4640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e8108730 0x7f09e8101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 -- 172.21.15.39:0/2119128687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e8108730 msgr2=0x7f09e8101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e8108730 0x7f09e8101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 -- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 msgr2=0x7f09e8101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 -- 172.21.15.39:0/2119128687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8102390 con 0x7f09e806b6e0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09ee4c3640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 0x7f09e8102d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e9f0 tx=0x7f09e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400ccc0 con 0x7f09e806b6e0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f09e4005020 con 0x7f09e806b6e0 2024-09-10T21:46:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400ce60 con 0x7f09e806b6e0 2024-09-10T21:46:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e81a2e40 con 0x7f09e806b6e0 2024-09-10T21:46:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.498+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e81a3290 con 0x7f09e806b6e0 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.499+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e80fecd0 con 0x7f09e806b6e0 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.501+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f09e4004a80 con 0x7f09e806b6e0 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.501+0000 7f09df7fe640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 0x7f09d40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.502+0000 7f09edcc2640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 0x7f09d40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.502+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f09e40e3e60 con 0x7f09e806b6e0 2024-09-10T21:46:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.502+0000 7f09edcc2640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 0x7f09d40b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09d8005ec0 tx=0x7f09d8005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:55.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.506+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f09e40051d0 con 0x7f09e806b6e0 2024-09-10T21:46:55.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.692+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f09e8063df0 con 0x7f09e806b6e0 2024-09-10T21:46:55.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.697+0000 7f09df7fe640 1 -- 172.21.15.39:0/2119128687 <== mon.2 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f09e40ac990 con 0x7f09e806b6e0 2024-09-10T21:46:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 msgr2=0x7f09d40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 0x7f09d40b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09d8005ec0 tx=0x7f09d8005dd0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 msgr2=0x7f09e8102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 0x7f09e8102d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e9f0 tx=0x7f09e400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 shutdown_connections 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09d40b52d0 0x7f09d40b7790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09e8108730 0x7f09e8101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09e8105b80 0x7f09e8101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 --2- 172.21.15.39:0/2119128687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09e806b6e0 0x7f09e8102d20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.699+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 >> 172.21.15.39:0/2119128687 conn(0x7f09e80fd1e0 msgr2=0x7f09e8103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.700+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 shutdown_connections 2024-09-10T21:46:55.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:55.700+0000 7f09f0727640 1 -- 172.21.15.39:0/2119128687 wait complete. 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- 172.21.15.39:0/189286664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8105ba0 msgr2=0x7f10e8108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 --2- 172.21.15.39:0/189286664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8105ba0 0x7f10e8108010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009900 tx=0x7f10d802a410 comp rx=0 tx=0).stop 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- 172.21.15.39:0/189286664 shutdown_connections 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 --2- 172.21.15.39:0/189286664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8108750 0x7f10e810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 --2- 172.21.15.39:0/189286664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8105ba0 0x7f10e8108010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 --2- 172.21.15.39:0/189286664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e8105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- 172.21.15.39:0/189286664 >> 172.21.15.39:0/189286664 conn(0x7f10e80fd200 msgr2=0x7f10e80ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- 172.21.15.39:0/189286664 shutdown_connections 2024-09-10T21:46:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- 172.21.15.39:0/189286664 wait complete. 2024-09-10T21:46:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 Processor -- start 2024-09-10T21:46:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.237+0000 7f10f04eb640 1 -- start start 2024-09-10T21:46:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 0x7f10e819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 0x7f10e819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e5b0 con 0x7f10e8108750 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e430 con 0x7f10e806bf00 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10f04eb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810e730 con 0x7f10e8105ba0 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10eea88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 0x7f10e819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10eda86640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 0x7f10e819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:52074/0 (socket says 172.21.15.39:52074) 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10eea88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 0x7f10e819c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50644/0 (socket says 172.21.15.39:50644) 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 -- 172.21.15.39:0/2063552232 learned_addr learned my addr 172.21.15.39:0/2063552232 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 -- 172.21.15.39:0/2063552232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 msgr2=0x7f10e819b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 0x7f10e819b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 -- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 msgr2=0x7f10e819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 0x7f10e819c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 -- 172.21.15.39:0/2063552232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e819cab0 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10eda86640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 0x7f10e819b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.238+0000 7f10ee287640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e9f0 tx=0x7f10e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.239+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e400cd80 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.239+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f10e40108c0 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.239+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40187d0 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.239+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e819cda0 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.239+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81a3480 con 0x7f10e806bf00 2024-09-10T21:46:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.240+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e81a3650 con 0x7f10e806bf00 2024-09-10T21:46:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.241+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f10e4010430 con 0x7f10e806bf00 2024-09-10T21:46:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.242+0000 7f10df7fe640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 0x7f10d40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.242+0000 7f10eda86640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 0x7f10d40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.242+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f10e40e42e0 con 0x7f10e806bf00 2024-09-10T21:46:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.242+0000 7f10eda86640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 0x7f10d40b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10d802aa00 tx=0x7f10d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:56.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.245+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10e40ac780 con 0x7f10e806bf00 2024-09-10T21:46:56.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.431+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f10e81a3820 con 0x7f10e806bf00 2024-09-10T21:46:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.436+0000 7f10df7fe640 1 -- 172.21.15.39:0/2063552232 <== mon.2 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f10e40b11b0 con 0x7f10e806bf00 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 msgr2=0x7f10d40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 0x7f10d40b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10d802aa00 tx=0x7f10d8005a20 comp rx=0 tx=0).stop 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 msgr2=0x7f10e819af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e9f0 tx=0x7f10e400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 shutdown_connections 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10d40b5250 0x7f10d40b7710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10e8108750 0x7f10e819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10e8105ba0 0x7f10e819b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 --2- 172.21.15.39:0/2063552232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e806bf00 0x7f10e819af80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 >> 172.21.15.39:0/2063552232 conn(0x7f10e80fd200 msgr2=0x7f10e80ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 shutdown_connections 2024-09-10T21:46:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.439+0000 7f10f04eb640 1 -- 172.21.15.39:0/2063552232 wait complete. 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/130532733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 msgr2=0x7fa3d8109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/130532733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8109db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009930 tx=0x7fa3c802a420 comp rx=0 tx=0).stop 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/130532733 shutdown_connections 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/130532733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8109db0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/130532733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 0x7fa3d8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/130532733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 0x7fa3d8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/130532733 >> 172.21.15.39:0/130532733 conn(0x7fa3d80fd1e0 msgr2=0x7fa3d80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/130532733 shutdown_connections 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.939+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/130532733 wait complete. 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.940+0000 7fa3dd1dd640 1 Processor -- start 2024-09-10T21:46:56.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.940+0000 7fa3dd1dd640 1 -- start start 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 0x7fa3d81056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 0x7fa3d8103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d810d4b0 con 0x7fa3d8103430 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d810d330 con 0x7fa3d8101910 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d810d630 con 0x7fa3d8102a70 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50660/0 (socket says 172.21.15.39:50660) 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 -- 172.21.15.39:0/2141978865 learned_addr learned my addr 172.21.15.39:0/2141978865 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d659c640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 0x7fa3d8103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d6d9d640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 0x7fa3d81056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 -- 172.21.15.39:0/2141978865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 msgr2=0x7fa3d8103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 0x7fa3d8103f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 -- 172.21.15.39:0/2141978865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 msgr2=0x7fa3d81056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 0x7fa3d81056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 -- 172.21.15.39:0/2141978865 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d8104d40 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3d759e640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005ab0 tx=0x7fa3c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c803f030 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d81a2da0 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa3c8003c90 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.941+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8035070 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.942+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d81a3270 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.943+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d81a34a0 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.944+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fa3c8003800 con 0x7fa3d8103430 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.944+0000 7fa3bffff640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 0x7fa3c00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.945+0000 7fa3d6d9d640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 0x7fa3c00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.945+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa3c81047f0 con 0x7fa3d8103430 2024-09-10T21:46:56.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.945+0000 7fa3d6d9d640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 0x7fa3c00b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005fd0 tx=0x7fa3d0009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:56.951 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:56 smithi039 ceph-mon[30872]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:56.951 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:56 smithi039 ceph-mon[30872]: from='client.? ' entity='client.admin' 2024-09-10T21:46:56.951 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:56 smithi039 ceph-mon[30872]: from='client.? ' entity='client.admin' 2024-09-10T21:46:56.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:56.950+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3c80cd380 con 0x7fa3d8103430 2024-09-10T21:46:56.953 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:46:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:56 smithi173 ceph-mon[35294]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:56 smithi173 ceph-mon[35294]: from='client.? ' entity='client.admin' 2024-09-10T21:46:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:56 smithi173 ceph-mon[35294]: from='client.? ' entity='client.admin' 2024-09-10T21:46:57.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.139+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fa3d81a3670 con 0x7fa3d8103430 2024-09-10T21:46:57.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.144+0000 7fa3bffff640 1 -- 172.21.15.39:0/2141978865 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fa3c80ccc80 con 0x7fa3d8103430 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 msgr2=0x7fa3c00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 0x7fa3c00b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005fd0 tx=0x7fa3d0009870 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 msgr2=0x7fa3d8104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005ab0 tx=0x7fa3c80042f0 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 shutdown_connections 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa3c00b5250 0x7fa3c00b7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3d8103430 0x7fa3d8104480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d8102a70 0x7fa3d8103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 --2- 172.21.15.39:0/2141978865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3d8101910 0x7fa3d81056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 >> 172.21.15.39:0/2141978865 conn(0x7fa3d80fd1e0 msgr2=0x7fa3d80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:57.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 shutdown_connections 2024-09-10T21:46:57.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:57.146+0000 7fa3dd1dd640 1 -- 172.21.15.39:0/2141978865 wait complete. 2024-09-10T21:46:57.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:56 smithi070 ceph-mon[34909]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:57.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:56 smithi070 ceph-mon[34909]: from='client.? ' entity='client.admin' 2024-09-10T21:46:57.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:56 smithi070 ceph-mon[34909]: from='client.? ' entity='client.admin' 2024-09-10T21:46:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:58 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2141978865' entity='client.admin' 2024-09-10T21:46:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:58 smithi070 ceph-mon[34909]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:58.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:58 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2141978865' entity='client.admin' 2024-09-10T21:46:58.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:58 smithi039 ceph-mon[30872]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:58 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2141978865' entity='client.admin' 2024-09-10T21:46:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:58 smithi173 ceph-mon[35294]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:46:58.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 -- 172.21.15.39:0/2399992055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728107f70 msgr2=0x7f072810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:58.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 --2- 172.21.15.39:0/2399992055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728107f70 0x7f072810a360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0718009900 tx=0x7f071802a410 comp rx=0 tx=0).stop 2024-09-10T21:46:58.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 -- 172.21.15.39:0/2399992055 shutdown_connections 2024-09-10T21:46:58.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 --2- 172.21.15.39:0/2399992055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072810a980 0x7f072810ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 --2- 172.21.15.39:0/2399992055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728107f70 0x7f072810a360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 --2- 172.21.15.39:0/2399992055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 0x7f0728107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 -- 172.21.15.39:0/2399992055 >> 172.21.15.39:0/2399992055 conn(0x7f07280fd200 msgr2=0x7f07280ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 -- 172.21.15.39:0/2399992055 shutdown_connections 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.603+0000 7f07301ee640 1 -- 172.21.15.39:0/2399992055 wait complete. 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 Processor -- start 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 -- start start 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 0x7f072819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0728107f70 0x7f072819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0728110770 con 0x7f072810a980 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07281105f0 con 0x7f0728107f70 2024-09-10T21:46:58.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f07301ee640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07281108f0 con 0x7f072806bfb0 2024-09-10T21:46:58.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.604+0000 7f072e78b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:58.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50688/0 (socket says 172.21.15.39:50688) 2024-09-10T21:46:58.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 -- 172.21.15.39:0/3017902569 learned_addr learned my addr 172.21.15.39:0/3017902569 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:46:58.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072d789640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0728107f70 0x7f072819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:58.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072df8a640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 0x7f072819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 -- 172.21.15.39:0/3017902569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 msgr2=0x7f072819af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 0x7f072819af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 -- 172.21.15.39:0/3017902569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0728107f70 msgr2=0x7f072819b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0728107f70 0x7f072819b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 -- 172.21.15.39:0/3017902569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072819caa0 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f072e78b640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f072000cad0 tx=0x7f072000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.605+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072000ae20 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.606+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0720005020 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.606+0000 7f07301ee640 1 -- 172.21.15.39:0/3017902569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072819cd90 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.606+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072000f6b0 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.606+0000 7f07301ee640 1 -- 172.21.15.39:0/3017902569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07281a3470 con 0x7f072810a980 2024-09-10T21:46:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.607+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710005290 con 0x7f072810a980 2024-09-10T21:46:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.610+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f0720004a40 con 0x7f072810a980 2024-09-10T21:46:58.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.611+0000 7f071effd640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 0x7f07140b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:46:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.611+0000 7f072df8a640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 0x7f07140b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:46:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.611+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f07200e3de0 con 0x7f072810a980 2024-09-10T21:46:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.612+0000 7f072df8a640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 0x7f07140b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f072400bbe0 tx=0x7f072400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:46:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.615+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0720014030 con 0x7f072810a980 2024-09-10T21:46:58.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.804+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0710005580 con 0x7f072810a980 2024-09-10T21:46:58.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.808+0000 7f071effd640 1 -- 172.21.15.39:0/3017902569 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v28)=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f07200ac300 con 0x7f072810a980 2024-09-10T21:46:58.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.810+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 msgr2=0x7f07140b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.810+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 0x7f07140b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f072400bbe0 tx=0x7f072400b390 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.810+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 msgr2=0x7f072819c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.810+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f072000cad0 tx=0x7f072000cf90 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 shutdown_connections 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f07140b52d0 0x7f07140b7790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f072810a980 0x7f072819c200 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0728107f70 0x7f072819b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 --2- 172.21.15.39:0/3017902569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f072806bfb0 0x7f072819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 >> 172.21.15.39:0/3017902569 conn(0x7f07280fd200 msgr2=0x7f0728108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 shutdown_connections 2024-09-10T21:46:58.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:46:58.811+0000 7f071cff9640 1 -- 172.21.15.39:0/3017902569 wait complete. 2024-09-10T21:46:58.988 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:47:00.056 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:46:59 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3017902569' entity='client.admin' 2024-09-10T21:47:00.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:46:59 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3017902569' entity='client.admin' 2024-09-10T21:47:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:46:59 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3017902569' entity='client.admin' 2024-09-10T21:47:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 -- 172.21.15.39:0/902268889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 msgr2=0x7f4668102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 --2- 172.21.15.39:0/902268889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668102ef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f465c009930 tx=0x7f465c02a420 comp rx=0 tx=0).stop 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 -- 172.21.15.39:0/902268889 shutdown_connections 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 --2- 172.21.15.39:0/902268889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668103430 0x7f4668109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 --2- 172.21.15.39:0/902268889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668102ef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 --2- 172.21.15.39:0/902268889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668101910 0x7f4668101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 -- 172.21.15.39:0/902268889 >> 172.21.15.39:0/902268889 conn(0x7f46680fd1e0 msgr2=0x7f46680ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 -- 172.21.15.39:0/902268889 shutdown_connections 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.255+0000 7f466c8a6640 1 -- 172.21.15.39:0/902268889 wait complete. 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 Processor -- start 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 -- start start 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668101910 0x7f4668198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 0x7f4668199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:00.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f466810d4a0 con 0x7f4668102a70 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f466810d320 con 0x7f4668103430 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f466c8a6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f466810d620 con 0x7f4668101910 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f4665d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.256+0000 7f4665d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39656/0 (socket says 172.21.15.39:39656) 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 -- 172.21.15.39:0/2722453350 learned_addr learned my addr 172.21.15.39:0/2722453350 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4666d9d640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 0x7f4668199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f466659c640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668101910 0x7f4668198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 -- 172.21.15.39:0/2722453350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668101910 msgr2=0x7f4668198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668101910 0x7f4668198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 -- 172.21.15.39:0/2722453350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 msgr2=0x7f4668199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 0x7f4668199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 -- 172.21.15.39:0/2722453350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466819a810 con 0x7f4668102a70 2024-09-10T21:47:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4666d9d640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 0x7f4668199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f4665d9b640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f465c005ab0 tx=0x7f465c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c03f070 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f465c031b00 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466819aaa0 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.257+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c035030 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.258+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46681a1010 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.259+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46681a1330 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.260+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f465c031670 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.261+0000 7f46577fe640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 0x7f46500b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.261+0000 7f466659c640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 0x7f46500b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.261+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f465c104960 con 0x7f4668102a70 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.262+0000 7f466659c640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 0x7f46500b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4658009bd0 tx=0x7f4658005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:00.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.265+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f465c0ccea0 con 0x7f4668102a70 2024-09-10T21:47:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.455+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f46681a1500 con 0x7f4668102a70 2024-09-10T21:47:00.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.458+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) ==== 123+0+0 (secure 0 0 0) 0x7f465c0d18d0 con 0x7f4668102a70 2024-09-10T21:47:00.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.459+0000 7f46577fe640 1 -- 172.21.15.39:0/2722453350 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c10a080 con 0x7f4668102a70 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 msgr2=0x7f46500b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 0x7f46500b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4658009bd0 tx=0x7f4658005f90 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 msgr2=0x7f4668199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f465c005ab0 tx=0x7f465c003b90 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 shutdown_connections 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f46500b5250 0x7f46500b7710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4668103430 0x7f4668199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4668102a70 0x7f4668199330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 --2- 172.21.15.39:0/2722453350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4668101910 0x7f4668198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 >> 172.21.15.39:0/2722453350 conn(0x7f46680fd1e0 msgr2=0x7f46680fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 shutdown_connections 2024-09-10T21:47:00.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:00.461+0000 7f466c8a6640 1 -- 172.21.15.39:0/2722453350 wait complete. 2024-09-10T21:47:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:47:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:00 smithi070 ceph-mon[34909]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:00 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2722453350' entity='client.admin' 2024-09-10T21:47:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:00 smithi039 ceph-mon[30872]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:00 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2722453350' entity='client.admin' 2024-09-10T21:47:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:01.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:00 smithi173 ceph-mon[35294]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:01.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:00 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2722453350' entity='client.admin' 2024-09-10T21:47:01.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:01.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:02.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:02.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:02.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:02.136 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi039') 2024-09-10T21:47:02.136 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi039') 2024-09-10T21:47:02.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:02.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:02.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:02.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:02.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:02.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 -- 172.21.15.39:0/3564856335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 msgr2=0x7f3200108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 --2- 172.21.15.39:0/3564856335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200108030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009900 tx=0x7f31f402a410 comp rx=0 tx=0).stop 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 -- 172.21.15.39:0/3564856335 shutdown_connections 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 --2- 172.21.15.39:0/3564856335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3200108770 0x7f320010ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 --2- 172.21.15.39:0/3564856335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200108030 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 --2- 172.21.15.39:0/3564856335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f320006c0c0 0x7f3200105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 -- 172.21.15.39:0/3564856335 >> 172.21.15.39:0/3564856335 conn(0x7f32000fd200 msgr2=0x7f32000ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.363+0000 7f32048de640 1 -- 172.21.15.39:0/3564856335 shutdown_connections 2024-09-10T21:47:02.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.364+0000 7f32048de640 1 -- 172.21.15.39:0/3564856335 wait complete. 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.364+0000 7f32048de640 1 Processor -- start 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.364+0000 7f32048de640 1 -- start start 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f320006c0c0 0x7f3200198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3200108770 0x7f320019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:02.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f320010e6a0 con 0x7f3200105bc0 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f320010e520 con 0x7f3200108770 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f32048de640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f320010e820 con 0x7f320006c0c0 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39676/0 (socket says 172.21.15.39:39676) 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 -- 172.21.15.39:0/4292220108 learned_addr learned my addr 172.21.15.39:0/4292220108 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fed9d640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3200108770 0x7f320019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fe59c640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f320006c0c0 0x7f3200198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 -- 172.21.15.39:0/4292220108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f320006c0c0 msgr2=0x7f3200198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f320006c0c0 0x7f3200198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 -- 172.21.15.39:0/4292220108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3200108770 msgr2=0x7f320019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3200108770 0x7f320019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 -- 172.21.15.39:0/4292220108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320019a950 con 0x7f3200105bc0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.365+0000 7f31fdd9b640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006010 tx=0x7f31f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.366+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f403f030 con 0x7f3200105bc0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.366+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31f4031910 con 0x7f3200105bc0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.366+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320019abe0 con 0x7f3200105bc0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.366+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4035070 con 0x7f3200105bc0 2024-09-10T21:47:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.366+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32001015e0 con 0x7f3200105bc0 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.367+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3200106020 con 0x7f3200105bc0 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.368+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f31f4003800 con 0x7f3200105bc0 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.369+0000 7f31ef7fe640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 0x7f31e80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.369+0000 7f31fe59c640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 0x7f31e80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.369+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f31f4104670 con 0x7f3200105bc0 2024-09-10T21:47:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.369+0000 7f31fe59c640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 0x7f31e80b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009bd0 tx=0x7f31f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:02.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.373+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31f4003d40 con 0x7f3200105bc0 2024-09-10T21:47:02.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.563+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f320002e930 con 0x7f3200105bc0 2024-09-10T21:47:02.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.568+0000 7f31ef7fe640 1 -- 172.21.15.39:0/4292220108 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f31f40ccbb0 con 0x7f3200105bc0 2024-09-10T21:47:02.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 msgr2=0x7f31e80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 0x7f31e80b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009bd0 tx=0x7f31f0005f90 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 msgr2=0x7f3200199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006010 tx=0x7f31f40042f0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 shutdown_connections 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31e80b52d0 0x7f31e80b7790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3200108770 0x7f320019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3200105bc0 0x7f3200199470 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 --2- 172.21.15.39:0/4292220108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f320006c0c0 0x7f3200198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 >> 172.21.15.39:0/4292220108 conn(0x7f32000fd200 msgr2=0x7f3200103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 shutdown_connections 2024-09-10T21:47:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:02.571+0000 7f32048de640 1 -- 172.21.15.39:0/4292220108 wait complete. 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.115 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.116 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.116 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi039') 2024-09-10T21:47:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:03 smithi039 ceph-mon[30872]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:03 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4292220108' entity='client.admin' 2024-09-10T21:47:03.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 -- 172.21.15.39:0/3175893639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce806b6e0 msgr2=0x7f7ce81055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:03.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/3175893639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce806b6e0 0x7f7ce81055f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009900 tx=0x7f7ce402a410 comp rx=0 tx=0).stop 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 -- 172.21.15.39:0/3175893639 shutdown_connections 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/3175893639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce8108730 0x7f7ce810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/3175893639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 0x7f7ce8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/3175893639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce806b6e0 0x7f7ce81055f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 -- 172.21.15.39:0/3175893639 >> 172.21.15.39:0/3175893639 conn(0x7f7ce80fd1e0 msgr2=0x7f7ce80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 -- 172.21.15.39:0/3175893639 shutdown_connections 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.339+0000 7f7cf05c7640 1 -- 172.21.15.39:0/3175893639 wait complete. 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 Processor -- start 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 -- start start 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce806b6e0 0x7f7ce8102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 0x7f7ce8101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:03.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810e700 con 0x7f7ce8108730 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810e580 con 0x7f7ce8105b80 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7cf05c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810e880 con 0x7f7ce806b6e0 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.340+0000 7f7ceeb64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39692/0 (socket says 172.21.15.39:39692) 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 -- 172.21.15.39:0/90394029 learned_addr learned my addr 172.21.15.39:0/90394029 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cee363640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce806b6e0 0x7f7ce8102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cedb62640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 0x7f7ce8101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 -- 172.21.15.39:0/90394029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce806b6e0 msgr2=0x7f7ce8102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce806b6e0 0x7f7ce8102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 -- 172.21.15.39:0/90394029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 msgr2=0x7f7ce8101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 0x7f7ce8101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 -- 172.21.15.39:0/90394029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce8102390 con 0x7f7ce8108730 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7ceeb64640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eaa0 tx=0x7f7ce000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000cdb0 con 0x7f7ce8108730 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ce0005020 con 0x7f7ce8108730 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce81a2ee0 con 0x7f7ce8108730 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00116d0 con 0x7f7ce8108730 2024-09-10T21:47:03.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.341+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce81a33e0 con 0x7f7ce8108730 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.342+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce80fecd0 con 0x7f7ce8108730 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.344+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f7ce0022060 con 0x7f7ce8108730 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.344+0000 7f7cdf7fe640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 0x7f7cd40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.345+0000 7f7cee363640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 0x7f7cd40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.345+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ce00e3c20 con 0x7f7ce8108730 2024-09-10T21:47:03.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.345+0000 7f7cee363640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 0x7f7cd40b7790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4031500 tx=0x7f7ce4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:03.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.347+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7ce0016030 con 0x7f7ce8108730 2024-09-10T21:47:03.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:03 smithi070 ceph-mon[34909]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:03.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:03 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4292220108' entity='client.admin' 2024-09-10T21:47:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:03 smithi173 ceph-mon[35294]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:03 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4292220108' entity='client.admin' 2024-09-10T21:47:03.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.531+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7ce802e5c0 con 0x7f7ce8108730 2024-09-10T21:47:03.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.536+0000 7f7cdf7fe640 1 -- 172.21.15.39:0/90394029 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f7ce00ac830 con 0x7f7ce8108730 2024-09-10T21:47:03.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 msgr2=0x7f7cd40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 0x7f7cd40b7790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4031500 tx=0x7f7ce4005a20 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 msgr2=0x7f7ce8101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eaa0 tx=0x7f7ce000ef60 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 shutdown_connections 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7cd40b52d0 0x7f7cd40b7790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce8108730 0x7f7ce8101ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce8105b80 0x7f7ce8101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 --2- 172.21.15.39:0/90394029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ce806b6e0 0x7f7ce8102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 >> 172.21.15.39:0/90394029 conn(0x7f7ce80fd1e0 msgr2=0x7f7ce8103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 shutdown_connections 2024-09-10T21:47:03.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:03.539+0000 7f7cf05c7640 1 -- 172.21.15.39:0/90394029 wait complete. 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.121 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'c8786c20-6fbd-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi039') 2024-09-10T21:47:04.121 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T21:47:04.121 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:47:04.121 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:47:04.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:47:04.138 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-10 21:45:57.736520843 +0000 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-10 21:41:37.746709439 +0000 2024-09-10T21:47:04.195 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-10 21:41:37.746709439 +0000 2024-09-10T21:47:04.196 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-10 21:41:37.746709439 +0000 2024-09-10T21:47:04.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:47:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-10T21:47:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-10T21:47:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000397289 s, 1.3 MB/s 2024-09-10T21:47:04.264 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:47:04.321 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-10 21:45:57.768520255 +0000 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-10 21:41:38.087703316 +0000 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-10 21:41:38.087703316 +0000 2024-09-10T21:47:04.378 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-10 21:41:38.087703316 +0000 2024-09-10T21:47:04.378 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:47:04.442 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-10T21:47:04.442 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-10T21:47:04.442 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000275108 s, 1.9 MB/s 2024-09-10T21:47:04.443 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:47:04.500 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-10T21:47:04.556 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-10 21:45:57.799519685 +0000 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-10 21:41:38.416697408 +0000 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-10 21:41:38.416697408 +0000 2024-09-10T21:47:04.557 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-10 21:41:38.416697408 +0000 2024-09-10T21:47:04.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:47:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-10T21:47:04.621 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-10T21:47:04.621 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000332913 s, 1.5 MB/s 2024-09-10T21:47:04.622 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:47:04.679 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-10T21:47:04.735 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:47:04.735 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:04.735 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T21:47:04.735 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:04.736 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:04.736 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-10 21:45:57.832519078 +0000 2024-09-10T21:47:04.736 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-10 21:41:38.763691177 +0000 2024-09-10T21:47:04.736 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-10 21:41:38.763691177 +0000 2024-09-10T21:47:04.736 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-10 21:41:38.763691177 +0000 2024-09-10T21:47:04.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:47:04.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:04 smithi039 ceph-mon[30872]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:04.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:04 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/90394029' entity='client.admin' 2024-09-10T21:47:04.800 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-10T21:47:04.800 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-10T21:47:04.800 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000269402 s, 1.9 MB/s 2024-09-10T21:47:04.801 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:47:04.858 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T21:47:04.859 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:47:04.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:47:04.879 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-10T21:47:04.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:04 smithi070 ceph-mon[34909]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:04.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:04 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/90394029' entity='client.admin' 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 21:46:44.996568633 +0000 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 21:41:46.469438032 +0000 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 21:41:46.469438032 +0000 2024-09-10T21:47:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-10 21:41:46.469438032 +0000 2024-09-10T21:47:04.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:47:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:04 smithi173 ceph-mon[35294]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:04 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/90394029' entity='client.admin' 2024-09-10T21:47:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T21:47:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T21:47:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000120489 s, 4.2 MB/s 2024-09-10T21:47:04.998 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:47:05.058 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-10T21:47:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:47:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:05.115 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 21:46:44.997568604 +0000 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 21:41:46.785428522 +0000 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 21:41:46.785428522 +0000 2024-09-10T21:47:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-10 21:41:46.785428522 +0000 2024-09-10T21:47:05.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:47:05.181 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T21:47:05.182 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T21:47:05.182 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000125227 s, 4.1 MB/s 2024-09-10T21:47:05.183 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:47:05.240 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 21:46:44.997568604 +0000 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 21:41:47.102418983 +0000 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 21:41:47.102418983 +0000 2024-09-10T21:47:05.296 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-10 21:41:47.102418983 +0000 2024-09-10T21:47:05.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:47:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T21:47:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T21:47:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.7771e-05 s, 5.8 MB/s 2024-09-10T21:47:05.361 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:47:05.418 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-10T21:47:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:47:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:05.484 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 21:46:44.997568604 +0000 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 21:41:47.413409625 +0000 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 21:41:47.414409594 +0000 2024-09-10T21:47:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-10 21:41:47.413409625 +0000 2024-09-10T21:47:05.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:47:05.549 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T21:47:05.549 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T21:47:05.550 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.7498e-05 s, 5.9 MB/s 2024-09-10T21:47:05.551 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:47:05.607 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-10T21:47:05.607 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:47:05.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:47:05.627 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-10T21:47:05.685 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:47:05.685 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-10 21:46:42.533962807 +0000 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-10 21:41:44.975351553 +0000 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-10 21:41:44.975351553 +0000 2024-09-10T21:47:05.686 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-10 21:41:44.975351553 +0000 2024-09-10T21:47:05.686 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:47:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-10T21:47:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-10T21:47:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000267052 s, 1.9 MB/s 2024-09-10T21:47:05.759 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:47:05.818 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-10 21:46:42.533962807 +0000 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-10 21:41:45.300344296 +0000 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-10 21:41:45.300344296 +0000 2024-09-10T21:47:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-10 21:41:45.300344296 +0000 2024-09-10T21:47:05.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:47:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-10T21:47:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-10T21:47:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000214587 s, 2.4 MB/s 2024-09-10T21:47:05.941 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:47:05.998 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-10 21:46:42.533962807 +0000 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-10 21:41:45.625337039 +0000 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-10 21:41:45.625337039 +0000 2024-09-10T21:47:06.053 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-10 21:41:45.625337039 +0000 2024-09-10T21:47:06.054 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:47:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-10T21:47:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-10T21:47:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000236199 s, 2.2 MB/s 2024-09-10T21:47:06.117 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:47:06.174 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-10T21:47:06.229 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-10 21:46:42.534962785 +0000 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-10 21:41:45.961329536 +0000 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-10 21:41:45.961329536 +0000 2024-09-10T21:47:06.230 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-10 21:41:45.961329536 +0000 2024-09-10T21:47:06.230 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:47:06.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-10T21:47:06.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-10T21:47:06.295 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00020781 s, 2.5 MB/s 2024-09-10T21:47:06.296 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:47:06.353 INFO:tasks.cephadm:Deploying osd.0 on smithi039 with /dev/vg_nvme/lv_4... 2024-09-10T21:47:06.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:47:06.616 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:47:06.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:06 smithi039 ceph-mon[30872]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:06 smithi070 ceph-mon[34909]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:06 smithi173 ceph-mon[35294]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:08.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:08 smithi039 ceph-mon[30872]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:47:08.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2024-09-10T21:47:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:08 smithi070 ceph-mon[34909]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:08 smithi173 ceph-mon[35294]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:09.155 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 -- 172.21.15.39:0/410803379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 msgr2=0x7f3ca0109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 --2- 172.21.15.39:0/410803379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca0109df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009cd0 tx=0x7f3c9802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 -- 172.21.15.39:0/410803379 shutdown_connections 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 --2- 172.21.15.39:0/410803379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca0109df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 --2- 172.21.15.39:0/410803379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca0102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 --2- 172.21.15.39:0/410803379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 -- 172.21.15.39:0/410803379 >> 172.21.15.39:0/410803379 conn(0x7f3ca00fd200 msgr2=0x7f3ca00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 -- 172.21.15.39:0/410803379 shutdown_connections 2024-09-10T21:47:09.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 -- 172.21.15.39:0/410803379 wait complete. 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.612+0000 7f3ca547b640 1 Processor -- start 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 -- start start 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca010d5b0 con 0x7f3ca0103470 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca010d430 con 0x7f3ca0101950 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3ca547b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca010d730 con 0x7f3ca0102ab0 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39712/0 (socket says 172.21.15.39:39712) 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 -- 172.21.15.39:0/3801210847 learned_addr learned my addr 172.21.15.39:0/3801210847 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:47:09.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9e7fc640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9effd640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 -- 172.21.15.39:0/3801210847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 msgr2=0x7f3ca019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 -- 172.21.15.39:0/3801210847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 msgr2=0x7f3ca006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca006bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9f7fe640 1 -- 172.21.15.39:0/3801210847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca01a0980 con 0x7f3ca0103470 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9effd640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.613+0000 7f3c9e7fc640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3c9f7fe640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c980317d0 tx=0x7f3c98003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004250 con 0x7f3ca0103470 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c980305a0 con 0x7f3ca0103470 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca01a0c10 con 0x7f3ca0103470 2024-09-10T21:47:09.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98045670 con 0x7f3ca0103470 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.614+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a11a0 con 0x7f3ca0103470 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.615+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0108c00 con 0x7f3ca0103470 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.616+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f3c9804d070 con 0x7f3ca0103470 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.617+0000 7f3c87fff640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 0x7f3c880b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.617+0000 7f3c9effd640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 0x7f3c880b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.617+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3c9802e030 con 0x7f3ca0103470 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.617+0000 7f3c9effd640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 0x7f3c880b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009c20 tx=0x7f3c90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:09.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.620+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c9804a060 con 0x7f3ca0103470 2024-09-10T21:47:09.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:09.814+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3ca0063590 con 0x7f3c880b52d0 2024-09-10T21:47:10.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:10 smithi039 ceph-mon[30872]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:10.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:10 smithi039 ceph-mon[30872]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:10.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:10.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:10.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:10 smithi070 ceph-mon[34909]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:10 smithi070 ceph-mon[34909]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:10 smithi173 ceph-mon[35294]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:10 smithi173 ceph-mon[35294]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"} : dispatch 2024-09-10T21:47:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"}]': finished 2024-09-10T21:47:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:47:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:12 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/473655530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"} : dispatch 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"}]': finished 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/473655530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"} : dispatch 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/936232316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56332c27-ff44-404f-888f-2afe3c4a79e5"}]': finished 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:12 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/473655530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:15.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:14 smithi070 ceph-mon[34909]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:15.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:14 smithi039 ceph-mon[30872]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:15.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:14 smithi173 ceph-mon[35294]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:17.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:16 smithi070 ceph-mon[34909]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:16 smithi039 ceph-mon[30872]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:16 smithi173 ceph-mon[35294]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:18 smithi039 ceph-mon[30872]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:19.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:18 smithi070 ceph-mon[34909]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:19.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:18 smithi173 ceph-mon[35294]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:20 smithi039 ceph-mon[30872]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:21.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:20 smithi070 ceph-mon[34909]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:21.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:20 smithi173 ceph-mon[35294]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:22.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:47:22.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:22.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:47:22.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:22.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:47:22.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:22.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:22 smithi039 ceph-mon[30872]: Deploying daemon osd.0 on smithi039 2024-09-10T21:47:22.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:22 smithi039 ceph-mon[30872]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:23.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:22 smithi070 ceph-mon[34909]: Deploying daemon osd.0 on smithi039 2024-09-10T21:47:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:22 smithi070 ceph-mon[34909]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:22 smithi173 ceph-mon[35294]: Deploying daemon osd.0 on smithi039 2024-09-10T21:47:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:22 smithi173 ceph-mon[35294]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:25.044 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:24 smithi173 ceph-mon[35294]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:25.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:24 smithi070 ceph-mon[34909]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:24 smithi039 ceph-mon[30872]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:27.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:26 smithi070 ceph-mon[34909]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:26 smithi039 ceph-mon[30872]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:26 smithi173 ceph-mon[35294]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:27.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:27.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:27.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:28.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:28.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:28.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:28.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:29.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:28 smithi070 ceph-mon[34909]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:29.168 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:28 smithi039 ceph-mon[30872]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:28 smithi173 ceph-mon[35294]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:31.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:31.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:31.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:31.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:31.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:31.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.561+0000 7f3c87fff640 1 -- 172.21.15.39:0/3801210847 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ca0063590 con 0x7f3c880b52d0 2024-09-10T21:47:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 0 on host 'smithi039' 2024-09-10T21:47:31.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.564+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 msgr2=0x7f3c880b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:31.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.564+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 0x7f3c880b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009c20 tx=0x7f3c90005f90 comp rx=0 tx=0).stop 2024-09-10T21:47:31.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.564+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 msgr2=0x7f3ca01a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.564+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c980317d0 tx=0x7f3c98003c10 comp rx=0 tx=0).stop 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 shutdown_connections 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c880b52d0 0x7f3c880b7790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ca0103470 0x7f3ca01a00c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102ab0 0x7f3ca019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 --2- 172.21.15.39:0/3801210847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca0101950 0x7f3ca006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 >> 172.21.15.39:0/3801210847 conn(0x7f3ca00fd200 msgr2=0x7f3ca0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 shutdown_connections 2024-09-10T21:47:31.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:47:31.565+0000 7f3ca547b640 1 -- 172.21.15.39:0/3801210847 wait complete. 2024-09-10T21:47:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:31 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:31 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:31 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:32.188 DEBUG:teuthology.orchestra.run.smithi039:osd.0> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T21:47:32.191 INFO:tasks.cephadm:Deploying osd.1 on smithi070 with /dev/vg_nvme/lv_4... 2024-09-10T21:47:32.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:47:32.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:31 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:32.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:31 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:32.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:31 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:32.451 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:47:32.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:31 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:32.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:31 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:32.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:31 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:33.121 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:33 smithi070 ceph-mon[34909]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:33.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:32 smithi039 ceph-mon[30872]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:33.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:32 smithi173 ceph-mon[35294]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:33.560 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:47:33 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T21:47:33.543+0000 7f2f8cb7e640 -1 osd.0 0 log_to_monitors true 2024-09-10T21:47:34.291 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:34 smithi039 ceph-mon[30872]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:47:34.388 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:34 smithi070 ceph-mon[34909]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:47:34.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:34 smithi173 ceph-mon[35294]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:47:34.748 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:47:34.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-09-10T21:47:35.033 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:47:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:47:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.272 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:35.272 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:47:35.272 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:47:35.272 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:47:35.272 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:35.273 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:35.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:35.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 -- 172.21.15.70:0/735400630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20102a30 msgr2=0x7f1d20102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:35.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/735400630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20102a30 0x7f1d20102e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009930 tx=0x7f1d1002a420 comp rx=0 tx=0).stop 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 -- 172.21.15.70:0/735400630 shutdown_connections 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/735400630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20104550 0x7f1d2010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/735400630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20103b90 0x7f1d20104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/735400630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20102a30 0x7f1d20102e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 -- 172.21.15.70:0/735400630 >> 172.21.15.70:0/735400630 conn(0x7f1d200fe320 msgr2=0x7f1d20100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 -- 172.21.15.70:0/735400630 shutdown_connections 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.497+0000 7f1d24cd2640 1 -- 172.21.15.70:0/735400630 wait complete. 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 Processor -- start 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 -- start start 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20102a30 0x7f1d20198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:35.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20103b90 0x7f1d201994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2010e700 con 0x7f1d20102a30 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2010e580 con 0x7f1d20104550 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.498+0000 7f1d24cd2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2010e880 con 0x7f1d20103b90 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47958/0 (socket says 172.21.15.70:47958) 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 -- 172.21.15.70:0/371799261 learned_addr learned my addr 172.21.15.70:0/371799261 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1e59c640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20102a30 0x7f1d20198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d15d9b640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20103b90 0x7f1d201994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 -- 172.21.15.70:0/371799261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20103b90 msgr2=0x7f1d201994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20103b90 0x7f1d201994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 -- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20102a30 msgr2=0x7f1d20198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:35.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20102a30 0x7f1d20198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 -- 172.21.15.70:0/371799261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2019a910 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d1ed9d640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800eb10 tx=0x7f1d1800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18004b20 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d18004cc0 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2019ac00 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18010670 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.499+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d201a12e0 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.500+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d20109d50 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.502+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f1d18005000 con 0x7f1d20104550 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.502+0000 7f1d17fff640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 0x7f1d0c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.502+0000 7f1d1e59c640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 0x7f1d0c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:47:35.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.502+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f1d180e4750 con 0x7f1d20104550 2024-09-10T21:47:35.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.503+0000 7f1d1e59c640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 0x7f1d0c0b7710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009900 tx=0x7f1d10031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:47:35.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.505+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1d18056220 con 0x7f1d20104550 2024-09-10T21:47:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:35.692+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1d20063590 con 0x7f1d0c0b5250 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi039 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:36.334 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:36 smithi070 ceph-mon[34909]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' 2024-09-10T21:47:36.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:47:35 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T21:47:35.956+0000 7f2f88b01640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T21:47:36.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T21:47:36.020+0000 7f2f80920640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:47:36.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi039 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:36.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:36 smithi039 ceph-mon[30872]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi039 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:47:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:47:36.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:36.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:36 smithi173 ceph-mon[35294]: from='osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863]' entity='osd.0' 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:37.039 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:37 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:37 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:37 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:38.303 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] boot 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/813455493' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"}]': finished 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T21:47:38.304 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:47:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] boot 2024-09-10T21:47:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:47:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/813455493' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"}]': finished 2024-09-10T21:47:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T21:47:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: osd.0 [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] boot 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/813455493' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"} : dispatch 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c072d34-38e6-475a-b178-5482d9d1cd77"}]': finished 2024-09-10T21:47:38.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T21:47:38.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:47:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:39 smithi070 ceph-mon[34909]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:39 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/2759475908' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:39 smithi039 ceph-mon[30872]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:39 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/2759475908' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:39.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:39 smithi173 ceph-mon[35294]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:47:39.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:39 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/2759475908' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:47:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:41 smithi070 ceph-mon[34909]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:41.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:41 smithi039 ceph-mon[30872]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:41.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:41 smithi173 ceph-mon[35294]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:43 smithi070 ceph-mon[34909]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:43 smithi039 ceph-mon[30872]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:43 smithi173 ceph-mon[35294]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:45.149 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:45 smithi070 ceph-mon[34909]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:45 smithi039 ceph-mon[30872]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:45 smithi173 ceph-mon[35294]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:47.150 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:47 smithi070 ceph-mon[34909]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:47.150 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:47:47.150 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:47 smithi039 ceph-mon[30872]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:47:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:47 smithi173 ceph-mon[35294]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:47:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:48.310 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:48 smithi070 ceph-mon[34909]: Deploying daemon osd.1 on smithi070 2024-09-10T21:47:48.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:48 smithi039 ceph-mon[30872]: Deploying daemon osd.1 on smithi070 2024-09-10T21:47:48.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:48 smithi173 ceph-mon[35294]: Deploying daemon osd.1 on smithi070 2024-09-10T21:47:49.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:49 smithi070 ceph-mon[34909]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:49.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:49 smithi039 ceph-mon[30872]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:49 smithi173 ceph-mon[35294]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:51 smithi070 ceph-mon[34909]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:51 smithi039 ceph-mon[30872]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:51 smithi173 ceph-mon[35294]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:53.314 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:53 smithi070 ceph-mon[34909]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:53.314 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:53.314 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:53.314 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:53 smithi039 ceph-mon[30872]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:53 smithi173 ceph-mon[35294]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:55.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:55.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:55.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:55 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:55.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:55 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:47:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:55 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:56.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.806+0000 7f1d17fff640 1 -- 172.21.15.70:0/371799261 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d20063590 con 0x7f1d0c0b5250 2024-09-10T21:47:56.808 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 1 on host 'smithi070' 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 msgr2=0x7f1d0c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 0x7f1d0c0b7710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009900 tx=0x7f1d10031450 comp rx=0 tx=0).stop 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 msgr2=0x7f1d2019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800eb10 tx=0x7f1d1800c2d0 comp rx=0 tx=0).stop 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 shutdown_connections 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1d0c0b5250 0x7f1d0c0b7710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:56.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d20104550 0x7f1d2019a070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d20103b90 0x7f1d201994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 --2- 172.21.15.70:0/371799261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d20102a30 0x7f1d20198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:47:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.808+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 >> 172.21.15.70:0/371799261 conn(0x7f1d200fe320 msgr2=0x7f1d20106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:47:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.809+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 shutdown_connections 2024-09-10T21:47:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:47:56.809+0000 7f1d24cd2640 1 -- 172.21.15.70:0/371799261 wait complete. 2024-09-10T21:47:57.391 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:57 smithi070 ceph-mon[34909]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:57.391 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:57.392 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.392 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.420 DEBUG:teuthology.orchestra.run.smithi070:osd.1> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T21:47:57.423 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2024-09-10T21:47:57.423 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:47:57.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:57 smithi039 ceph-mon[30872]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:57.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:57.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:57 smithi173 ceph-mon[35294]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:57.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:47:57.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:47:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:47:58.800 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:47:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T21:47:58.667+0000 7f58f6f24640 -1 osd.1 0 log_to_monitors true 2024-09-10T21:47:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:59 smithi173 ceph-mon[35294]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:59 smithi173 ceph-mon[35294]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:47:59 smithi173 ceph-mon[35294]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:59 smithi070 ceph-mon[34909]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:59 smithi070 ceph-mon[34909]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:47:59 smithi070 ceph-mon[34909]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:59 smithi039 ceph-mon[30872]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:47:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:59 smithi039 ceph-mon[30872]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:47:59 smithi039 ceph-mon[30872]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:47:59.996 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:48:00.021 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-09-10T21:48:00.308 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:48:00.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:48:00.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:48:00.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:00.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-mon[34909]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:00 smithi039 ceph-mon[30872]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: from='osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:48:00.429 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:00 smithi173 ceph-mon[35294]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 -- 172.21.15.173:0/1054243311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898103b90 msgr2=0x7fa898104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1054243311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898103b90 0x7fa898104010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009960 tx=0x7fa88c02a460 comp rx=0 tx=0).stop 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 -- 172.21.15.173:0/1054243311 shutdown_connections 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1054243311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898104550 0x7fa89810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1054243311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898103b90 0x7fa898104010 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009960 tx=0x7fa88c02a460 comp rx=0 tx=0).stop 2024-09-10T21:48:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1054243311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa898102a30 0x7fa898102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 -- 172.21.15.173:0/1054243311 >> 172.21.15.173:0/1054243311 conn(0x7fa8980fe320 msgr2=0x7fa898100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 -- 172.21.15.173:0/1054243311 shutdown_connections 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.745+0000 7fa89df2b640 1 -- 172.21.15.173:0/1054243311 wait complete. 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 Processor -- start 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 -- start start 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 0x7fa89819b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 0x7fa89819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810e700 con 0x7fa898102a30 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810e580 con 0x7fa89819c500 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa89df2b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa89810e880 con 0x7fa898104550 2024-09-10T21:48:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38866/0 (socket says 172.21.15.173:38866) 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 -- 172.21.15.173:0/1639446224 learned_addr learned my addr 172.21.15.173:0/1639446224 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa897fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 0x7fa89819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa8977fe640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 0x7fa89819b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 -- 172.21.15.173:0/1639446224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 msgr2=0x7fa89819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 0x7fa89819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 -- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 msgr2=0x7fa89819b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.746+0000 7fa896ffd640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 0x7fa89819b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa896ffd640 1 -- 172.21.15.173:0/1639446224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89819d180 con 0x7fa898104550 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa8977fe640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 0x7fa89819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa897fff640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 0x7fa89819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:48:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa896ffd640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa88c031460 tx=0x7fa88c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c03f020 con 0x7fa898104550 2024-09-10T21:48:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa88c031bb0 con 0x7fa898104550 2024-09-10T21:48:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981a35a0 con 0x7fa898104550 2024-09-10T21:48:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c035070 con 0x7fa898104550 2024-09-10T21:48:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.747+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981a3940 con 0x7fa898104550 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.748+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa898104010 con 0x7fa898104550 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.750+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fa88c031700 con 0x7fa898104550 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.751+0000 7fa894ff9640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 0x7fa8800b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.751+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7fa88c1053a0 con 0x7fa898104550 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.751+0000 7fa8977fe640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 0x7fa8800b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.752+0000 7fa8977fe640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 0x7fa8800b7710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa888009b50 tx=0x7fa888005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.754+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa88c049030 con 0x7fa898104550 2024-09-10T21:48:00.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:00.938+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa898063650 con 0x7fa8800b5250 2024-09-10T21:48:01.112 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T21:48:00.790+0000 7f58f36bb640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T21:48:01.112 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T21:48:00.793+0000 7f58eacc6640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:48:01.363 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi070 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.364 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='osd.1 ' entity='osd.1' 2024-09-10T21:48:01.365 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:01.365 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:01.365 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:01.365 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.365 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:01 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi070 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='osd.1 ' entity='osd.1' 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:01 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi070 2024-09-10T21:48:01.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='osd.1 ' entity='osd.1' 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:01.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:01.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:01 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:02.304 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:48:02.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:48:02.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:02.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] boot 2024-09-10T21:48:02.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T21:48:02.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:48:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:48:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] boot 2024-09-10T21:48:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T21:48:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: osd.1 [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] boot 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T21:48:02.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/3069022410' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"}]': finished 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:04 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/3572739412' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/3069022410' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"}]': finished 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:04.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:04.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:04 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/3572739412' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/3069022410' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"} : dispatch 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1368958a-2ba8-4150-a83e-34fe758cc97c"}]': finished 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:04.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:04 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/3572739412' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:06 smithi173 ceph-mon[35294]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:06 smithi070 ceph-mon[34909]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:06 smithi039 ceph-mon[30872]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:08.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:08 smithi173 ceph-mon[35294]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:08 smithi070 ceph-mon[34909]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:08 smithi039 ceph-mon[30872]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:10.695 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:10 smithi173 ceph-mon[35294]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:10 smithi070 ceph-mon[34909]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:10 smithi039 ceph-mon[30872]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:12.725 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:12 smithi039 ceph-mon[30872]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:12.726 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:48:12.726 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:12.726 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:12 smithi039 ceph-mon[30872]: Deploying daemon osd.2 on smithi173 2024-09-10T21:48:12.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:12 smithi173 ceph-mon[35294]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:12.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:48:12.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:12.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:12 smithi173 ceph-mon[35294]: Deploying daemon osd.2 on smithi173 2024-09-10T21:48:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:12 smithi070 ceph-mon[34909]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:48:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:12.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:12 smithi070 ceph-mon[34909]: Deploying daemon osd.2 on smithi173 2024-09-10T21:48:14.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:14 smithi173 ceph-mon[35294]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:14 smithi070 ceph-mon[34909]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:14.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:14 smithi039 ceph-mon[30872]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:16.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:16 smithi173 ceph-mon[35294]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:16 smithi070 ceph-mon[34909]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:16.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:16 smithi039 ceph-mon[30872]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:18.724 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:18 smithi173 ceph-mon[35294]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:18.724 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:18.724 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:18.724 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:18.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:18 smithi070 ceph-mon[34909]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:18 smithi039 ceph-mon[30872]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:18.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:20 smithi173 ceph-mon[35294]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:20.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:20 smithi070 ceph-mon[34909]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:20 smithi039 ceph-mon[30872]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:21.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.741+0000 7fa894ff9640 1 -- 172.21.15.173:0/1639446224 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa898063650 con 0x7fa8800b5250 2024-09-10T21:48:21.742 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 msgr2=0x7fa8800b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 0x7fa8800b7710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa888009b50 tx=0x7fa888005f90 comp rx=0 tx=0).stop 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 msgr2=0x7fa89819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa88c031460 tx=0x7fa88c003c10 comp rx=0 tx=0).stop 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 shutdown_connections 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8800b5250 0x7fa8800b7710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa89819c500 0x7fa89819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa898104550 0x7fa89819b8c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:21.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 --2- 172.21.15.173:0/1639446224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa898102a30 0x7fa89819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:21.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 >> 172.21.15.173:0/1639446224 conn(0x7fa8980fe320 msgr2=0x7fa898104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:48:21.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 shutdown_connections 2024-09-10T21:48:21.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:48:21.744+0000 7fa89df2b640 1 -- 172.21.15.173:0/1639446224 wait complete. 2024-09-10T21:48:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:21.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:21.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:21.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:22.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:22.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:22.394 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T21:48:22.396 INFO:tasks.cephadm:Deploying osd.3 on smithi039 with /dev/vg_nvme/lv_3... 2024-09-10T21:48:22.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:48:22.661 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:48:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:22 smithi173 ceph-mon[35294]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:23.039 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:22 smithi039 ceph-mon[30872]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:23.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:22 smithi070 ceph-mon[34909]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:23.901 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:23 smithi039 ceph-mon[30872]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:23.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:23 smithi039 ceph-mon[30872]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:24.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:23 smithi070 ceph-mon[34909]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:24.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:23 smithi070 ceph-mon[34909]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:24.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:23 smithi173 ceph-mon[35294]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:24.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:23 smithi173 ceph-mon[35294]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:48:24.242 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T21:48:23.841+0000 7f01aa73a640 -1 osd.2 0 log_to_monitors true 2024-09-10T21:48:24.946 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:48:24.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2024-09-10T21:48:25.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:25.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:48:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:48:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:24 smithi070 ceph-mon[34909]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:24 smithi039 ceph-mon[30872]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.229 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:25.229 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:48:25.229 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:48:25.229 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: from='osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.229 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:25.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:24 smithi173 ceph-mon[35294]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:48:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:48:25.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.646+0000 7f73f6c49640 1 -- 172.21.15.39:0/68205036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f0105bc0 msgr2=0x7f73f0108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.646+0000 7f73f6c49640 1 --2- 172.21.15.39:0/68205036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f0105bc0 0x7f73f0108010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009900 tx=0x7f73dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.646+0000 7f73f6c49640 1 -- 172.21.15.39:0/68205036 shutdown_connections 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 --2- 172.21.15.39:0/68205036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0108750 0x7f73f010ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 --2- 172.21.15.39:0/68205036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f0105bc0 0x7f73f0108010 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 --2- 172.21.15.39:0/68205036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f006c060 0x7f73f0105680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 -- 172.21.15.39:0/68205036 >> 172.21.15.39:0/68205036 conn(0x7f73f00fd210 msgr2=0x7f73f00ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 -- 172.21.15.39:0/68205036 shutdown_connections 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 -- 172.21.15.39:0/68205036 wait complete. 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 Processor -- start 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 -- start start 2024-09-10T21:48:25.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.647+0000 7f73f6c49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 0x7f73f0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f6c49640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f6c49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f0108750 0x7f73f019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f6c49640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73f010e680 con 0x7f73f006c060 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f6c49640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73f010e500 con 0x7f73f0108750 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f6c49640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73f010e800 con 0x7f73f0105bc0 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:53448/0 (socket says 172.21.15.39:53448) 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 -- 172.21.15.39:0/3106331924 learned_addr learned my addr 172.21.15.39:0/3106331924 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f49e5640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 0x7f73f0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:25.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f51e6640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f0108750 0x7f73f019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 -- 172.21.15.39:0/3106331924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f0108750 msgr2=0x7f73f019a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f0108750 0x7f73f019a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 -- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 msgr2=0x7f73f0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 0x7f73f0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 -- 172.21.15.39:0/3106331924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f019a900 con 0x7f73f0105bc0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73f49e5640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 0x7f73f0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73effff640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73dc005940 tx=0x7f73dc004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.648+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc03f030 con 0x7f73f0105bc0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.649+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73dc003cb0 con 0x7f73f0105bc0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.649+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f019ab90 con 0x7f73f0105bc0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.649+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc035070 con 0x7f73f0105bc0 2024-09-10T21:48:25.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.649+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f01a1100 con 0x7f73f0105bc0 2024-09-10T21:48:25.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.650+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f00fed00 con 0x7f73f0105bc0 2024-09-10T21:48:25.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.651+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f73dc03b460 con 0x7f73f0105bc0 2024-09-10T21:48:25.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.652+0000 7f73edffb640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 0x7f73e00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:25.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.652+0000 7f73f49e5640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 0x7f73e00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:25.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.652+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f73dc1053b0 con 0x7f73f0105bc0 2024-09-10T21:48:25.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.652+0000 7f73f49e5640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 0x7f73e00b7710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73e40058c0 tx=0x7f73e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:25.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.655+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f73dc0cd920 con 0x7f73f0105bc0 2024-09-10T21:48:25.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:25.855+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f73f0063590 con 0x7f73e00b5250 2024-09-10T21:48:26.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='osd.2 ' entity='osd.2' 2024-09-10T21:48:26.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:26.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:26.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='osd.2 ' entity='osd.2' 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:26.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:26.242 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T21:48:25.810+0000 7f01a6ed1640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T21:48:26.242 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T21:48:26.000+0000 7f019e4dc640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:48:26.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:48:26.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:48:26.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:26.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='osd.2 ' entity='osd.2' 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:26.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:27.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:48:27.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:48:27.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi173 2024-09-10T21:48:27.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-10T21:48:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:48:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:48:27.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi173 2024-09-10T21:48:27.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-10T21:48:27.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:27.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:27.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi173 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:27.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:27 smithi173 ceph-mon[35294]: osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] boot 2024-09-10T21:48:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:27 smithi173 ceph-mon[35294]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T21:48:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:28.158 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52335]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.158 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52335]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.159 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:28.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:27 smithi039 ceph-mon[30872]: osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] boot 2024-09-10T21:48:28.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:27 smithi039 ceph-mon[30872]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T21:48:28.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:28.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:28.227 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:28.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:27 smithi070 ceph-mon[34909]: osd.2 [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] boot 2024-09-10T21:48:28.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:27 smithi070 ceph-mon[34909]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T21:48:28.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:48:28.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:28.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52335]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52340]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52340]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.423 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52340]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52349]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52349]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52349]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52352]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52352]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 sudo[52352]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.655 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43133]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43133]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43133]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43136]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43136]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.656 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43136]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43139]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43139]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43139]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43142]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43142]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 sudo[43142]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44377]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44377]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44380]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.742 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44380]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44383]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44386]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44386]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:48:28.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 sudo[44386]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:48:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"} : dispatch 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"}]': finished 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:28.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:28.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:28.926 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:28.926 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:28 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1553821011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:48:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"} : dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"}]': finished 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:28 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1553821011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"} : dispatch 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:48:29.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2050761215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e1d4a1d-b631-4b70-91f0-ac23984ab2c0"}]': finished 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:48:29.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:28 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1553821011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:30.281+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f73dc0c9490 con 0x7f73f0105bc0 2024-09-10T21:48:30.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:30 smithi070 ceph-mon[34909]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T21:48:30.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:30.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:30 smithi070 ceph-mon[34909]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:30.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:30 smithi039 ceph-mon[30872]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T21:48:30.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:30.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:30 smithi039 ceph-mon[30872]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:30.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:30 smithi173 ceph-mon[35294]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T21:48:30.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:30.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:30 smithi173 ceph-mon[35294]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:31.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:31 smithi070 ceph-mon[34909]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:48:31.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:31 smithi039 ceph-mon[30872]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:48:31.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:31 smithi173 ceph-mon[35294]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:48:32.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:32 smithi070 ceph-mon[34909]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:32.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:32 smithi039 ceph-mon[30872]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:32.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:32 smithi173 ceph-mon[35294]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:34.576 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:34 smithi039 ceph-mon[30872]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:34 smithi173 ceph-mon[35294]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:34 smithi070 ceph-mon[34909]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:36.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:36 smithi173 ceph-mon[35294]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:36.795 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:36 smithi070 ceph-mon[34909]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:36.813 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:36 smithi039 ceph-mon[30872]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:37 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:48:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:37 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:37.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:37 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:48:37.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:37 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:37.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:37 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:48:37.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:37 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:38 smithi173 ceph-mon[35294]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:38 smithi173 ceph-mon[35294]: Deploying daemon osd.3 on smithi039 2024-09-10T21:48:38.757 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:38 smithi039 ceph-mon[30872]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:38.757 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:38 smithi039 ceph-mon[30872]: Deploying daemon osd.3 on smithi039 2024-09-10T21:48:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:38 smithi070 ceph-mon[34909]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:38 smithi070 ceph-mon[34909]: Deploying daemon osd.3 on smithi039 2024-09-10T21:48:40.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:40 smithi173 ceph-mon[35294]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:40.762 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:40 smithi039 ceph-mon[30872]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:40.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:40 smithi070 ceph-mon[34909]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:42.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:42 smithi173 ceph-mon[35294]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:42.791 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:42 smithi039 ceph-mon[30872]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:42.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:42 smithi070 ceph-mon[34909]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:43.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:43.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:43.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:43.790 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:43.790 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:43.790 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:43.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:43.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:43.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:44.798 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:44 smithi039 ceph-mon[30872]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:44.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:44 smithi070 ceph-mon[34909]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:44 smithi173 ceph-mon[35294]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:47.092 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:47.092 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.092 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.092 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:47.093 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:47.093 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.091+0000 7f73edffb640 1 -- 172.21.15.39:0/3106331924 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f73f0063590 con 0x7f73e00b5250 2024-09-10T21:48:47.093 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 3 on host 'smithi039' 2024-09-10T21:48:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 msgr2=0x7f73e00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 0x7f73e00b7710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73e40058c0 tx=0x7f73e400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 msgr2=0x7f73f0199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73dc005940 tx=0x7f73dc004430 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 shutdown_connections 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73e00b5250 0x7f73e00b7710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f0108750 0x7f73f019a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73f0105bc0 0x7f73f0199420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 --2- 172.21.15.39:0/3106331924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73f006c060 0x7f73f0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 >> 172.21.15.39:0/3106331924 conn(0x7f73f00fd210 msgr2=0x7f73f0103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 shutdown_connections 2024-09-10T21:48:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:48:47.094+0000 7f73f6c49640 1 -- 172.21.15.39:0/3106331924 wait complete. 2024-09-10T21:48:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:47.721 DEBUG:teuthology.orchestra.run.smithi039:osd.3> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T21:48:47.724 INFO:tasks.cephadm:Deploying osd.4 on smithi070 with /dev/vg_nvme/lv_3... 2024-09-10T21:48:47.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:48:47.978 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:48:48.002 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:48.003 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.003 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:47 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.098 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:48.098 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.098 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:47 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:48:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:47 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:48.967 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 21:48:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T21:48:48.935+0000 7f2e0b540640 -1 osd.3 0 log_to_monitors true 2024-09-10T21:48:49.353 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:49 smithi070 ceph-mon[34909]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:49.353 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:49 smithi070 ceph-mon[34909]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:48:49.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:49 smithi039 ceph-mon[30872]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:49.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:49 smithi039 ceph-mon[30872]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:48:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:49 smithi173 ceph-mon[35294]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:49 smithi173 ceph-mon[35294]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:48:50.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-mon[30872]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:48:50.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-mon[30872]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:48:50.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-mon[30872]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:48:50.307 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:50.307 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T21:48:50.104+0000 7f2e074c3640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T21:48:50.307 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 21:48:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T21:48:50.113+0000 7f2e032ea640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:48:50.402 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:50 smithi070 ceph-mon[34909]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:48:50.402 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:50 smithi070 ceph-mon[34909]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:48:50.402 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:50 smithi070 ceph-mon[34909]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:48:50.402 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:50 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:50.405 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:48:50.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-09-10T21:48:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:50 smithi173 ceph-mon[35294]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:48:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:50 smithi173 ceph-mon[35294]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:48:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:50 smithi173 ceph-mon[35294]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:48:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:50 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:48:51.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 -- 172.21.15.70:0/2037170132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 msgr2=0x7f5390102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:51.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 --2- 172.21.15.70:0/2037170132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f5390102ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5378009930 tx=0x7f537802a420 comp rx=0 tx=0).stop 2024-09-10T21:48:51.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 -- 172.21.15.70:0/2037170132 shutdown_connections 2024-09-10T21:48:51.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 --2- 172.21.15.70:0/2037170132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390103430 0x7f5390109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:51.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 --2- 172.21.15.70:0/2037170132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f5390102ef0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 --2- 172.21.15.70:0/2037170132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390101910 0x7f5390101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 -- 172.21.15.70:0/2037170132 >> 172.21.15.70:0/2037170132 conn(0x7f53900fd1e0 msgr2=0x7f53900ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 -- 172.21.15.70:0/2037170132 shutdown_connections 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 -- 172.21.15.70:0/2037170132 wait complete. 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.173+0000 7f539558d640 1 Processor -- start 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 -- start start 2024-09-10T21:48:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 0x7f539006b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 0x7f53901a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f539010d590 con 0x7f5390103430 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f539010d410 con 0x7f5390102a70 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f539558d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f539010d710 con 0x7f5390101910 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50212/0 (socket says 172.21.15.70:50212) 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 -- 172.21.15.70:0/1644805838 learned_addr learned my addr 172.21.15.70:0/1644805838 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538f7fe640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 0x7f53901a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538effd640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 0x7f539006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 -- 172.21.15.70:0/1644805838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 msgr2=0x7f539006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 0x7f539006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 -- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 msgr2=0x7f53901a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 0x7f53901a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:48:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 -- 172.21.15.70:0/1644805838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53901a2b60 con 0x7f5390102a70 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538f7fe640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 0x7f53901a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538effd640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 0x7f539006b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.174+0000 7f538e7fc640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5378005ec0 tx=0x7f5378004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.175+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537803f030 con 0x7f5390102a70 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.175+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5378003cb0 con 0x7f5390102a70 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.175+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53901a2df0 con 0x7f5390102a70 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.175+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378035070 con 0x7f5390102a70 2024-09-10T21:48:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.175+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901a3270 con 0x7f5390102a70 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.176+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5390108c30 con 0x7f5390102a70 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.177+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f537804c060 con 0x7f5390102a70 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.178+0000 7f5387fff640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 0x7f537c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.178+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f5378104e50 con 0x7f5390102a70 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.178+0000 7f538effd640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 0x7f537c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.178+0000 7f538effd640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 0x7f537c0b77a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f538800baa0 tx=0x7f5388005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:48:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.182+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53780ccf10 con 0x7f5390102a70 2024-09-10T21:48:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:48:51.376+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5390063590 con 0x7f537c0b52e0 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.377 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:51.378 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:48:51.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:48:52.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:48:52.394 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi039 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] boot 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:52.395 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:52 smithi173 ceph-mon[35294]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi039 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] boot 2024-09-10T21:48:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:52 smithi070 ceph-mon[34909]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi039 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: osd.3 [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] boot 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T21:48:52.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:48:52.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:48:52.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:48:52.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:48:52.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:52 smithi039 ceph-mon[30872]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:48:53.376 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:53 smithi070 ceph-mon[34909]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:48:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:53 smithi039 ceph-mon[30872]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:48:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:53 smithi173 ceph-mon[35294]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/2699280336' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"}]': finished 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T21:48:54.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:48:54.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:54.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/2699280336' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"}]': finished 2024-09-10T21:48:54.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T21:48:54.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/2699280336' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"} : dispatch 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28463f55-3ef4-40b9-8ee0-2ce24d86681e"}]': finished 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T21:48:54.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:48:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:55 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/2921128901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:55.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:55 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/2921128901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:55.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:55 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/2921128901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:48:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:56 smithi173 ceph-mon[35294]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:56.557 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:56 smithi070 ceph-mon[34909]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:56.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:56 smithi039 ceph-mon[30872]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:48:58.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:48:58 smithi173 ceph-mon[35294]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:48:58.852 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:48:58 smithi070 ceph-mon[34909]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:48:58.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:48:58 smithi039 ceph-mon[30872]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:49:00.567 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:00 smithi070 ceph-mon[34909]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:00.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:00 smithi173 ceph-mon[35294]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:00 smithi039 ceph-mon[30872]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:02 smithi173 ceph-mon[35294]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:49:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:49:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:02.757 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:02 smithi070 ceph-mon[34909]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:49:02.757 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:49:02.757 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:02 smithi039 ceph-mon[30872]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:49:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:49:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:03.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:03 smithi173 ceph-mon[35294]: Deploying daemon osd.4 on smithi070 2024-09-10T21:49:03.773 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:03 smithi070 ceph-mon[34909]: Deploying daemon osd.4 on smithi070 2024-09-10T21:49:03.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:03 smithi039 ceph-mon[30872]: Deploying daemon osd.4 on smithi070 2024-09-10T21:49:04.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:04 smithi173 ceph-mon[35294]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:49:04.803 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:04 smithi070 ceph-mon[34909]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:49:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:04 smithi039 ceph-mon[30872]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:49:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:06 smithi173 ceph-mon[35294]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T21:49:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:06 smithi070 ceph-mon[34909]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T21:49:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:06 smithi039 ceph-mon[30872]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T21:49:08.869 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:08 smithi070 ceph-mon[34909]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:49:08.869 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:08.869 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:08.869 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:08 smithi039 ceph-mon[30872]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:49:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:08 smithi173 ceph-mon[35294]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:49:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:10.582 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:10 smithi070 ceph-mon[34909]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:10 smithi039 ceph-mon[30872]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:10.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:10 smithi173 ceph-mon[35294]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:12 smithi173 ceph-mon[35294]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:12.513 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.513 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.514 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:12.514 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:12.514 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.514 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:12 smithi070 ceph-mon[34909]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:12.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.555+0000 7f5387fff640 1 -- 172.21.15.70:0/1644805838 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5390063590 con 0x7f537c0b52e0 2024-09-10T21:49:12.557 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 4 on host 'smithi070' 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 msgr2=0x7f537c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 0x7f537c0b77a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f538800baa0 tx=0x7f5388005d90 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 msgr2=0x7f539019fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5378005ec0 tx=0x7f5378004360 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 shutdown_connections 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f537c0b52e0 0x7f537c0b77a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5390103430 0x7f53901a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5390102a70 0x7f539019fe90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 --2- 172.21.15.70:0/1644805838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5390101910 0x7f539006b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 >> 172.21.15.70:0/1644805838 conn(0x7f53900fd1e0 msgr2=0x7f5390105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 shutdown_connections 2024-09-10T21:49:12.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:49:12.558+0000 7f539558d640 1 -- 172.21.15.70:0/1644805838 wait complete. 2024-09-10T21:49:12.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:12.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:12.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:12.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:12 smithi039 ceph-mon[30872]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:13.152 DEBUG:teuthology.orchestra.run.smithi070:osd.4> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T21:49:13.154 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2024-09-10T21:49:13.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:49:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:13 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:13.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:13 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:13.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:13 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:13.410 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:49:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:13 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:13 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:13 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:13.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:13 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:13.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:13 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:13.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:13 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:14.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:14 smithi173 ceph-mon[35294]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:14.499 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:14 smithi070 ceph-mon[34909]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:14.499 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 21:49:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T21:49:14.256+0000 7f76da89c640 -1 osd.4 0 log_to_monitors true 2024-09-10T21:49:14.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:14 smithi039 ceph-mon[30872]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:15.476 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:15 smithi173 ceph-mon[35294]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.476 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:15 smithi173 ceph-mon[35294]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.645 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:15 smithi070 ceph-mon[34909]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.645 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:15 smithi070 ceph-mon[34909]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:15 smithi039 ceph-mon[30872]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:15 smithi039 ceph-mon[30872]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:49:15.975 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:49:16.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-09-10T21:49:16.253 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:49:16.373 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi070 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:16.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:16.375 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:16 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.655 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T21:49:16.228+0000 7f76d681f640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T21:49:16.655 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T21:49:16.233+0000 7f76d2646640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi070 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-10T21:49:16.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:16.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:16.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:16 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:16.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi070 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:16.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:16 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 -- 172.21.15.173:0/3685992698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 msgr2=0x7fadb8104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/3685992698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8104010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fada40098c0 tx=0x7fada402a390 comp rx=0 tx=0).stop 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 -- 172.21.15.173:0/3685992698 shutdown_connections 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/3685992698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 0x7fadb810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/3685992698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8104010 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:16.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/3685992698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 0x7fadb8102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 -- 172.21.15.173:0/3685992698 >> 172.21.15.173:0/3685992698 conn(0x7fadb80fe320 msgr2=0x7fadb8100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 -- 172.21.15.173:0/3685992698 shutdown_connections 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.790+0000 7fadbf0c5640 1 -- 172.21.15.173:0/3685992698 wait complete. 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 Processor -- start 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 -- start start 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 0x7fadb8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 0x7fadb819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fadb810e6b0 con 0x7fadb8102a30 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fadb810e530 con 0x7fadb8104550 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbf0c5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fadb810e830 con 0x7fadb8103b90 2024-09-10T21:49:16.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38584/0 (socket says 172.21.15.173:38584) 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 -- 172.21.15.173:0/2391364655 learned_addr learned my addr 172.21.15.173:0/2391364655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbd662640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 0x7fadb819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadbce61640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 0x7fadb8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 -- 172.21.15.173:0/2391364655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 msgr2=0x7fadb819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 0x7fadb819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 -- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 msgr2=0x7fadb8198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 0x7fadb8198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.791+0000 7fadb7fff640 1 -- 172.21.15.173:0/2391364655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb819a930 con 0x7fadb8103b90 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadb7fff640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fada4009890 tx=0x7fada4030800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4040020 con 0x7fadb8103b90 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fada4038040 con 0x7fadb8103b90 2024-09-10T21:49:16.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb819abc0 con 0x7fadb8103b90 2024-09-10T21:49:16.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4037070 con 0x7fadb8103b90 2024-09-10T21:49:16.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.792+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb81a1300 con 0x7fadb8103b90 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.793+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8102e30 con 0x7fadb8103b90 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.794+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fada4005050 con 0x7fadb8103b90 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.795+0000 7fadb5ffb640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 0x7fada80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.795+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3821+0+0 (secure 0 0 0) 0x7fada4104be0 con 0x7fadb8103b90 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.795+0000 7fadbce61640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 0x7fada80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:16.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.796+0000 7fadbce61640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 0x7fada80b7820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fadac005fd0 tx=0x7fadac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:49:16.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.799+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fada404a070 con 0x7fadb8103b90 2024-09-10T21:49:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:16.986+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fadb8063590 con 0x7fada80b5360 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:17 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:17.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:49:17.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:17.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:17 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:17.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:17 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:49:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:49:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] boot 2024-09-10T21:49:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T21:49:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:18.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:18 smithi173 ceph-mon[35294]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:18.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:49:18.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:49:18.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] boot 2024-09-10T21:49:18.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T21:49:18.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:18.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:18 smithi070 ceph-mon[34909]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: osd.4 [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] boot 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:49:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:18 smithi039 ceph-mon[30872]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:49:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:19 smithi173 ceph-mon[35294]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:49:19.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:19 smithi070 ceph-mon[34909]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:49:19.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:19 smithi039 ceph-mon[30872]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:49:20.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/794499909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"}]': finished 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:20.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:20 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/2499985662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/794499909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"}]': finished 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:20.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:20 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/2499985662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/794499909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"} : dispatch 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b164260c-3662-492f-82c1-9514e6eaddc3"}]': finished 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:20.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:20 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/2499985662' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:22.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:22 smithi039 ceph-mon[30872]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:22.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:22 smithi173 ceph-mon[35294]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:22.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:22 smithi070 ceph-mon[34909]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:24.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:24 smithi173 ceph-mon[35294]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:24.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:24 smithi070 ceph-mon[34909]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:24.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:24 smithi039 ceph-mon[30872]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:26.707 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:26 smithi070 ceph-mon[34909]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:26.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:26 smithi173 ceph-mon[35294]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:26.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:26 smithi039 ceph-mon[30872]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:28.738 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:28 smithi173 ceph-mon[35294]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:28.738 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:49:28.738 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:28.739 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:28 smithi173 ceph-mon[35294]: Deploying daemon osd.5 on smithi173 2024-09-10T21:49:28.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:28 smithi070 ceph-mon[34909]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:28.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:49:28.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:28.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:28 smithi070 ceph-mon[34909]: Deploying daemon osd.5 on smithi173 2024-09-10T21:49:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:28 smithi039 ceph-mon[30872]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:49:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:28 smithi039 ceph-mon[30872]: Deploying daemon osd.5 on smithi173 2024-09-10T21:49:30.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:30 smithi173 ceph-mon[35294]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:30.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:30 smithi070 ceph-mon[34909]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:30.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:30 smithi039 ceph-mon[30872]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:32.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:32 smithi173 ceph-mon[35294]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:32.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:32 smithi070 ceph-mon[34909]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:32 smithi039 ceph-mon[30872]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:34 smithi173 ceph-mon[35294]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:34 smithi070 ceph-mon[34909]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:34 smithi039 ceph-mon[30872]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:36.553 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:36 smithi173 ceph-mon[35294]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:36.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:36 smithi070 ceph-mon[34909]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:36.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:36 smithi039 ceph-mon[30872]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:38.350 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.350 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.350 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:38.350 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:38.350 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.390+0000 7fadb5ffb640 1 -- 172.21.15.173:0/2391364655 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fadb8063590 con 0x7fada80b5360 2024-09-10T21:49:38.391 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-09-10T21:49:38.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.392+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 msgr2=0x7fada80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 0x7fada80b7820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fadac005fd0 tx=0x7fadac009260 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 msgr2=0x7fadb8199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fada4009890 tx=0x7fada4030800 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 shutdown_connections 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fada80b5360 0x7fada80b7820 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadb8104550 0x7fadb819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadb8103b90 0x7fadb8199450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 --2- 172.21.15.173:0/2391364655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadb8102a30 0x7fadb8198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 >> 172.21.15.173:0/2391364655 conn(0x7fadb80fe320 msgr2=0x7fadb8106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 shutdown_connections 2024-09-10T21:49:38.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:49:38.393+0000 7fadbf0c5640 1 -- 172.21.15.173:0/2391364655 wait complete. 2024-09-10T21:49:38.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:38.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:38.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.030 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T21:49:39.032 INFO:tasks.cephadm:Deploying osd.6 on smithi039 with /dev/vg_nvme/lv_2... 2024-09-10T21:49:39.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:49:39.279 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:39 smithi173 ceph-mon[35294]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:39.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:39.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:39 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.302 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:49:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:39 smithi070 ceph-mon[34909]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:39.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:39 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:39 smithi039 ceph-mon[30872]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:49:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:39 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:40.389 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 21:49:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T21:49:40.130+0000 7f34e5722640 -1 osd.5 0 log_to_monitors true 2024-09-10T21:49:41.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:41 smithi039 ceph-mon[30872]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:41.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:41 smithi039 ceph-mon[30872]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:41 smithi039 ceph-mon[30872]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:41 smithi070 ceph-mon[34909]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:41 smithi070 ceph-mon[34909]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:41 smithi070 ceph-mon[34909]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:41 smithi173 ceph-mon[35294]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:41.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:41 smithi173 ceph-mon[35294]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:41 smithi173 ceph-mon[35294]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:49:41.765 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:49:41.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2024-09-10T21:49:42.054 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:49:42.242 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T21:49:42.136+0000 7f34e16a5640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T21:49:42.242 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T21:49:42.143+0000 7f34dd4cc640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:42.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi173 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:42.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi173 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:49:42.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi173 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:49:42.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:49:42.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 -- 172.21.15.39:0/334326150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504104570 msgr2=0x7f450410aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:42.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 --2- 172.21.15.39:0/334326150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504104570 0x7f450410aef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009930 tx=0x7f44fc02a420 comp rx=0 tx=0).stop 2024-09-10T21:49:42.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 -- 172.21.15.39:0/334326150 shutdown_connections 2024-09-10T21:49:42.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 --2- 172.21.15.39:0/334326150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504104570 0x7f450410aef0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:42.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 --2- 172.21.15.39:0/334326150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504103bb0 0x7f4504104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 --2- 172.21.15.39:0/334326150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4504102a50 0x7f4504102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 -- 172.21.15.39:0/334326150 >> 172.21.15.39:0/334326150 conn(0x7f45040fe320 msgr2=0x7f4504100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 -- 172.21.15.39:0/334326150 shutdown_connections 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.492+0000 7f450b45e640 1 -- 172.21.15.39:0/334326150 wait complete. 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 Processor -- start 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 -- start start 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 0x7f4504198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4504104570 0x7f4504199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f450410e6b0 con 0x7f4504103bb0 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f450410e530 con 0x7f4504104570 2024-09-10T21:49:42.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f450b45e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f450410e830 con 0x7f4504102a50 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:32830/0 (socket says 172.21.15.39:32830) 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 -- 172.21.15.39:0/1622086911 learned_addr learned my addr 172.21.15.39:0/1622086911 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45091fa640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 0x7f4504198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 -- 172.21.15.39:0/1622086911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 msgr2=0x7f4504198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 0x7f4504198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 -- 172.21.15.39:0/1622086911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4504104570 msgr2=0x7f4504199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4504104570 0x7f4504199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45089f9640 1 -- 172.21.15.39:0/1622086911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450419a850 con 0x7f4504103bb0 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.493+0000 7f45091fa640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 0x7f4504198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:49:42.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f45089f9640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44f400d950 tx=0x7f44f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4017030 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450419ab40 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f4004020 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40047a0 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.494+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041a1220 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.495+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4504109d70 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.496+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f44f4009a30 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.497+0000 7f44fa7fc640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 0x7f44f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.497+0000 7f45091fa640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 0x7f44f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.498+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4253+0+0 (secure 0 0 0) 0x7f44f40e4d70 con 0x7f4504103bb0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.498+0000 7f45091fa640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 0x7f44f00b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4500005fd0 tx=0x7f45000093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:49:42.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.501+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f44f40acc10 con 0x7f4504103bb0 2024-09-10T21:49:42.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:49:42.694+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4504063590 con 0x7f44f00b52e0 2024-09-10T21:49:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:49:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:49:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:49:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:44.208 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:49:44.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:49:44.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] boot 2024-09-10T21:49:44.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T21:49:44.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:44.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:44 smithi039 ceph-mon[30872]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:49:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:49:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] boot 2024-09-10T21:49:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T21:49:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:44 smithi070 ceph-mon[34909]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: osd.5 [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] boot 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:49:44.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:44 smithi173 ceph-mon[35294]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:45.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:45 smithi070 ceph-mon[34909]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:49:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"} : dispatch 2024-09-10T21:49:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"}]': finished 2024-09-10T21:49:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:45 smithi070 ceph-mon[34909]: osdmap e36: 7 total, 6 up, 7 in 2024-09-10T21:49:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:49:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:45 smithi039 ceph-mon[30872]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:49:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"} : dispatch 2024-09-10T21:49:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"}]': finished 2024-09-10T21:49:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:45 smithi039 ceph-mon[30872]: osdmap e36: 7 total, 6 up, 7 in 2024-09-10T21:49:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:49:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:45 smithi173 ceph-mon[35294]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:49:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"} : dispatch 2024-09-10T21:49:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3309094247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2699e689-3038-4851-b19e-c1d2db643248"}]': finished 2024-09-10T21:49:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:45 smithi173 ceph-mon[35294]: osdmap e36: 7 total, 6 up, 7 in 2024-09-10T21:49:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:49:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:46 smithi070 ceph-mon[34909]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/411856791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:46 smithi039 ceph-mon[30872]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/411856791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:46 smithi173 ceph-mon[35294]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:49:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/411856791' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:49:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:48 smithi070 ceph-mon[34909]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T21:49:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:48 smithi039 ceph-mon[30872]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T21:49:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:48 smithi173 ceph-mon[35294]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T21:49:50.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:50 smithi070 ceph-mon[34909]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:49:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:50 smithi039 ceph-mon[30872]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:49:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:50 smithi173 ceph-mon[35294]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:49:52.635 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:52 smithi039 ceph-mon[30872]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:52.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:52 smithi070 ceph-mon[34909]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:52 smithi173 ceph-mon[35294]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:49:54.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:54 smithi070 ceph-mon[34909]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:49:54.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:49:54.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:54 smithi039 ceph-mon[30872]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:49:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:49:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:54 smithi173 ceph-mon[35294]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:49:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:49:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:49:55.813 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:55 smithi039 ceph-mon[30872]: Deploying daemon osd.6 on smithi039 2024-09-10T21:49:55.893 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:55 smithi173 ceph-mon[35294]: Deploying daemon osd.6 on smithi039 2024-09-10T21:49:55.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:55 smithi070 ceph-mon[34909]: Deploying daemon osd.6 on smithi039 2024-09-10T21:49:56.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:56 smithi039 ceph-mon[30872]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T21:49:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:56 smithi070 ceph-mon[34909]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T21:49:56.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:56 smithi173 ceph-mon[35294]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T21:49:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:49:58 smithi070 ceph-mon[34909]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:49:58.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:49:58 smithi039 ceph-mon[30872]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:49:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:49:58 smithi173 ceph-mon[35294]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:50:00.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:00 smithi039 ceph-mon[30872]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:00.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:00 smithi039 ceph-mon[30872]: overall HEALTH_OK 2024-09-10T21:50:00.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:00.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:00.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:00 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:00 smithi070 ceph-mon[34909]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:00 smithi070 ceph-mon[34909]: overall HEALTH_OK 2024-09-10T21:50:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:00.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:00.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:00 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:00 smithi173 ceph-mon[35294]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:00 smithi173 ceph-mon[35294]: overall HEALTH_OK 2024-09-10T21:50:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:00 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:02 smithi070 ceph-mon[34909]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:02 smithi039 ceph-mon[30872]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:02.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:02 smithi173 ceph-mon[35294]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:03.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.599+0000 7f44fa7fc640 1 -- 172.21.15.39:0/1622086911 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4504063590 con 0x7f44f00b52e0 2024-09-10T21:50:03.601 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 6 on host 'smithi039' 2024-09-10T21:50:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.602+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 msgr2=0x7f44f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.602+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 0x7f44f00b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4500005fd0 tx=0x7f45000093e0 comp rx=0 tx=0).stop 2024-09-10T21:50:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.602+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 msgr2=0x7f4504199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.602+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44f400d950 tx=0x7f44f400de10 comp rx=0 tx=0).stop 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 shutdown_connections 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44f00b52e0 0x7f44f00b77a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4504104570 0x7f4504199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4504103bb0 0x7f4504199370 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 --2- 172.21.15.39:0/1622086911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4504102a50 0x7f4504198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 >> 172.21.15.39:0/1622086911 conn(0x7f45040fe320 msgr2=0x7f4504106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 shutdown_connections 2024-09-10T21:50:03.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:03.603+0000 7f450b45e640 1 -- 172.21.15.39:0/1622086911 wait complete. 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.157 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.197 DEBUG:teuthology.orchestra.run.smithi039:osd.6> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T21:50:04.200 INFO:tasks.cephadm:Deploying osd.7 on smithi070 with /dev/vg_nvme/lv_2... 2024-09-10T21:50:04.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:50:04.227 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.227 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.228 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:50:05.138 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:04 smithi039 ceph-mon[30872]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:05.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:04 smithi070 ceph-mon[34909]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:05.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:04 smithi173 ceph-mon[35294]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:06.423 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T21:50:06.334+0000 7fbcf740d640 -1 osd.6 0 log_to_monitors true 2024-09-10T21:50:07.107 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:50:07.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:07.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.420 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:07.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:07.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:07.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 -- 172.21.15.70:0/1471421756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac101950 msgr2=0x7f98ac101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/1471421756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac101950 0x7f98ac101d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f989c009930 tx=0x7f989c02a420 comp rx=0 tx=0).stop 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 -- 172.21.15.70:0/1471421756 shutdown_connections 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/1471421756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac103470 0x7f98ac109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/1471421756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac102ab0 0x7f98ac102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/1471421756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac101950 0x7f98ac101d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 -- 172.21.15.70:0/1471421756 >> 172.21.15.70:0/1471421756 conn(0x7f98ac0fd200 msgr2=0x7f98ac0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 -- 172.21.15.70:0/1471421756 shutdown_connections 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.837+0000 7f98b1b0d640 1 -- 172.21.15.70:0/1471421756 wait complete. 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 Processor -- start 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 -- start start 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac101950 0x7f98ac198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac102ab0 0x7f98ac1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac10d6b0 con 0x7f98ac101950 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac10d530 con 0x7f98ac103470 2024-09-10T21:50:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98b1b0d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac10d830 con 0x7f98ac102ab0 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50450/0 (socket says 172.21.15.70:50450) 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.838+0000 7f98abfff640 1 -- 172.21.15.70:0/486863904 learned_addr learned my addr 172.21.15.70:0/486863904 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98ab7fe640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac101950 0x7f98ac198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98aaffd640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac102ab0 0x7f98ac1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 -- 172.21.15.70:0/486863904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac102ab0 msgr2=0x7f98ac1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac102ab0 0x7f98ac1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 -- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac101950 msgr2=0x7f98ac198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac101950 0x7f98ac198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 -- 172.21.15.70:0/486863904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac19aa60 con 0x7f98ac103470 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98abfff640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98a400b970 tx=0x7f98a400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4019070 con 0x7f98ac103470 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac19ad50 con 0x7f98ac103470 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98a4014440 con 0x7f98ac103470 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a40075b0 con 0x7f98ac103470 2024-09-10T21:50:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.839+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac1a1430 con 0x7f98ac103470 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.840+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ac1a16c0 con 0x7f98ac103470 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.842+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f98a400cb40 con 0x7f98ac103470 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.842+0000 7f98a8ff9640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 0x7f98940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.843+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4669+0+0 (secure 0 0 0) 0x7f98a40e44e0 con 0x7f98ac103470 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.843+0000 7f98ab7fe640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 0x7f98940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.843+0000 7f98ab7fe640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 0x7f98940b77a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f989c009900 tx=0x7f989c031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:07.846+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98a40abb90 con 0x7f98ac103470 2024-09-10T21:50:08.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:08.032+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f98ac0ff3c0 con 0x7f98940b52e0 2024-09-10T21:50:08.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi039 2024-09-10T21:50:08.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:50:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi039 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:50:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi039 2024-09-10T21:50:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-10T21:50:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:50:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T21:50:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:50:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:50:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:50:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.112 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' 2024-09-10T21:50:09.113 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.173 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T21:50:08.760+0000 7fbcf3390640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T21:50:09.173 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T21:50:08.820+0000 7fbceb1af640 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:50:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' 2024-09-10T21:50:09.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614]' entity='osd.6' 2024-09-10T21:50:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:09 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:50:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:09 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:50:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:09 smithi070 ceph-mon[34909]: osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] boot 2024-09-10T21:50:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:09 smithi070 ceph-mon[34909]: osdmap e39: 7 total, 7 up, 7 in 2024-09-10T21:50:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:09 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:50:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:09 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:50:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:09 smithi173 ceph-mon[35294]: osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] boot 2024-09-10T21:50:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:09 smithi173 ceph-mon[35294]: osdmap e39: 7 total, 7 up, 7 in 2024-09-10T21:50:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:10.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:09 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:50:10.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:09 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:50:10.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:09 smithi039 ceph-mon[30872]: osd.6 [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] boot 2024-09-10T21:50:10.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:09 smithi039 ceph-mon[30872]: osdmap e39: 7 total, 7 up, 7 in 2024-09-10T21:50:10.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/2104033596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"}]': finished 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: osdmap e40: 8 total, 7 up, 8 in 2024-09-10T21:50:11.140 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/2104033596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"}]': finished 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: osdmap e40: 8 total, 7 up, 8 in 2024-09-10T21:50:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/2104033596' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"} : dispatch 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76"}]': finished 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: osdmap e40: 8 total, 7 up, 8 in 2024-09-10T21:50:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:12.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:11 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/3875379428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:12.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:11 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/3875379428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:12.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:11 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/3875379428' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:13.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:12 smithi173 ceph-mon[35294]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:12 smithi070 ceph-mon[34909]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:13.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:12 smithi039 ceph-mon[30872]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:15.345 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:14 smithi070 ceph-mon[34909]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:15.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:14 smithi039 ceph-mon[30872]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:14 smithi173 ceph-mon[35294]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:17.315 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:16 smithi070 ceph-mon[34909]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:16 smithi039 ceph-mon[30872]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:16 smithi173 ceph-mon[35294]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:19 smithi070 ceph-mon[34909]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:19 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:50:19.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:19 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:19 smithi039 ceph-mon[30872]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:19 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:50:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:19 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:19 smithi173 ceph-mon[35294]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:19 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:50:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:19 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:20.257 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:20 smithi070 ceph-mon[34909]: Deploying daemon osd.7 on smithi070 2024-09-10T21:50:20.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:20 smithi039 ceph-mon[30872]: Deploying daemon osd.7 on smithi070 2024-09-10T21:50:20.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:20 smithi173 ceph-mon[35294]: Deploying daemon osd.7 on smithi070 2024-09-10T21:50:21.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:21 smithi070 ceph-mon[34909]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:21 smithi039 ceph-mon[30872]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:21 smithi173 ceph-mon[35294]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:23.321 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:23 smithi070 ceph-mon[34909]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:23 smithi039 ceph-mon[30872]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:23 smithi173 ceph-mon[35294]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:25.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:25 smithi173 ceph-mon[35294]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:25.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:25.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:25.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:25 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:25 smithi070 ceph-mon[34909]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:25 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:25.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:25 smithi039 ceph-mon[30872]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:25.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:25.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:25.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:25 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:27.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:27 smithi070 ceph-mon[34909]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:27.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:27 smithi039 ceph-mon[30872]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:27.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:27 smithi173 ceph-mon[35294]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:27.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.990+0000 7f98a8ff9640 1 -- 172.21.15.70:0/486863904 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98ac0ff3c0 con 0x7f98940b52e0 2024-09-10T21:50:27.993 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 7 on host 'smithi070' 2024-09-10T21:50:27.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.992+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 msgr2=0x7f98940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:27.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.992+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 0x7f98940b77a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f989c009900 tx=0x7f989c031430 comp rx=0 tx=0).stop 2024-09-10T21:50:27.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.992+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 msgr2=0x7f98ac19a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.992+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98a400b970 tx=0x7f98a400be30 comp rx=0 tx=0).stop 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 shutdown_connections 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98940b52e0 0x7f98940b77a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ac103470 0x7f98ac19a1c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ac102ab0 0x7f98ac1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 --2- 172.21.15.70:0/486863904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98ac101950 0x7f98ac198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 >> 172.21.15.70:0/486863904 conn(0x7f98ac0fd200 msgr2=0x7f98ac0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 shutdown_connections 2024-09-10T21:50:27.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:50:27.993+0000 7f98b1b0d640 1 -- 172.21.15.70:0/486863904 wait complete. 2024-09-10T21:50:28.362 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.362 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.362 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:28.362 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:28.363 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.363 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:28.363 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.363 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:28 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:28 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:28 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:28.701 DEBUG:teuthology.orchestra.run.smithi070:osd.7> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T21:50:28.704 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2024-09-10T21:50:28.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:50:28.960 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:50:29.308 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:29 smithi173 ceph-mon[35294]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:29.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:29 smithi070 ceph-mon[34909]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:29.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:29 smithi039 ceph-mon[30872]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:30.057 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 21:50:30 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T21:50:30.020+0000 7fb445216640 -1 osd.7 0 log_to_monitors true 2024-09-10T21:50:30.317 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:30 smithi173 ceph-mon[35294]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:30.318 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:30 smithi173 ceph-mon[35294]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:30.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:30 smithi070 ceph-mon[34909]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:30.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:30 smithi070 ceph-mon[34909]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:30.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:30 smithi039 ceph-mon[30872]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:30.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:30 smithi039 ceph-mon[30872]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:50:31.343 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:31.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:50:31.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: osdmap e41: 8 total, 7 up, 8 in 2024-09-10T21:50:31.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:31.344 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:31 smithi173 ceph-mon[35294]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.346 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:50:31.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-09-10T21:50:31.400 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T21:50:31.068+0000 7fb441199640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T21:50:31.401 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T21:50:31.076+0000 7fb43cfc0640 -1 osd.7 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: osdmap e41: 8 total, 7 up, 8 in 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:31.401 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:31 smithi070 ceph-mon[34909]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: from='osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: osdmap e41: 8 total, 7 up, 8 in 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:31 smithi039 ceph-mon[30872]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:50:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 -- 172.21.15.173:0/3270165279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028104560 msgr2=0x7f602810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 --2- 172.21.15.173:0/3270165279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028104560 0x7f602810aee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6020009d00 tx=0x7f602002a910 comp rx=0 tx=0).stop 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 -- 172.21.15.173:0/3270165279 shutdown_connections 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 --2- 172.21.15.173:0/3270165279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028104560 0x7f602810aee0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 --2- 172.21.15.173:0/3270165279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 0x7f6028104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 --2- 172.21.15.173:0/3270165279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028102a40 0x7f6028102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:32.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 -- 172.21.15.173:0/3270165279 >> 172.21.15.173:0/3270165279 conn(0x7f60280fe2f0 msgr2=0x7f6028100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 -- 172.21.15.173:0/3270165279 shutdown_connections 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.095+0000 7f602d281640 1 -- 172.21.15.173:0/3270165279 wait complete. 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 Processor -- start 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 -- start start 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 0x7f6028199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 0x7f602819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f602810e6a0 con 0x7f6028104560 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f602810e520 con 0x7f6028103ba0 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.096+0000 7f602d281640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f602810e820 con 0x7f6028102a40 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47380/0 (socket says 172.21.15.173:47380) 2024-09-10T21:50:32.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 -- 172.21.15.173:0/2582438985 learned_addr learned my addr 172.21.15.173:0/2582438985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f601e7fc640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 0x7f6028199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f60277fe640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 0x7f602819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 -- 172.21.15.173:0/2582438985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 msgr2=0x7f6028199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 0x7f6028199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 -- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 msgr2=0x7f602819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 0x7f602819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 -- 172.21.15.173:0/2582438985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602819a940 con 0x7f6028102a40 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f60277fe640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 0x7f602819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6026ffd640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f601800c890 tx=0x7f601800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018004220 con 0x7f6028102a40 2024-09-10T21:50:32.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602819ac30 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60180043c0 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018004a00 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.097+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60281a1310 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.098+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60281a14e0 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.100+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f60180079b0 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.101+0000 7f6024ff9640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 0x7f60140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.101+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5430+0+0 (secure 0 0 0) 0x7f60180e5280 con 0x7f6028102a40 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.101+0000 7f601e7fc640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 0x7f60140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:32.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.102+0000 7f601e7fc640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 0x7f60140b77a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6010009b50 tx=0x7f6010005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:32.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.104+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6018014030 con 0x7f6028102a40 2024-09-10T21:50:32.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:32.297+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f60281a16b0 con 0x7f60140b52e0 2024-09-10T21:50:32.299 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:50:32.299 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:50:32.299 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] boot 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: osdmap e43: 8 total, 8 up, 8 in 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.300 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:32.301 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:32.301 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:50:32.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:50:32.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] boot 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: osdmap e43: 8 total, 8 up, 8 in 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:32.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: osd.7 [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] boot 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: osdmap e43: 8 total, 8 up, 8 in 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:32.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi070 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: osdmap e44: 8 total, 8 up, 8 in 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:33.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:33 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:33.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:50:33.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi070 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: osdmap e44: 8 total, 8 up, 8 in 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:33 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi070 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: osdmap e44: 8 total, 8 up, 8 in 2024-09-10T21:50:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:33.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:33.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:33 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:34.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:34 smithi173 ceph-mon[35294]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:34.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:34 smithi173 ceph-mon[35294]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:50:34.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:34 smithi070 ceph-mon[34909]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:34.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:34 smithi070 ceph-mon[34909]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:50:34.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:34 smithi039 ceph-mon[30872]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:34.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:34 smithi039 ceph-mon[30872]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/3403902164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"}]': finished 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: osdmap e46: 9 total, 8 up, 9 in 2024-09-10T21:50:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:35.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/3403902164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"}]': finished 2024-09-10T21:50:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: osdmap e46: 9 total, 8 up, 9 in 2024-09-10T21:50:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/3403902164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"} : dispatch 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92a3c209-2026-4723-8b0c-b0e780c4cdf3"}]': finished 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: osdmap e46: 9 total, 8 up, 9 in 2024-09-10T21:50:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:36.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:36 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/3040255759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:36.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:36 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/3040255759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:36.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:36 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/3040255759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:50:37.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:37 smithi070 ceph-mon[34909]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:37 smithi039 ceph-mon[30872]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:37 smithi173 ceph-mon[35294]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:39 smithi070 ceph-mon[34909]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:50:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:39 smithi039 ceph-mon[30872]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:50:39.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:39 smithi173 ceph-mon[35294]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:50:41.189 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:41 smithi173 ceph-mon[35294]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:50:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:41 smithi070 ceph-mon[34909]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:50:41.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:41 smithi039 ceph-mon[30872]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:50:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:43 smithi070 ceph-mon[34909]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:50:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:43 smithi039 ceph-mon[30872]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:50:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:43 smithi173 ceph-mon[35294]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:50:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:50:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:50:44.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:44.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:50:44.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:45.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:45 smithi070 ceph-mon[34909]: Deploying daemon osd.8 on smithi173 2024-09-10T21:50:45.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:45 smithi070 ceph-mon[34909]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:50:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:45 smithi039 ceph-mon[30872]: Deploying daemon osd.8 on smithi173 2024-09-10T21:50:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:45 smithi039 ceph-mon[30872]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:50:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:45 smithi173 ceph-mon[35294]: Deploying daemon osd.8 on smithi173 2024-09-10T21:50:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:45 smithi173 ceph-mon[35294]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:50:46.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:46 smithi070 ceph-mon[34909]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:50:46.411 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:46 smithi173 ceph-mon[35294]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:50:46.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:46 smithi039 ceph-mon[30872]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:50:48.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:48 smithi173 ceph-mon[35294]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:50:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:48 smithi070 ceph-mon[34909]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:50:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:48 smithi039 ceph-mon[30872]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:50:49.738 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:49.739 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:49.739 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:49.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:49.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:49.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:49.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:49.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:49.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:51.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:51 smithi173 ceph-mon[35294]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:51 smithi070 ceph-mon[34909]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:51 smithi039 ceph-mon[30872]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:52.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.292+0000 7f6024ff9640 1 -- 172.21.15.173:0/2582438985 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f60281a16b0 con 0x7f60140b52e0 2024-09-10T21:50:52.295 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2024-09-10T21:50:52.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 msgr2=0x7f60140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:52.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 0x7f60140b77a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6010009b50 tx=0x7f6010005f90 comp rx=0 tx=0).stop 2024-09-10T21:50:52.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 msgr2=0x7f6028198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:52.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f601800c890 tx=0x7f601800cd50 comp rx=0 tx=0).stop 2024-09-10T21:50:52.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 shutdown_connections 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60140b52e0 0x7f60140b77a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6028104560 0x7f602819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6028103ba0 0x7f6028199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 --2- 172.21.15.173:0/2582438985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6028102a40 0x7f6028198e10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 >> 172.21.15.173:0/2582438985 conn(0x7f60280fe2f0 msgr2=0x7f6028104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 shutdown_connections 2024-09-10T21:50:52.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:50:52.295+0000 7f602d281640 1 -- 172.21.15.173:0/2582438985 wait complete. 2024-09-10T21:50:52.972 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T21:50:52.974 INFO:tasks.cephadm:Deploying osd.9 on smithi039 with /dev/vg_nvme/lv_1... 2024-09-10T21:50:52.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:50:53.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:53 smithi173 ceph-mon[35294]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:50:53.369 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:53 smithi039 ceph-mon[30872]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:53.369 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:53.370 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:53 smithi070 ceph-mon[34909]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.389 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.389 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.432 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.432 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:54.992 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 21:50:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T21:50:54.853+0000 7fe5ce4bc640 -1 osd.8 0 log_to_monitors true 2024-09-10T21:50:55.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:55 smithi039 ceph-mon[30872]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:55.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:55 smithi039 ceph-mon[30872]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:55 smithi039 ceph-mon[30872]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:55 smithi070 ceph-mon[34909]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:55.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:55 smithi070 ceph-mon[34909]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:55 smithi070 ceph-mon[34909]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.412 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:55 smithi173 ceph-mon[35294]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:55.412 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:55 smithi173 ceph-mon[35294]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.412 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:55 smithi173 ceph-mon[35294]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:50:55.780 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:50:55.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2024-09-10T21:50:56.072 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:50:56.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:56 smithi039 ceph-mon[30872]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:50:56.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:50:56.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:50:56.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:56.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:50:56.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:56 smithi070 ceph-mon[34909]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:50:56.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T21:50:56.088+0000 7fe5ca43f640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T21:50:56.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T21:50:56.104+0000 7fe5c6266640 -1 osd.8 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:50:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:50:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: from='osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:50:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:56.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:50:56.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:50:56.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:56 smithi173 ceph-mon[35294]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:50:56.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 -- 172.21.15.39:0/2628921872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070101940 msgr2=0x7fa070101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:56.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 --2- 172.21.15.39:0/2628921872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070101940 0x7fa070101d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa060009930 tx=0x7fa06002a420 comp rx=0 tx=0).stop 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 -- 172.21.15.39:0/2628921872 shutdown_connections 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 --2- 172.21.15.39:0/2628921872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070103460 0x7fa070109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 --2- 172.21.15.39:0/2628921872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070102aa0 0x7fa070102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 --2- 172.21.15.39:0/2628921872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070101940 0x7fa070101d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 -- 172.21.15.39:0/2628921872 >> 172.21.15.39:0/2628921872 conn(0x7fa0700fd210 msgr2=0x7fa0700ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 -- 172.21.15.39:0/2628921872 shutdown_connections 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.551+0000 7fa0760d5640 1 -- 172.21.15.39:0/2628921872 wait complete. 2024-09-10T21:50:56.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 Processor -- start 2024-09-10T21:50:56.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 -- start start 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070101940 0x7fa07006be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070102aa0 0x7fa07019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010d5a0 con 0x7fa070103460 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010d420 con 0x7fa070102aa0 2024-09-10T21:50:56.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa0760d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010d720 con 0x7fa070101940 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51786/0 (socket says 172.21.15.39:51786) 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa06f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070101940 0x7fa07006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa06ffff640 1 -- 172.21.15.39:0/1683734706 learned_addr learned my addr 172.21.15.39:0/1683734706 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.552+0000 7fa06effd640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070102aa0 0x7fa07019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 -- 172.21.15.39:0/1683734706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070101940 msgr2=0x7fa07006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070101940 0x7fa07006be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 -- 172.21.15.39:0/1683734706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070102aa0 msgr2=0x7fa07019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070102aa0 0x7fa07019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 -- 172.21.15.39:0/1683734706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0701a0a40 con 0x7fa070103460 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06ffff640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa06800eaa0 tx=0x7fa06800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:56.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06800cdb0 con 0x7fa070103460 2024-09-10T21:50:56.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0701a0d30 con 0x7fa070103460 2024-09-10T21:50:56.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa068005020 con 0x7fa070103460 2024-09-10T21:50:56.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680116d0 con 0x7fa070103460 2024-09-10T21:50:56.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.553+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0701a11c0 con 0x7fa070103460 2024-09-10T21:50:56.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.554+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa070108d90 con 0x7fa070103460 2024-09-10T21:50:56.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.556+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fa06800f040 con 0x7fa070103460 2024-09-10T21:50:56.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.556+0000 7fa06cff9640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 0x7fa0580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:50:56.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.557+0000 7fa06f7fe640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 0x7fa0580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:50:56.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.557+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5862+0+0 (secure 0 0 0) 0x7fa0680e5370 con 0x7fa070103460 2024-09-10T21:50:56.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.557+0000 7fa06f7fe640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 0x7fa0580b77a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa060031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:50:56.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.559+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa068016030 con 0x7fa070103460 2024-09-10T21:50:56.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:50:56.759+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa070063590 con 0x7fa0580b52e0 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] boot 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: osdmap e49: 9 total, 9 up, 9 in 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:57.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:57.353 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] boot 2024-09-10T21:50:57.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: osdmap e49: 9 total, 9 up, 9 in 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:57.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:50:57.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: osd.8 [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] boot 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: osdmap e49: 9 total, 9 up, 9 in 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:57.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:50:57.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:50:57.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:50:57.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:50:57.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi173 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:58.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:58 smithi039 ceph-mon[30872]: osdmap e50: 9 total, 9 up, 9 in 2024-09-10T21:50:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:50:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:50:58.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi173 2024-09-10T21:50:58.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-10T21:50:58.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:58.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:58 smithi070 ceph-mon[34909]: osdmap e50: 9 total, 9 up, 9 in 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi173 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:50:58.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:58 smithi173 ceph-mon[35294]: osdmap e50: 9 total, 9 up, 9 in 2024-09-10T21:50:59.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:50:59.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:50:59.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"} : dispatch 2024-09-10T21:50:59.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"}]': finished 2024-09-10T21:50:59.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: osdmap e52: 10 total, 9 up, 10 in 2024-09-10T21:50:59.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:50:59 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:50:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:50:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:50:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"} : dispatch 2024-09-10T21:50:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"}]': finished 2024-09-10T21:50:59.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: osdmap e52: 10 total, 9 up, 10 in 2024-09-10T21:50:59.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:50:59 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"} : dispatch 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/736495969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44086006-8ec9-46fd-bf78-c82043bdb546"}]': finished 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: osdmap e52: 10 total, 9 up, 10 in 2024-09-10T21:50:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:50:59 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:00 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1399677507' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:00 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1399677507' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:00 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1399677507' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:01.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:01 smithi070 ceph-mon[34909]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:01.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:01 smithi039 ceph-mon[30872]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:01.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:01 smithi173 ceph-mon[35294]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:02 smithi070 ceph-mon[34909]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:02 smithi039 ceph-mon[30872]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:02.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:02 smithi173 ceph-mon[35294]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:04.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:04 smithi070 ceph-mon[34909]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:51:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:04 smithi039 ceph-mon[30872]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:51:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:04 smithi173 ceph-mon[35294]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T21:51:06.748 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:06 smithi039 ceph-mon[30872]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:51:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:06 smithi070 ceph-mon[34909]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:51:06.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:06 smithi173 ceph-mon[35294]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:51:08.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:08 smithi039 ceph-mon[30872]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:51:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:08 smithi070 ceph-mon[34909]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:51:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:08 smithi173 ceph-mon[35294]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T21:51:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:51:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:09 smithi039 ceph-mon[30872]: Deploying daemon osd.9 on smithi039 2024-09-10T21:51:09.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:51:09.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:09.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:09 smithi070 ceph-mon[34909]: Deploying daemon osd.9 on smithi039 2024-09-10T21:51:09.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:51:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:09 smithi173 ceph-mon[35294]: Deploying daemon osd.9 on smithi039 2024-09-10T21:51:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:10 smithi070 ceph-mon[34909]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:51:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:10 smithi039 ceph-mon[30872]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:51:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:10 smithi173 ceph-mon[35294]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:51:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:12 smithi070 ceph-mon[34909]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:12 smithi039 ceph-mon[30872]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:12.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:12 smithi173 ceph-mon[35294]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:14.848 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:14 smithi039 ceph-mon[30872]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:14.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:14 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:14.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:14 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:14.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:14 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:14 smithi070 ceph-mon[34909]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:14 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:14 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:14.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:14 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:14.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:14 smithi173 ceph-mon[35294]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:51:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:14 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:14 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:14 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:16.836 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:16 smithi039 ceph-mon[30872]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:16 smithi070 ceph-mon[34909]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:16.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:16 smithi173 ceph-mon[35294]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.132+0000 7fa06cff9640 1 -- 172.21.15.39:0/1683734706 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa070063590 con 0x7fa0580b52e0 2024-09-10T21:51:17.133 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 9 on host 'smithi039' 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 msgr2=0x7fa0580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 0x7fa0580b77a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa060031430 comp rx=0 tx=0).stop 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 msgr2=0x7fa0701a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa06800eaa0 tx=0x7fa06800ef60 comp rx=0 tx=0).stop 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 shutdown_connections 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0580b52e0 0x7fa0580b77a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa070103460 0x7fa0701a0180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa070102aa0 0x7fa07019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 --2- 172.21.15.39:0/1683734706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa070101940 0x7fa07006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.134+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 >> 172.21.15.39:0/1683734706 conn(0x7fa0700fd210 msgr2=0x7fa070105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:51:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.135+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 shutdown_connections 2024-09-10T21:51:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:51:17.135+0000 7fa0760d5640 1 -- 172.21.15.39:0/1683734706 wait complete. 2024-09-10T21:51:17.752 DEBUG:teuthology.orchestra.run.smithi039:osd.9> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T21:51:17.754 INFO:tasks.cephadm:Deploying osd.10 on smithi070 with /dev/vg_nvme/lv_1... 2024-09-10T21:51:17.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:51:18.010 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:51:18.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:18.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:18.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:18.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:19 smithi039 ceph-mon[30872]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:19 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:19 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:19 smithi070 ceph-mon[34909]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:19 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:19 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:19 smithi173 ceph-mon[35294]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:19 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:19 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:20.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:20 smithi070 ceph-mon[34909]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:20.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:20 smithi070 ceph-mon[34909]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:51:20.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:20 smithi039 ceph-mon[30872]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:20.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:20 smithi039 ceph-mon[30872]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:51:20.409 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 21:51:20 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T21:51:20.059+0000 7f8d5d304640 -1 osd.9 0 log_to_monitors true 2024-09-10T21:51:20.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:20 smithi173 ceph-mon[35294]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:20.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:20 smithi173 ceph-mon[35294]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:51:20.563 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T21:51:20.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-09-10T21:51:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.358+0000 7f10ca71c640 1 -- 172.21.15.70:0/1066437578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c406b680 msgr2=0x7f10c4105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.358+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1066437578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c406b680 0x7f10c4105650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009900 tx=0x7f10b402a410 comp rx=0 tx=0).stop 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 -- 172.21.15.70:0/1066437578 shutdown_connections 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1066437578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c4108720 0x7f10c410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1066437578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 0x7f10c4107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1066437578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c406b680 0x7f10c4105650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 -- 172.21.15.70:0/1066437578 >> 172.21.15.70:0/1066437578 conn(0x7f10c40fd1e0 msgr2=0x7f10c40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:51:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 -- 172.21.15.70:0/1066437578 shutdown_connections 2024-09-10T21:51:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 -- 172.21.15.70:0/1066437578 wait complete. 2024-09-10T21:51:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 Processor -- start 2024-09-10T21:51:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.359+0000 7f10ca71c640 1 -- start start 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 0x7f10c4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410e660 con 0x7f10c406b680 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410e4e0 con 0x7f10c4108720 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10ca71c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10c410e7e0 con 0x7f10c4105b90 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46948/0 (socket says 172.21.15.70:46948) 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.70:46890/0 (socket says 172.21.15.70:46890) 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 -- 172.21.15.70:0/1986707945 learned_addr learned my addr 172.21.15.70:0/1986707945 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c37fe640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 0x7f10c4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 -- 172.21.15.70:0/1986707945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 msgr2=0x7f10c4199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 0x7f10c4199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 -- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 msgr2=0x7f10c4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 -- 172.21.15.70:0/1986707945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c419a8f0 con 0x7f10c4108720 2024-09-10T21:51:21.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c3fff640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:51:21.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.360+0000 7f10c8cb9640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00eb10 tx=0x7f10bc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:51:21.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.361+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc004b20 con 0x7f10c4108720 2024-09-10T21:51:21.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.361+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c419abe0 con 0x7f10c4108720 2024-09-10T21:51:21.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.361+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10bc004cc0 con 0x7f10c4108720 2024-09-10T21:51:21.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.361+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc010670 con 0x7f10c4108720 2024-09-10T21:51:21.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.361+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c4101600 con 0x7f10c4108720 2024-09-10T21:51:21.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.362+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c4105fd0 con 0x7f10c4108720 2024-09-10T21:51:21.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.364+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f10bc005000 con 0x7f10c4108720 2024-09-10T21:51:21.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.365+0000 7f10c17fa640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 0x7f10ac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:21.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.365+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5981+0+0 (secure 0 0 0) 0x7f10bc0e5970 con 0x7f10c4108720 2024-09-10T21:51:21.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.365+0000 7f10c3fff640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 0x7f10ac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:21.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.365+0000 7f10c3fff640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 0x7f10ac0b7820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:51:21.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.367+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10bc056220 con 0x7f10c4108720 2024-09-10T21:51:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:51:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: osdmap e53: 10 total, 9 up, 10 in 2024-09-10T21:51:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:51:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi039 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:21 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T21:51:21.152+0000 7f8d59287640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T21:51:21.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T21:51:21.167+0000 7f8d550ae640 -1 osd.9 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: osdmap e53: 10 total, 9 up, 10 in 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi039 2024-09-10T21:51:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:21.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:21.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:21 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: osdmap e53: 10 total, 9 up, 10 in 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]} : dispatch 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi039 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:21.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:21 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:21.558+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f10c4063590 con 0x7f10ac0b5360 2024-09-10T21:51:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:22 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:22 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.619 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:22.619 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.619 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:22.620 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:22 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:23 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:51:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:23 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:51:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:23 smithi039 ceph-mon[30872]: osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] boot 2024-09-10T21:51:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:23 smithi039 ceph-mon[30872]: osdmap e55: 10 total, 10 up, 10 in 2024-09-10T21:51:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:23 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:23.465 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:23 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:51:23.465 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:23 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:51:23.465 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:23 smithi070 ceph-mon[34909]: osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] boot 2024-09-10T21:51:23.466 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:23 smithi070 ceph-mon[34909]: osdmap e55: 10 total, 10 up, 10 in 2024-09-10T21:51:23.466 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:23 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:23 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:51:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:23 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:51:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:23 smithi173 ceph-mon[35294]: osd.9 [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] boot 2024-09-10T21:51:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:23 smithi173 ceph-mon[35294]: osdmap e55: 10 total, 10 up, 10 in 2024-09-10T21:51:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:23 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:51:24.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: osdmap e56: 10 total, 10 up, 10 in 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/1982709857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"}]': finished 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: osdmap e57: 11 total, 10 up, 11 in 2024-09-10T21:51:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:24.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: osdmap e56: 10 total, 10 up, 10 in 2024-09-10T21:51:24.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:24.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/1982709857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"}]': finished 2024-09-10T21:51:24.557 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: osdmap e57: 11 total, 10 up, 11 in 2024-09-10T21:51:24.557 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: osdmap e56: 10 total, 10 up, 10 in 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/1982709857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"} : dispatch 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9ca0ca6-7ace-4069-b3c2-d5630dca41fa"}]': finished 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: osdmap e57: 11 total, 10 up, 11 in 2024-09-10T21:51:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:25.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:25 smithi173 ceph-mon[35294]: from='client.? 172.21.15.70:0/1934243802' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:25.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:25 smithi070 ceph-mon[34909]: from='client.? 172.21.15.70:0/1934243802' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:25.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:25 smithi039 ceph-mon[30872]: from='client.? 172.21.15.70:0/1934243802' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:26.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:26 smithi173 ceph-mon[35294]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:26.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:26 smithi070 ceph-mon[34909]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:26 smithi039 ceph-mon[30872]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:28.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:28 smithi070 ceph-mon[34909]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:28.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:28 smithi173 ceph-mon[35294]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:28 smithi039 ceph-mon[30872]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:30.793 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:30 smithi070 ceph-mon[34909]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:30.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:30 smithi039 ceph-mon[30872]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:30.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:30 smithi173 ceph-mon[35294]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:32.786 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:32 smithi070 ceph-mon[34909]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:32.786 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:51:32.786 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:32.786 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:32 smithi070 ceph-mon[34909]: Deploying daemon osd.10 on smithi070 2024-09-10T21:51:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:32 smithi039 ceph-mon[30872]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:51:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:32 smithi039 ceph-mon[30872]: Deploying daemon osd.10 on smithi070 2024-09-10T21:51:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:32 smithi173 ceph-mon[35294]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:51:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:32 smithi173 ceph-mon[35294]: Deploying daemon osd.10 on smithi070 2024-09-10T21:51:34.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:34 smithi070 ceph-mon[34909]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:34 smithi039 ceph-mon[30872]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:34.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:34 smithi173 ceph-mon[35294]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:36.555 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:36 smithi070 ceph-mon[34909]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:36.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:36 smithi039 ceph-mon[30872]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:36 smithi173 ceph-mon[35294]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:38 smithi070 ceph-mon[34909]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:38.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:38.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:38 smithi039 ceph-mon[30872]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:38.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:38.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:38.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:38 smithi173 ceph-mon[35294]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:40.626 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:40 smithi070 ceph-mon[34909]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:40 smithi039 ceph-mon[30872]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:40 smithi173 ceph-mon[35294]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:41.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.252+0000 7f10c17fa640 1 -- 172.21.15.70:0/1986707945 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f10c4063590 con 0x7f10ac0b5360 2024-09-10T21:51:41.253 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 10 on host 'smithi070' 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 msgr2=0x7f10ac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 0x7f10ac0b7820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b40314a0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 msgr2=0x7f10c419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00eb10 tx=0x7f10bc00c2d0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 shutdown_connections 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f10ac0b5360 0x7f10ac0b7820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10c4108720 0x7f10c419a050 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4105b90 0x7f10c4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 --2- 172.21.15.70:0/1986707945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10c406b680 0x7f10c4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 >> 172.21.15.70:0/1986707945 conn(0x7f10c40fd1e0 msgr2=0x7f10c4103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:51:41.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 shutdown_connections 2024-09-10T21:51:41.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T21:51:41.254+0000 7f10ca71c640 1 -- 172.21.15.70:0/1986707945 wait complete. 2024-09-10T21:51:41.894 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.894 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.894 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:41.895 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:41.895 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.895 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:41.895 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.895 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:41 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:41.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:41.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:41.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:41 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.926 DEBUG:teuthology.orchestra.run.smithi070:osd.10> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T21:51:41.929 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2024-09-10T21:51:41.929 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:51:41.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:41.957 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:41.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:51:41.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:41.958 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:41 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:42.188 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:51:42.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:42 smithi070 ceph-mon[34909]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:42.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:42 smithi039 ceph-mon[30872]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:42 smithi173 ceph-mon[35294]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:44.123 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 21:51:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T21:51:43.777+0000 7f83ecb89640 -1 osd.10 0 log_to_monitors true 2024-09-10T21:51:44.693 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:44 smithi173 ceph-mon[35294]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:44.693 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:44 smithi173 ceph-mon[35294]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:44.693 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:44 smithi173 ceph-mon[35294]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:44.696 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-10T21:51:44.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-09-10T21:51:44.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:44 smithi070 ceph-mon[34909]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:44 smithi070 ceph-mon[34909]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:44 smithi070 ceph-mon[34909]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:44.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:44 smithi039 ceph-mon[30872]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:44.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:44 smithi039 ceph-mon[30872]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:44.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:44 smithi039 ceph-mon[30872]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:51:45.019 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 -- 172.21.15.173:0/3354542045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 msgr2=0x7fc38c10ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 --2- 172.21.15.173:0/3354542045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c10ac30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc384009900 tx=0x7fc38402a410 comp rx=0 tx=0).stop 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 -- 172.21.15.173:0/3354542045 shutdown_connections 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 --2- 172.21.15.173:0/3354542045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c10ac30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 --2- 172.21.15.173:0/3354542045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c105bc0 0x7fc38c108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 --2- 172.21.15.173:0/3354542045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c06c0c0 0x7fc38c105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.478+0000 7fc394551640 1 -- 172.21.15.173:0/3354542045 >> 172.21.15.173:0/3354542045 conn(0x7fc38c0fd200 msgr2=0x7fc38c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- 172.21.15.173:0/3354542045 shutdown_connections 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- 172.21.15.173:0/3354542045 wait complete. 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 Processor -- start 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- start start 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 0x7fc38c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 0x7fc38c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10e6e0 con 0x7fc38c06c0c0 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10e560 con 0x7fc38c105bc0 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc394551640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10e860 con 0x7fc38c108770 2024-09-10T21:51:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc392aee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc392aee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43334/0 (socket says 172.21.15.173:43334) 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc392aee640 1 -- 172.21.15.173:0/2995591127 learned_addr learned my addr 172.21.15.173:0/2995591127 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.479+0000 7fc3922ed640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 0x7fc38c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc391aec640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 0x7fc38c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 -- 172.21.15.173:0/2995591127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 msgr2=0x7fc38c199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 0x7fc38c199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 -- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 msgr2=0x7fc38c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 0x7fc38c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 -- 172.21.15.173:0/2995591127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c19a900 con 0x7fc38c108770 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc391aec640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 0x7fc38c199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc3922ed640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 0x7fc38c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc392aee640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc384031500 tx=0x7fc384031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:51:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38403f030 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc384003aa0 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c19ab90 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384035070 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.480+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c1a12d0 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.481+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c106020 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.482+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fc38403bc30 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.483+0000 7fc3837fe640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 0x7fc3780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.484+0000 7fc3922ed640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 0x7fc3780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.484+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6398+0+0 (secure 0 0 0) 0x7fc384105d60 con 0x7fc38c108770 2024-09-10T21:51:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.484+0000 7fc3922ed640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 0x7fc3780b7820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc388005c40 tx=0x7fc38800a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:51:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.488+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc3840cd3a0 con 0x7fc38c108770 2024-09-10T21:51:45.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:51:45.675+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc38c063590 con 0x7fc3780b5360 2024-09-10T21:51:45.676 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:51:45.676 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.676 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi070 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:45.677 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:45.678 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.905 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T21:51:45.630+0000 7f83e8b0c640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T21:51:45.905 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T21:51:45.641+0000 7f83e4933640 -1 osd.10 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi070 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-10T21:51:45.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:45.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:45.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-10T21:51:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi070 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:45.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:51:45.925 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] boot 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: osdmap e60: 11 total, 11 up, 11 in 2024-09-10T21:51:46.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:46 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] boot 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: osdmap e60: 11 total, 11 up, 11 in 2024-09-10T21:51:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:46 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:51:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:51:46.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:46.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: osd.10 [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] boot 2024-09-10T21:51:46.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: osdmap e60: 11 total, 11 up, 11 in 2024-09-10T21:51:46.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:46 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:51:47.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:47 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:51:47.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:47 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:51:47.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:47 smithi070 ceph-mon[34909]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:51:47.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:47 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:51:47.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:47 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:51:47.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:47 smithi039 ceph-mon[30872]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:51:47.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:47 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:51:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:47 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:51:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:47 smithi173 ceph-mon[35294]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:51:48.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:48.909 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/1796705258' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.909 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.909 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"}]': finished 2024-09-10T21:51:48.909 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: osdmap e62: 12 total, 11 up, 12 in 2024-09-10T21:51:48.909 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:48 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/1796705258' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"}]': finished 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: osdmap e62: 12 total, 11 up, 12 in 2024-09-10T21:51:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:48 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/1796705258' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"} : dispatch 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a925b267-e78c-4cd2-b4c3-a236abc4ce1d"}]': finished 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: osdmap e62: 12 total, 11 up, 12 in 2024-09-10T21:51:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:48 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:51:49.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:49 smithi070 ceph-mon[34909]: from='client.? 172.21.15.173:0/872539537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:49.922 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:49 smithi039 ceph-mon[30872]: from='client.? 172.21.15.173:0/872539537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:49.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:49 smithi173 ceph-mon[35294]: from='client.? 172.21.15.173:0/872539537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:51:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:50 smithi039 ceph-mon[30872]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:50.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:50 smithi173 ceph-mon[35294]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:51.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:50 smithi070 ceph-mon[34909]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:52.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:52 smithi039 ceph-mon[30872]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:52.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:52 smithi173 ceph-mon[35294]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:53.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:52 smithi070 ceph-mon[34909]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:51:54.867 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:54 smithi173 ceph-mon[35294]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:51:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:54 smithi039 ceph-mon[30872]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:51:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:54 smithi070 ceph-mon[34909]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T21:51:56.866 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:56 smithi173 ceph-mon[35294]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:51:56.922 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:56 smithi039 ceph-mon[30872]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:51:56.957 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:56 smithi070 ceph-mon[34909]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T21:51:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:51:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:57 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:57 smithi173 ceph-mon[35294]: Deploying daemon osd.11 on smithi173 2024-09-10T21:51:58.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:51:58.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:57 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:58.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:57 smithi070 ceph-mon[34909]: Deploying daemon osd.11 on smithi173 2024-09-10T21:51:58.172 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:51:58.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:57 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:51:58.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:57 smithi039 ceph-mon[30872]: Deploying daemon osd.11 on smithi173 2024-09-10T21:51:58.856 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:51:58 smithi173 ceph-mon[35294]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:51:59.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:51:58 smithi070 ceph-mon[34909]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:51:59.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:51:58 smithi039 ceph-mon[30872]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T21:52:00.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:00 smithi173 ceph-mon[35294]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T21:52:01.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:00 smithi070 ceph-mon[34909]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T21:52:01.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:00 smithi039 ceph-mon[30872]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T21:52:02.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:02 smithi173 ceph-mon[35294]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:02.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:02 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:03.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:02 smithi070 ceph-mon[34909]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:03.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:03.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:03.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:02 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:02 smithi039 ceph-mon[30872]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:02 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:04.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:04 smithi173 ceph-mon[35294]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:05.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:04 smithi070 ceph-mon[34909]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:05.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:04 smithi039 ceph-mon[30872]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:52:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.163+0000 7fc3837fe640 1 -- 172.21.15.173:0/2995591127 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc38c063590 con 0x7fc3780b5360 2024-09-10T21:52:06.166 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2024-09-10T21:52:06.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.165+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 msgr2=0x7fc3780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:06.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.165+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 0x7fc3780b7820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc388005c40 tx=0x7fc38800a410 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.165+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 msgr2=0x7fc38c19a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.165+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc384031500 tx=0x7fc384031a50 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 shutdown_connections 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3780b5360 0x7fc3780b7820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc38c108770 0x7fc38c19a060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc38c105bc0 0x7fc38c199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 --2- 172.21.15.173:0/2995591127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc38c06c0c0 0x7fc38c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 >> 172.21.15.173:0/2995591127 conn(0x7fc38c0fd200 msgr2=0x7fc38c103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 shutdown_connections 2024-09-10T21:52:06.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:06.166+0000 7fc394551640 1 -- 172.21.15.173:0/2995591127 wait complete. 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.787 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T21:52:06.789 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T21:52:06.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.818 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:07.058 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 -- 172.21.15.39:0/2263784234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64103430 msgr2=0x7f7a64109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2263784234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64103430 0x7f7a64109db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009cd0 tx=0x7f7a5c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 -- 172.21.15.39:0/2263784234 shutdown_connections 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2263784234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64103430 0x7f7a64109db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2263784234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64102a70 0x7f7a64102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2263784234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64101910 0x7f7a64101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 -- 172.21.15.39:0/2263784234 >> 172.21.15.39:0/2263784234 conn(0x7f7a640fd1e0 msgr2=0x7f7a640ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 -- 172.21.15.39:0/2263784234 shutdown_connections 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 -- 172.21.15.39:0/2263784234 wait complete. 2024-09-10T21:52:07.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.583+0000 7f7a696bd640 1 Processor -- start 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 -- start start 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64102a70 0x7f7a64199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64103430 0x7f7a6419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6410d570 con 0x7f7a64101910 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6410d3f0 con 0x7f7a64103430 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a696bd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6410d6f0 con 0x7f7a64102a70 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41506/0 (socket says 172.21.15.39:41506) 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 -- 172.21.15.39:0/2528719248 learned_addr learned my addr 172.21.15.39:0/2528719248 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a627fc640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64102a70 0x7f7a64199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a637fe640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64103430 0x7f7a6419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:07.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 -- 172.21.15.39:0/2528719248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64102a70 msgr2=0x7f7a64199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64102a70 0x7f7a64199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 -- 172.21.15.39:0/2528719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64103430 msgr2=0x7f7a6419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64103430 0x7f7a6419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.584+0000 7f7a62ffd640 1 -- 172.21.15.39:0/2528719248 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6419a920 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a62ffd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400cd80 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6419ac10 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a540108e0 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54018980 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.585+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a641a12f0 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.586+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a64101d10 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.587+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7a54010430 con 0x7f7a64101910 2024-09-10T21:52:07.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.588+0000 7f7a4bfff640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 0x7f7a4c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.588+0000 7f7a627fc640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 0x7f7a4c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.588+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6809+0+0 (secure 0 0 0) 0x7f7a540e5990 con 0x7f7a64101910 2024-09-10T21:52:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.588+0000 7f7a627fc640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 0x7f7a4c0b77a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800bbe0 tx=0x7f7a5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:07.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.592+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a540ace30 con 0x7f7a64101910 2024-09-10T21:52:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.805+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7a641a1680 con 0x7f7a64101910 2024-09-10T21:52:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.806+0000 7f7a4bfff640 1 -- 172.21.15.39:0/2528719248 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v62) ==== 74+0+133 (secure 0 0 0) 0x7f7a540ac730 con 0x7f7a64101910 2024-09-10T21:52:07.806 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 msgr2=0x7f7a4c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 0x7f7a4c0b77a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800bbe0 tx=0x7f7a5800b390 comp rx=0 tx=0).stop 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 msgr2=0x7f7a64198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 shutdown_connections 2024-09-10T21:52:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a4c0b52e0 0x7f7a4c0b77a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a64103430 0x7f7a6419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a64102a70 0x7f7a64199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 --2- 172.21.15.39:0/2528719248 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a64101910 0x7f7a64198df0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 >> 172.21.15.39:0/2528719248 conn(0x7f7a640fd1e0 msgr2=0x7f7a640febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 shutdown_connections 2024-09-10T21:52:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:07.808+0000 7f7a696bd640 1 -- 172.21.15.39:0/2528719248 wait complete. 2024-09-10T21:52:08.581 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":62,"num_osds":12,"num_up_osds":11,"osd_up_since":1726005106,"num_in_osds":12,"osd_in_since":1726005108,"num_remapped_pgs":0} 2024-09-10T21:52:08.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:08 smithi173 ceph-mon[35294]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:08.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:08 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2528719248' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:08.825 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:08 smithi039 ceph-mon[30872]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:08.825 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:08 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2528719248' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:08 smithi070 ceph-mon[34909]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:08 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2528719248' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:09.242 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 21:52:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T21:52:08.937+0000 7fecc12e3640 -1 osd.11 0 log_to_monitors true 2024-09-10T21:52:09.583 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:52:09.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:09 smithi173 ceph-mon[35294]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:09.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:09 smithi173 ceph-mon[35294]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:09.852 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:09.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:09 smithi070 ceph-mon[34909]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:09.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:09 smithi070 ceph-mon[34909]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:09.922 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:09 smithi039 ceph-mon[30872]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:09.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:09 smithi039 ceph-mon[30872]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:52:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.304+0000 7f988a8eb640 1 -- 172.21.15.39:0/4173869881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 msgr2=0x7f9884103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.304+0000 7f988a8eb640 1 --2- 172.21.15.39:0/4173869881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f9884103410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9874009900 tx=0x7f987402a410 comp rx=0 tx=0).stop 2024-09-10T21:52:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.304+0000 7f988a8eb640 1 -- 172.21.15.39:0/4173869881 shutdown_connections 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 --2- 172.21.15.39:0/4173869881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 0x7f9884106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 --2- 172.21.15.39:0/4173869881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 0x7f9884105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 --2- 172.21.15.39:0/4173869881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f9884103410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 -- 172.21.15.39:0/4173869881 >> 172.21.15.39:0/4173869881 conn(0x7f98840fd210 msgr2=0x7f98840ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 -- 172.21.15.39:0/4173869881 shutdown_connections 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 -- 172.21.15.39:0/4173869881 wait complete. 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 Processor -- start 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.305+0000 7f988a8eb640 1 -- start start 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 0x7f988419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 0x7f98841a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9884114cd0 con 0x7f988406c0c0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9884114b50 con 0x7f9884106550 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f988a8eb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9884114e50 con 0x7f98841039a0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54478/0 (socket says 172.21.15.39:54478) 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 -- 172.21.15.39:0/2075186529 learned_addr learned my addr 172.21.15.39:0/2075186529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f98837fe640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 0x7f988419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9888e88640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 0x7f98841a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 -- 172.21.15.39:0/2075186529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 msgr2=0x7f988419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 0x7f988419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 -- 172.21.15.39:0/2075186529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 msgr2=0x7f98841a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 0x7f98841a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 -- 172.21.15.39:0/2075186529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98841a0f00 con 0x7f988406c0c0 2024-09-10T21:52:10.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.306+0000 7f9883fff640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9874031500 tx=0x7f98740043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.307+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987403f030 con 0x7f988406c0c0 2024-09-10T21:52:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.307+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98841a1190 con 0x7f988406c0c0 2024-09-10T21:52:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.307+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9874003800 con 0x7f988406c0c0 2024-09-10T21:52:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.307+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874035070 con 0x7f988406c0c0 2024-09-10T21:52:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.307+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98841a7700 con 0x7f988406c0c0 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.308+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98840fed00 con 0x7f988406c0c0 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.309+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9874003cd0 con 0x7f988406c0c0 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.310+0000 7f98817fa640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 0x7f986c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.310+0000 7f98837fe640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 0x7f986c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.310+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6831+0+0 (secure 0 0 0) 0x7f9874106680 con 0x7f988406c0c0 2024-09-10T21:52:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.311+0000 7f98837fe640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 0x7f986c0b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98780058c0 tx=0x7f987800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:10.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.314+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98740cdb10 con 0x7f988406c0c0 2024-09-10T21:52:10.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.504+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f988402e810 con 0x7f988406c0c0 2024-09-10T21:52:10.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.505+0000 7f98817fa640 1 -- 172.21.15.39:0/2075186529 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7f98740cd410 con 0x7f988406c0c0 2024-09-10T21:52:10.505 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 msgr2=0x7f986c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 0x7f986c0b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98780058c0 tx=0x7f987800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 msgr2=0x7f988419f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9874031500 tx=0x7f98740043c0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 shutdown_connections 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f986c0b52e0 0x7f986c0b77a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9884106550 0x7f98841a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98841039a0 0x7f988419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 --2- 172.21.15.39:0/2075186529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f988406c0c0 0x7f988419f3d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:10.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 >> 172.21.15.39:0/2075186529 conn(0x7f98840fd210 msgr2=0x7f98841047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:10.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 shutdown_connections 2024-09-10T21:52:10.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:10.507+0000 7f988a8eb640 1 -- 172.21.15.39:0/2075186529 wait complete. 2024-09-10T21:52:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: Detected new or changed devices on smithi173 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:10 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2075186529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: Detected new or changed devices on smithi173 2024-09-10T21:52:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:10 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2075186529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: Detected new or changed devices on smithi173 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:10 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2075186529' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:11.251 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1726005106,"num_in_osds":12,"osd_in_since":1726005108,"num_remapped_pgs":0} 2024-09-10T21:52:11.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-mon[35294]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:52:11.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-mon[35294]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:52:11.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:11.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-mon[35294]: from='osd.11 ' entity='osd.11' 2024-09-10T21:52:11.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:11.742 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T21:52:11.397+0000 7fecbd266640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T21:52:11.742 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 21:52:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T21:52:11.553+0000 7fecb5085640 -1 osd.11 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:52:11.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:11 smithi070 ceph-mon[34909]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:52:11.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:11 smithi070 ceph-mon[34909]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:52:11.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:11.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:11 smithi070 ceph-mon[34909]: from='osd.11 ' entity='osd.11' 2024-09-10T21:52:11.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:11 smithi039 ceph-mon[30872]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-10T21:52:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:11 smithi039 ceph-mon[30872]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:52:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:11 smithi039 ceph-mon[30872]: from='osd.11 ' entity='osd.11' 2024-09-10T21:52:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:12.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:52:12.523 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:12.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:12 smithi039 ceph-mon[30872]: purged_snaps scrub starts 2024-09-10T21:52:12.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:12 smithi039 ceph-mon[30872]: purged_snaps scrub ok 2024-09-10T21:52:12.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:12 smithi039 ceph-mon[30872]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:12.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:12 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:12 smithi070 ceph-mon[34909]: purged_snaps scrub starts 2024-09-10T21:52:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:12 smithi070 ceph-mon[34909]: purged_snaps scrub ok 2024-09-10T21:52:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:12 smithi070 ceph-mon[34909]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:12 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:12.991 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:12 smithi173 ceph-mon[35294]: purged_snaps scrub starts 2024-09-10T21:52:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:12 smithi173 ceph-mon[35294]: purged_snaps scrub ok 2024-09-10T21:52:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:12 smithi173 ceph-mon[35294]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:12 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:13.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- 172.21.15.39:0/1616102376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0102a30 msgr2=0x7f17e0102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:13.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/1616102376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0102a30 0x7f17e0102e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009cd0 tx=0x7f17d002a8e0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- 172.21.15.39:0/1616102376 shutdown_connections 2024-09-10T21:52:13.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/1616102376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0104550 0x7f17e010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/1616102376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 0x7f17e0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/1616102376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0102a30 0x7f17e0102e30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- 172.21.15.39:0/1616102376 >> 172.21.15.39:0/1616102376 conn(0x7f17e00fe320 msgr2=0x7f17e0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- 172.21.15.39:0/1616102376 shutdown_connections 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- 172.21.15.39:0/1616102376 wait complete. 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 Processor -- start 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 -- start start 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0102a30 0x7f17e0198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 0x7f17e01994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.963+0000 7f17e6ad4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e6ad4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f17e010e6b0 con 0x7f17e0104550 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e6ad4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17e010e530 con 0x7f17e0102a30 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e6ad4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17e010e830 con 0x7f17e0103b90 2024-09-10T21:52:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54488/0 (socket says 172.21.15.39:54488) 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 -- 172.21.15.39:0/13804227 learned_addr learned my addr 172.21.15.39:0/13804227 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e4870640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0102a30 0x7f17e0198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17dffff640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 0x7f17e01994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 -- 172.21.15.39:0/13804227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 msgr2=0x7f17e01994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 0x7f17e01994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 -- 172.21.15.39:0/13804227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0102a30 msgr2=0x7f17e0198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0102a30 0x7f17e0198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 -- 172.21.15.39:0/13804227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e019a9d0 con 0x7f17e0104550 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e5071640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17d800d750 tx=0x7f17d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8017070 con 0x7f17e0104550 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e019acc0 con 0x7f17e0104550 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17d80054d0 con 0x7f17e0104550 2024-09-10T21:52:13.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.964+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8004c60 con 0x7f17e0104550 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.965+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e01a13a0 con 0x7f17e0104550 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.966+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e0102e30 con 0x7f17e0104550 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.967+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f17d8004e00 con 0x7f17e0104550 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.968+0000 7f17ddffb640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 0x7f17cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.968+0000 7f17e4870640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 0x7f17cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.968+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7127+0+0 (secure 0 0 0) 0x7f17d80e5530 con 0x7f17e0104550 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.968+0000 7f17e4870640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 0x7f17cc0b77a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f17d0006010 tx=0x7f17d0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:12.971+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17d80ac1a0 con 0x7f17e0104550 2024-09-10T21:52:13.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.156+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f17e0109db0 con 0x7f17e0104550 2024-09-10T21:52:13.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.156+0000 7f17ddffb640 1 -- 172.21.15.39:0/13804227 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f17d80b0bd0 con 0x7f17e0104550 2024-09-10T21:52:13.157 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 msgr2=0x7f17cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 0x7f17cc0b77a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f17d0006010 tx=0x7f17d0004a40 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 msgr2=0x7f17e019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17d800d750 tx=0x7f17d800dc10 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 shutdown_connections 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17cc0b52e0 0x7f17cc0b77a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17e0104550 0x7f17e019a130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e0103b90 0x7f17e01994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 --2- 172.21.15.39:0/13804227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17e0102a30 0x7f17e0198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 >> 172.21.15.39:0/13804227 conn(0x7f17e00fe320 msgr2=0x7f17e0106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 shutdown_connections 2024-09-10T21:52:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:13.159+0000 7f17e6ad4640 1 -- 172.21.15.39:0/13804227 wait complete. 2024-09-10T21:52:13.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:13 smithi039 ceph-mon[30872]: osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] boot 2024-09-10T21:52:13.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:13 smithi039 ceph-mon[30872]: osdmap e65: 12 total, 12 up, 12 in 2024-09-10T21:52:13.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:13 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:13.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:13 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/13804227' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:13.893 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":65,"num_osds":12,"num_up_osds":12,"osd_up_since":1726005132,"num_in_osds":12,"osd_in_since":1726005108,"num_remapped_pgs":0} 2024-09-10T21:52:13.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:52:13.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:13 smithi070 ceph-mon[34909]: osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] boot 2024-09-10T21:52:13.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:13 smithi070 ceph-mon[34909]: osdmap e65: 12 total, 12 up, 12 in 2024-09-10T21:52:13.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:13 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:13.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:13 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/13804227' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:13.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:13 smithi173 ceph-mon[35294]: osd.11 [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] boot 2024-09-10T21:52:13.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:13 smithi173 ceph-mon[35294]: osdmap e65: 12 total, 12 up, 12 in 2024-09-10T21:52:13.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:13 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:52:13.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:13 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/13804227' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:52:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:14.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 -- 172.21.15.39:0/2719186748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c109150 msgr2=0x7f205c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:14.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 --2- 172.21.15.39:0/2719186748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c109150 0x7f205c10f950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2054009ca0 tx=0x7f205402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 -- 172.21.15.39:0/2719186748 shutdown_connections 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 --2- 172.21.15.39:0/2719186748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c109150 0x7f205c10f950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 --2- 172.21.15.39:0/2719186748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c1087d0 0x7f205c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.560+0000 7f2060ab9640 1 --2- 172.21.15.39:0/2719186748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c102dc0 0x7f205c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.561+0000 7f2060ab9640 1 -- 172.21.15.39:0/2719186748 >> 172.21.15.39:0/2719186748 conn(0x7f205c0fe830 msgr2=0x7f205c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.561+0000 7f2060ab9640 1 -- 172.21.15.39:0/2719186748 shutdown_connections 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.561+0000 7f2060ab9640 1 -- 172.21.15.39:0/2719186748 wait complete. 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.561+0000 7f2060ab9640 1 Processor -- start 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.561+0000 7f2060ab9640 1 -- start start 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 0x7f205c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c109150 0x7f205c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f205c112dd0 con 0x7f205c1087d0 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f205c112c50 con 0x7f205c102dc0 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f205c112f50 con 0x7f205c109150 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54508/0 (socket says 172.21.15.39:54508) 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 -- 172.21.15.39:0/3787604446 learned_addr learned my addr 172.21.15.39:0/3787604446 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f205ad9d640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c109150 0x7f205c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f205a59c640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 0x7f205c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 -- 172.21.15.39:0/3787604446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c109150 msgr2=0x7f205c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c109150 0x7f205c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 -- 172.21.15.39:0/3787604446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 msgr2=0x7f205c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 0x7f205c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 -- 172.21.15.39:0/3787604446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c1a7680 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f205a59c640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 0x7f205c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2059d9b640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f205000e9f0 tx=0x7f205000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205000cd80 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c1a7970 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20500108e0 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050018980 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.562+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c1a7eb0 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.563+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c1031a0 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.565+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f2050010430 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.566+0000 7f204b7fe640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 0x7f20440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.566+0000 7f205a59c640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 0x7f20440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.566+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f20500e5a60 con 0x7f205c1087d0 2024-09-10T21:52:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.566+0000 7f205a59c640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 0x7f20440b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f204c005d00 tx=0x7f204c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.570+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20500acdc0 con 0x7f205c1087d0 2024-09-10T21:52:14.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.758+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f205c02e5c0 con 0x7f205c1087d0 2024-09-10T21:52:14.758 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:14 smithi039 ceph-mon[30872]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:14.759 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:14 smithi039 ceph-mon[30872]: osdmap e66: 12 total, 12 up, 12 in 2024-09-10T21:52:14.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.758+0000 7f204b7fe640 1 -- 172.21.15.39:0/3787604446 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+18408 (secure 0 0 0) 0x7f20500ac6c0 con 0x7f205c1087d0 2024-09-10T21:52:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:14.760 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":66,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:52:13.546122+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 msgr2=0x7f20440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 0x7f20440b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f204c005d00 tx=0x7f204c005c70 comp rx=0 tx=0).stop 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 msgr2=0x7f205c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f205000e9f0 tx=0x7f205000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 shutdown_connections 2024-09-10T21:52:14.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20440b52e0 0x7f20440b77a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f205c109150 0x7f205c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c1087d0 0x7f205c0759e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 --2- 172.21.15.39:0/3787604446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f205c102dc0 0x7f205c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 >> 172.21.15.39:0/3787604446 conn(0x7f205c0fe830 msgr2=0x7f205c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 shutdown_connections 2024-09-10T21:52:14.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:14.761+0000 7f2060ab9640 1 -- 172.21.15.39:0/3787604446 wait complete. 2024-09-10T21:52:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:14 smithi070 ceph-mon[34909]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:14 smithi070 ceph-mon[34909]: osdmap e66: 12 total, 12 up, 12 in 2024-09-10T21:52:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:14 smithi173 ceph-mon[35294]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:52:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:14 smithi173 ceph-mon[35294]: osdmap e66: 12 total, 12 up, 12 in 2024-09-10T21:52:15.347 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:48:27.848097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:52:15.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T21:52:15.601 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:15 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3787604446' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:52:15.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:15 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3787604446' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:52:15.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:15 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3787604446' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.012+0000 7f5c329b6640 1 -- 172.21.15.39:0/2975875121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c1076a0 msgr2=0x7f5c2c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.012+0000 7f5c329b6640 1 --2- 172.21.15.39:0/2975875121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c107ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009900 tx=0x7f5c2002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 -- 172.21.15.39:0/2975875121 shutdown_connections 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 --2- 172.21.15.39:0/2975875121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c108020 0x7f5c2c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 --2- 172.21.15.39:0/2975875121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c107ae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 --2- 172.21.15.39:0/2975875121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 0x7f5c2c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 -- 172.21.15.39:0/2975875121 >> 172.21.15.39:0/2975875121 conn(0x7f5c2c0fd700 msgr2=0x7f5c2c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 -- 172.21.15.39:0/2975875121 shutdown_connections 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 -- 172.21.15.39:0/2975875121 wait complete. 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 Processor -- start 2024-09-10T21:52:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.013+0000 7f5c329b6640 1 -- start start 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 0x7f5c2c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c111d70 con 0x7f5c2c108020 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c111bf0 con 0x7f5c2c1076a0 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c329b6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c111ef0 con 0x7f5c2c101c90 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:16.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54536/0 (socket says 172.21.15.39:54536) 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 -- 172.21.15.39:0/652255106 learned_addr learned my addr 172.21.15.39:0/652255106 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c2bfff640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 0x7f5c2c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c2b7fe640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 -- 172.21.15.39:0/652255106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 msgr2=0x7f5c2c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 0x7f5c2c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 -- 172.21.15.39:0/652255106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c1076a0 msgr2=0x7f5c2c0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c0fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 -- 172.21.15.39:0/652255106 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c1a7890 con 0x7f5c2c108020 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.014+0000 7f5c30f53640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b970 tx=0x7f5c2400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.015+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24019070 con 0x7f5c2c108020 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.015+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c24014440 con 0x7f5c2c108020 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.015+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c1a7b80 con 0x7f5c2c108020 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.015+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c240075d0 con 0x7f5c2c108020 2024-09-10T21:52:16.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.015+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c1a8040 con 0x7f5c2c108020 2024-09-10T21:52:16.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.016+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c1020f0 con 0x7f5c2c108020 2024-09-10T21:52:16.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.017+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5c240145f0 con 0x7f5c2c108020 2024-09-10T21:52:16.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.018+0000 7f5c297fa640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 0x7f5c140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:16.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.018+0000 7f5c2bfff640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 0x7f5c140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:16.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.018+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f5c240e52d0 con 0x7f5c2c108020 2024-09-10T21:52:16.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.019+0000 7f5c2bfff640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 0x7f5c140b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009990 tx=0x7f5c1c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:16.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.021+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c240abfe0 con 0x7f5c2c108020 2024-09-10T21:52:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.205+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c2c1a8270 con 0x7f5c2c108020 2024-09-10T21:52:16.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.206+0000 7f5c297fa640 1 -- 172.21.15.39:0/652255106 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f5c240b0a10 con 0x7f5c2c108020 2024-09-10T21:52:16.207 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-10T21:52:16.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 msgr2=0x7f5c140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:16.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 0x7f5c140b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009990 tx=0x7f5c1c009110 comp rx=0 tx=0).stop 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 msgr2=0x7f5c2c0fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b970 tx=0x7f5c2400bd70 comp rx=0 tx=0).stop 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 shutdown_connections 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b52e0 0x7f5c140b77a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c2c108020 0x7f5c2c0fe680 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c2c1076a0 0x7f5c2c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 --2- 172.21.15.39:0/652255106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c2c101c90 0x7f5c2c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:16.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 >> 172.21.15.39:0/652255106 conn(0x7f5c2c0fd700 msgr2=0x7f5c2c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:16.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 shutdown_connections 2024-09-10T21:52:16.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:16.208+0000 7f5c329b6640 1 -- 172.21.15.39:0/652255106 wait complete. 2024-09-10T21:52:16.807 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:16 smithi039 ceph-mon[30872]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:16.807 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:16 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/652255106' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.a on smithi039 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.d on smithi039 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.g on smithi039 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.j on smithi039 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.b on smithi070 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.e on smithi070 2024-09-10T21:52:16.840 INFO:tasks.cephadm:Adding mds.h on smithi070 2024-09-10T21:52:16.841 INFO:tasks.cephadm:Adding mds.k on smithi070 2024-09-10T21:52:16.841 INFO:tasks.cephadm:Adding mds.c on smithi173 2024-09-10T21:52:16.841 INFO:tasks.cephadm:Adding mds.f on smithi173 2024-09-10T21:52:16.841 INFO:tasks.cephadm:Adding mds.i on smithi173 2024-09-10T21:52:16.841 INFO:tasks.cephadm:Adding mds.l on smithi173 2024-09-10T21:52:16.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2024-09-10T21:52:16.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:16 smithi173 ceph-mon[35294]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:16.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:16 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/652255106' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:52:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:16 smithi070 ceph-mon[34909]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:16 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/652255106' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:52:17.102 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:52:17.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- 172.21.15.173:0/2653064498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60103430 msgr2=0x7f7a60109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2653064498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60103430 0x7f7a60109db0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009d00 tx=0x7f7a5802a910 comp rx=0 tx=0).stop 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- 172.21.15.173:0/2653064498 shutdown_connections 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2653064498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60103430 0x7f7a60109db0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2653064498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60102a70 0x7f7a60102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2653064498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60101910 0x7f7a60101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- 172.21.15.173:0/2653064498 >> 172.21.15.173:0/2653064498 conn(0x7f7a600fd1e0 msgr2=0x7f7a600ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- 172.21.15.173:0/2653064498 shutdown_connections 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- 172.21.15.173:0/2653064498 wait complete. 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 Processor -- start 2024-09-10T21:52:17.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.562+0000 7f7a66f52640 1 -- start start 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60102a70 0x7f7a60103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 0x7f7a60104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6010d570 con 0x7f7a60102a70 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6010d3f0 con 0x7f7a60103430 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6010d6f0 con 0x7f7a60101910 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53220/0 (socket says 172.21.15.173:53220) 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 -- 172.21.15.173:0/2704628673 learned_addr learned my addr 172.21.15.173:0/2704628673 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a5ffff640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60102a70 0x7f7a60103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a654ef640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 0x7f7a60104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:17.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 -- 172.21.15.173:0/2704628673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 msgr2=0x7f7a60104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 0x7f7a60104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 -- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60102a70 msgr2=0x7f7a60103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60102a70 0x7f7a60103f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 -- 172.21.15.173:0/2704628673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a60104d40 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a654ef640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 0x7f7a60104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a64cee640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400cd80 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a540108e0 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a601a2e60 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.563+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54018980 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.564+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a601a32c0 con 0x7f7a60101910 2024-09-10T21:52:17.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.565+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a601a34f0 con 0x7f7a60101910 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.567+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7a54010430 con 0x7f7a60101910 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.567+0000 7f7a5dffb640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 0x7f7a500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.567+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f7a540e5a50 con 0x7f7a60101910 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.568+0000 7f7a5ffff640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 0x7f7a500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.568+0000 7f7a5ffff640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 0x7f7a500b7820 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0058c0 tx=0x7f7a4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.574+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a540acdb0 con 0x7f7a60101910 2024-09-10T21:52:17.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.763+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) -- 0x7f7a600ff410 con 0x7f7a500b5360 2024-09-10T21:52:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.771+0000 7f7a5dffb640 1 -- 172.21.15.173:0/2704628673 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7a600ff410 con 0x7f7a500b5360 2024-09-10T21:52:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2024-09-10T21:52:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 msgr2=0x7f7a500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 0x7f7a500b7820 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0058c0 tx=0x7f7a4c00a2d0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 msgr2=0x7f7a601056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 shutdown_connections 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7a500b5360 0x7f7a500b7820 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a60103430 0x7f7a60104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a60102a70 0x7f7a60103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 --2- 172.21.15.173:0/2704628673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a60101910 0x7f7a601056d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.773+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 >> 172.21.15.173:0/2704628673 conn(0x7f7a600fd1e0 msgr2=0x7f7a600fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.774+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 shutdown_connections 2024-09-10T21:52:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-10T21:52:17.774+0000 7f7a66f52640 1 -- 172.21.15.173:0/2704628673 wait complete. 2024-09-10T21:52:18.478 DEBUG:teuthology.orchestra.run.smithi039:mds.a> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T21:52:18.481 DEBUG:teuthology.orchestra.run.smithi039:mds.d> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T21:52:18.524 DEBUG:teuthology.orchestra.run.smithi039:mds.g> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T21:52:18.567 DEBUG:teuthology.orchestra.run.smithi039:mds.j> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T21:52:18.610 DEBUG:teuthology.orchestra.run.smithi070:mds.b> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T21:52:18.613 DEBUG:teuthology.orchestra.run.smithi070:mds.e> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T21:52:18.655 DEBUG:teuthology.orchestra.run.smithi070:mds.h> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T21:52:18.699 DEBUG:teuthology.orchestra.run.smithi070:mds.k> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T21:52:18.741 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T21:52:18.744 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T21:52:18.786 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T21:52:18.829 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T21:52:18.872 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T21:52:18.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:18.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:18.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:18.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:18 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:18.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:18.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:18.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:18.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:18.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:18 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:19.130 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:19.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:19.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:19.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:19.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:18 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 -- 172.21.15.39:0/3591468439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe534109150 msgr2=0x7fe53410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3591468439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe534109150 0x7fe53410f950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009ca0 tx=0x7fe52c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 -- 172.21.15.39:0/3591468439 shutdown_connections 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3591468439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe534109150 0x7fe53410f950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3591468439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5341087d0 0x7fe534108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3591468439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 0x7fe5341031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 -- 172.21.15.39:0/3591468439 >> 172.21.15.39:0/3591468439 conn(0x7fe5340fe830 msgr2=0x7fe534100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 -- 172.21.15.39:0/3591468439 shutdown_connections 2024-09-10T21:52:19.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.527+0000 7fe539e5c640 1 -- 172.21.15.39:0/3591468439 wait complete. 2024-09-10T21:52:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 Processor -- start 2024-09-10T21:52:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 -- start start 2024-09-10T21:52:19.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 0x7fe534199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe534109150 0x7fe53419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe534112e10 con 0x7fe5341087d0 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe534112c90 con 0x7fe534109150 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe539e5c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe534112f90 con 0x7fe534102dc0 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54554/0 (socket says 172.21.15.39:54554) 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 -- 172.21.15.39:0/3730333875 learned_addr learned my addr 172.21.15.39:0/3730333875 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe5337fe640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 0x7fe534199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe533fff640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe534109150 0x7fe53419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 -- 172.21.15.39:0/3730333875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 msgr2=0x7fe534199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:19.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 0x7fe534199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 -- 172.21.15.39:0/3730333875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe534109150 msgr2=0x7fe53419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe534109150 0x7fe53419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.528+0000 7fe52bfff640 1 -- 172.21.15.39:0/3730333875 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53419f2e0 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe52bfff640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e9f0 tx=0x7fe51c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00cd80 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53419f5d0 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe51c0108e0 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c018980 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.529+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341a5e60 con 0x7fe5341087d0 2024-09-10T21:52:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.530+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5341031a0 con 0x7fe5341087d0 2024-09-10T21:52:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.531+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe51c010430 con 0x7fe5341087d0 2024-09-10T21:52:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.532+0000 7fe5317fa640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 0x7fe5200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.532+0000 7fe5337fe640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 0x7fe5200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.532+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7fe51c0e5a20 con 0x7fe5341087d0 2024-09-10T21:52:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.533+0000 7fe5337fe640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 0x7fe5200b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe524005fd0 tx=0x7fe52400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.536+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe51c0ac730 con 0x7fe5341087d0 2024-09-10T21:52:19.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.756+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe53419a360 con 0x7fe5341087d0 2024-09-10T21:52:19.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.756+0000 7fe5317fa640 1 -- 172.21.15.39:0/3730333875 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fe51c0b1160 con 0x7fe5341087d0 2024-09-10T21:52:19.757 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:19.757 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"btime":"2024-09-10T21:44:49:362931+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T21:52:19.758 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 1 2024-09-10T21:52:19.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 msgr2=0x7fe5200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:19.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 0x7fe5200b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe524005fd0 tx=0x7fe52400b390 comp rx=0 tx=0).stop 2024-09-10T21:52:19.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 msgr2=0x7fe534199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00e9f0 tx=0x7fe51c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 shutdown_connections 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5200b52e0 0x7fe5200b77a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe534109150 0x7fe53419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5341087d0 0x7fe534199770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 --2- 172.21.15.39:0/3730333875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe534102dc0 0x7fe534199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 >> 172.21.15.39:0/3730333875 conn(0x7fe5340fe830 msgr2=0x7fe534100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 shutdown_connections 2024-09-10T21:52:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:19.759+0000 7fe539e5c640 1 -- 172.21.15.39:0/3730333875 wait complete. 2024-09-10T21:52:19.919 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:19 smithi173 ceph-mon[35294]: Deploying daemon mds.l on smithi173 2024-09-10T21:52:19.919 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:19 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3730333875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:19 smithi039 ceph-mon[30872]: Deploying daemon mds.l on smithi173 2024-09-10T21:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:19 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3730333875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:20.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:19 smithi070 ceph-mon[34909]: Deploying daemon mds.l on smithi173 2024-09-10T21:52:20.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:19 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3730333875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:20.242 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 systemd[1]: Starting Ceph mds.l for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:20.567 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 podman[64883]: 2024-09-10 21:52:20.213270117 +0000 UTC m=+0.015824410 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:20.568 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 podman[64883]: 2024-09-10 21:52:20.322522067 +0000 UTC m=+0.125076392 container create fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T21:52:20.568 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 podman[64883]: 2024-09-10 21:52:20.54124854 +0000 UTC m=+0.343802824 container init fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T21:52:20.568 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 podman[64883]: 2024-09-10 21:52:20.544363826 +0000 UTC m=+0.346918118 container start fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:52:20.568 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mds[64902]: -- 172.21.15.173:0/2578721530 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e686765860 con 0x55e686742800 2024-09-10T21:52:20.992 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: starting mds.l at 2024-09-10T21:52:20.992 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 bash[64883]: fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 2024-09-10T21:52:20.992 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 21:52:20 smithi173 systemd[1]: Started Ceph mds.l for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6832/4284402847,v1:172.21.15.173:6833/4284402847] up:boot 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: fsmap 1 up:standby 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:20.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:20 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6832/4284402847,v1:172.21.15.173:6833/4284402847] up:boot 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: fsmap 1 up:standby 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:21.141 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:20 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6832/4284402847,v1:172.21.15.173:6833/4284402847] up:boot 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: fsmap 1 up:standby 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:20 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:22.103 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:21 smithi070 ceph-mon[34909]: Deploying daemon mds.k on smithi070 2024-09-10T21:52:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:21 smithi039 ceph-mon[30872]: Deploying daemon mds.k on smithi070 2024-09-10T21:52:22.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:21 smithi173 ceph-mon[35294]: Deploying daemon mds.k on smithi070 2024-09-10T21:52:22.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:22.655 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:22 smithi070 systemd[1]: Starting Ceph mds.k for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:22.770 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:23.042 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:22 smithi070 ceph-mon[34909]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:23.042 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:22 smithi070 podman[63362]: 2024-09-10 21:52:22.689931369 +0000 UTC m=+0.015920951 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:23.042 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:22 smithi070 podman[63362]: 2024-09-10 21:52:22.788306919 +0000 UTC m=+0.114296503 container create 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T21:52:23.042 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 podman[63362]: 2024-09-10 21:52:23.015796071 +0000 UTC m=+0.341785665 container init 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:52:23.043 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 podman[63362]: 2024-09-10 21:52:23.018560633 +0000 UTC m=+0.344550215 container start 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:52:23.043 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 ceph-mds[63381]: -- 172.21.15.70:0/2454488125 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604804a7860 con 0x560480485400 2024-09-10T21:52:23.064 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:22 smithi039 ceph-mon[30872]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:22 smithi173 ceph-mon[35294]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 -- 172.21.15.39:0/49705041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 msgr2=0x7f5838107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 --2- 172.21.15.39:0/49705041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f5838107ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5820009900 tx=0x7f582002a410 comp rx=0 tx=0).stop 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 -- 172.21.15.39:0/49705041 shutdown_connections 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 --2- 172.21.15.39:0/49705041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838108020 0x7f583810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 --2- 172.21.15.39:0/49705041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f5838107ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 --2- 172.21.15.39:0/49705041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838101c90 0x7f5838102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 -- 172.21.15.39:0/49705041 >> 172.21.15.39:0/49705041 conn(0x7f58380fd700 msgr2=0x7f58380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 -- 172.21.15.39:0/49705041 shutdown_connections 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.269+0000 7f583e4ea640 1 -- 172.21.15.39:0/49705041 wait complete. 2024-09-10T21:52:23.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 Processor -- start 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 -- start start 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838101c90 0x7f583819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838108020 0x7f58381a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5838111ce0 con 0x7f58381076a0 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5838111b60 con 0x7f5838108020 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583e4ea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5838111e60 con 0x7f5838101c90 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f582ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f582ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42534/0 (socket says 172.21.15.39:42534) 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f582ffff640 1 -- 172.21.15.39:0/1496051246 learned_addr learned my addr 172.21.15.39:0/1496051246 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f583ca87640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838108020 0x7f58381a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:23.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.270+0000 7f5837fff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838101c90 0x7f583819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 -- 172.21.15.39:0/1496051246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838101c90 msgr2=0x7f583819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838101c90 0x7f583819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 -- 172.21.15.39:0/1496051246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838108020 msgr2=0x7f58381a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838108020 0x7f58381a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 -- 172.21.15.39:0/1496051246 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58381a14f0 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f582ffff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5820005940 tx=0x7f5820004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582003f030 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58381a1780 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5820003aa0 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820035070 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.271+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58381a7ea0 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.272+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5838102070 con 0x7f58381076a0 2024-09-10T21:52:23.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.274+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f582003bcc0 con 0x7f58381076a0 2024-09-10T21:52:23.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.275+0000 7f5835ffb640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 0x7f58240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:23.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.275+0000 7f5837fff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 0x7f58240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:23.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.275+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f58201063a0 con 0x7f58381076a0 2024-09-10T21:52:23.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.276+0000 7f5837fff640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 0x7f58240b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5828009b60 tx=0x7f5828005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:23.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.278+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58200cd700 con 0x7f58381076a0 2024-09-10T21:52:23.405 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: starting mds.k at 2024-09-10T21:52:23.405 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 bash[63362]: 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 2024-09-10T21:52:23.406 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 21:52:23 smithi070 systemd[1]: Started Ceph mds.k for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.516+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f583819c570 con 0x7f58381076a0 2024-09-10T21:52:23.518 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:23.518 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":2,"btime":"2024-09-10T21:52:20:572379+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T21:52:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.517+0000 7f5835ffb640 1 -- 172.21.15.39:0/1496051246 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f58200b2e20 con 0x7f58381076a0 2024-09-10T21:52:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 2 2024-09-10T21:52:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.519+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 msgr2=0x7f58240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.519+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 0x7f58240b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5828009b60 tx=0x7f5828005f90 comp rx=0 tx=0).stop 2024-09-10T21:52:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 msgr2=0x7f583819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5820005940 tx=0x7f5820004270 comp rx=0 tx=0).stop 2024-09-10T21:52:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 shutdown_connections 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58240b52e0 0x7f58240b77a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838108020 0x7f58381a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58381076a0 0x7f583819b980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 --2- 172.21.15.39:0/1496051246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5838101c90 0x7f583819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 >> 172.21.15.39:0/1496051246 conn(0x7f58380fd700 msgr2=0x7f583806b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 shutdown_connections 2024-09-10T21:52:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:23.520+0000 7f583e4ea640 1 -- 172.21.15.39:0/1496051246 wait complete. 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:24.341 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: Deploying daemon mds.j on smithi039 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1496051246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6832/4205749592,v1:172.21.15.70:6833/4205749592] up:boot 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: fsmap 2 up:standby 2024-09-10T21:52:24.342 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:24 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: Deploying daemon mds.j on smithi039 2024-09-10T21:52:24.439 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:24.440 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1496051246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:24.440 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6832/4205749592,v1:172.21.15.70:6833/4205749592] up:boot 2024-09-10T21:52:24.440 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: fsmap 2 up:standby 2024-09-10T21:52:24.440 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:24 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: Deploying daemon mds.j on smithi039 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1496051246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6832/4205749592,v1:172.21.15.70:6833/4205749592] up:boot 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: fsmap 2 up:standby 2024-09-10T21:52:24.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:24 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:52:25.923 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:25 smithi039 systemd[1]: Starting Ceph mds.j for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 podman[73145]: 2024-09-10 21:52:26.048958743 +0000 UTC m=+0.110185454 container create 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 podman[73145]: 2024-09-10 21:52:25.955090977 +0000 UTC m=+0.016317686 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 podman[73145]: 2024-09-10 21:52:26.251654498 +0000 UTC m=+0.312881209 container init 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 podman[73145]: 2024-09-10 21:52:26.254789197 +0000 UTC m=+0.316015906 container start 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mds[73166]: -- 172.21.15.39:0/470298274 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55765f64fc20 con 0x55765f62d400 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j[73162]: starting mds.j at 2024-09-10T21:52:26.327 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 bash[73145]: 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b 2024-09-10T21:52:26.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:26.649 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 21:52:26 smithi039 systemd[1]: Started Ceph mds.j for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:26.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:26.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:26 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:26.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:26.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:26 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:26 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:27.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 -- 172.21.15.39:0/2880883742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c109130 msgr2=0x7f818c10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:27.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 --2- 172.21.15.39:0/2880883742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c109130 0x7f818c10f930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8184009ca0 tx=0x7f818402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 -- 172.21.15.39:0/2880883742 shutdown_connections 2024-09-10T21:52:27.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 --2- 172.21.15.39:0/2880883742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c109130 0x7f818c10f930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 --2- 172.21.15.39:0/2880883742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c1087b0 0x7f818c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 --2- 172.21.15.39:0/2880883742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c102da0 0x7f818c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 -- 172.21.15.39:0/2880883742 >> 172.21.15.39:0/2880883742 conn(0x7f818c0fe810 msgr2=0x7f818c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 -- 172.21.15.39:0/2880883742 shutdown_connections 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.070+0000 7f8190a50640 1 -- 172.21.15.39:0/2880883742 wait complete. 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.071+0000 7f8190a50640 1 Processor -- start 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.071+0000 7f8190a50640 1 -- start start 2024-09-10T21:52:27.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.071+0000 7f8190a50640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c102da0 0x7f818c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:27.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.071+0000 7f8190a50640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:27.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.071+0000 7f8190a50640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c109130 0x7f818c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:27.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8190a50640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f818c112e30 con 0x7f818c1087b0 2024-09-10T21:52:27.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8190a50640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f818c112cb0 con 0x7f818c109130 2024-09-10T21:52:27.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8190a50640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f818c112fb0 con 0x7f818c102da0 2024-09-10T21:52:27.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:27.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42568/0 (socket says 172.21.15.39:42568) 2024-09-10T21:52:27.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 -- 172.21.15.39:0/3305973555 learned_addr learned my addr 172.21.15.39:0/3305973555 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:27.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f818ad9d640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c109130 0x7f818c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:27.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f818a59c640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c102da0 0x7f818c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 -- 172.21.15.39:0/3305973555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c102da0 msgr2=0x7f818c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c102da0 0x7f818c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 -- 172.21.15.39:0/3305973555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c109130 msgr2=0x7f818c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c109130 0x7f818c19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 -- 172.21.15.39:0/3305973555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c19f430 con 0x7f818c1087b0 2024-09-10T21:52:27.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f8183fff640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f817400b4a0 tx=0x7f817400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:27.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.072+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174015020 con 0x7f818c1087b0 2024-09-10T21:52:27.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.073+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c19f720 con 0x7f818c1087b0 2024-09-10T21:52:27.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.073+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8174011ce0 con 0x7f818c1087b0 2024-09-10T21:52:27.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.073+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174010dc0 con 0x7f818c1087b0 2024-09-10T21:52:27.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.073+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c1a5e60 con 0x7f818c1087b0 2024-09-10T21:52:27.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.074+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818c103200 con 0x7f818c1087b0 2024-09-10T21:52:27.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.075+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8174011830 con 0x7f818c1087b0 2024-09-10T21:52:27.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.076+0000 7f81837fe640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 0x7f81780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:27.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.076+0000 7f818a59c640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 0x7f81780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:27.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.076+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f81740e5700 con 0x7f818c1087b0 2024-09-10T21:52:27.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.077+0000 7f818a59c640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 0x7f81780b77a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f817c009990 tx=0x7f817c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:27.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.079+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f817401f020 con 0x7f818c1087b0 2024-09-10T21:52:27.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.306+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f818c02e5c0 con 0x7f818c1087b0 2024-09-10T21:52:27.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.306+0000 7f81837fe640 1 -- 172.21.15.39:0/3305973555 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f81740aca60 con 0x7f818c1087b0 2024-09-10T21:52:27.307 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:27.307 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":4,"btime":"2024-09-10T21:52:26:498592+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T21:52:27.307 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 4 2024-09-10T21:52:27.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.308+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 msgr2=0x7f81780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:27.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.308+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 0x7f81780b77a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f817c009990 tx=0x7f817c009110 comp rx=0 tx=0).stop 2024-09-10T21:52:27.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.308+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 msgr2=0x7f818c1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:27.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.308+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f817400b4a0 tx=0x7f817400b8a0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 shutdown_connections 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f81780b52e0 0x7f81780b77a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f818c109130 0x7f818c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f818c1087b0 0x7f818c1998c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 --2- 172.21.15.39:0/3305973555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c102da0 0x7f818c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 >> 172.21.15.39:0/3305973555 conn(0x7f818c0fe810 msgr2=0x7f818c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 shutdown_connections 2024-09-10T21:52:27.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:27.309+0000 7f8190a50640 1 -- 172.21.15.39:0/3305973555 wait complete. 2024-09-10T21:52:27.626 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:27 smithi039 ceph-mon[30872]: Deploying daemon mds.d on smithi039 2024-09-10T21:52:27.626 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:27 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6834/2261493823,v1:172.21.15.39:6835/2261493823] up:boot 2024-09-10T21:52:27.626 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:27 smithi039 ceph-mon[30872]: fsmap 3 up:standby 2024-09-10T21:52:27.626 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:27 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:52:27.626 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:27 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3305973555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:27.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:27 smithi070 ceph-mon[34909]: Deploying daemon mds.d on smithi039 2024-09-10T21:52:27.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:27 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6834/2261493823,v1:172.21.15.39:6835/2261493823] up:boot 2024-09-10T21:52:27.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:27 smithi070 ceph-mon[34909]: fsmap 3 up:standby 2024-09-10T21:52:27.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:27 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:52:27.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:27 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3305973555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:27 smithi173 ceph-mon[35294]: Deploying daemon mds.d on smithi039 2024-09-10T21:52:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:27 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6834/2261493823,v1:172.21.15.39:6835/2261493823] up:boot 2024-09-10T21:52:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:27 smithi173 ceph-mon[35294]: fsmap 3 up:standby 2024-09-10T21:52:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:27 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:52:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:27 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3305973555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:28.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:28 smithi039 ceph-mon[30872]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:28.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:28 smithi070 ceph-mon[34909]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:28 smithi173 ceph-mon[35294]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:29.423 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 systemd[1]: Starting Ceph mds.d for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:29.715 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 podman[73564]: 2024-09-10 21:52:29.350182536 +0000 UTC m=+0.016669165 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:29.715 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 podman[73564]: 2024-09-10 21:52:29.4680563 +0000 UTC m=+0.134542952 container create 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:52:29.715 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 podman[73564]: 2024-09-10 21:52:29.687079105 +0000 UTC m=+0.353565727 container init 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T21:52:29.715 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 podman[73564]: 2024-09-10 21:52:29.690063655 +0000 UTC m=+0.356550266 container start 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T21:52:30.173 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 ceph-mds[73583]: -- 172.21.15.39:0/2710393991 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f249113860 con 0x55f2490f1000 2024-09-10T21:52:30.173 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d[73579]: starting mds.d at 2024-09-10T21:52:30.173 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 bash[73564]: 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d 2024-09-10T21:52:30.173 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 21:52:29 smithi039 systemd[1]: Started Ceph mds.d for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:30.365 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:31.083 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: Deploying daemon mds.e on smithi070 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6836/1193570849,v1:172.21.15.39:6837/1193570849] up:boot 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: fsmap 4 up:standby 2024-09-10T21:52:31.084 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:30 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:52:31.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 -- 172.21.15.39:0/4148789756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34104600 msgr2=0x7f7b3410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:31.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/4148789756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34104600 0x7f7b3410caf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009900 tx=0x7f7b2802a410 comp rx=0 tx=0).stop 2024-09-10T21:52:31.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 -- 172.21.15.39:0/4148789756 shutdown_connections 2024-09-10T21:52:31.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/4148789756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b3410d140 0x7f7b3410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/4148789756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34104600 0x7f7b3410caf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/4148789756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b34103ce0 0x7f7b341040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 -- 172.21.15.39:0/4148789756 >> 172.21.15.39:0/4148789756 conn(0x7f7b340fd720 msgr2=0x7f7b340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 -- 172.21.15.39:0/4148789756 shutdown_connections 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.082+0000 7f7b3be4a640 1 -- 172.21.15.39:0/4148789756 wait complete. 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 Processor -- start 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 -- start start 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b34104600 0x7f7b34105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3410d140 0x7f7b341055a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7b34112db0 con 0x7f7b34103ce0 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b34112c30 con 0x7f7b3410d140 2024-09-10T21:52:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.083+0000 7f7b3be4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b34112f30 con 0x7f7b34104600 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47872/0 (socket says 172.21.15.39:47872) 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 -- 172.21.15.39:0/824100758 learned_addr learned my addr 172.21.15.39:0/824100758 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b393e5640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b34104600 0x7f7b34105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b3a3e7640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3410d140 0x7f7b341055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 -- 172.21.15.39:0/824100758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b34104600 msgr2=0x7f7b34105060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b34104600 0x7f7b34105060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 -- 172.21.15.39:0/824100758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3410d140 msgr2=0x7f7b341055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3410d140 0x7f7b341055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 -- 172.21.15.39:0/824100758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b341abb10 con 0x7f7b34103ce0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b39be6640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400ebc0 tx=0x7f7b2400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24010630 con 0x7f7b34103ce0 2024-09-10T21:52:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b341abe00 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b24010c80 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24018b60 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.084+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b341ac2b0 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.086+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b341040c0 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.087+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7b240107d0 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.087+0000 7f7b32ffd640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 0x7f7b1c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.088+0000 7f7b393e5640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 0x7f7b1c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.088+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f7b240e5ce0 con 0x7f7b34103ce0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.088+0000 7f7b393e5640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 0x7f7b1c0b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000c00 tx=0x7f7b28031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:31.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.092+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7b240ac9f0 con 0x7f7b34103ce0 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: Deploying daemon mds.e on smithi070 2024-09-10T21:52:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6836/1193570849,v1:172.21.15.39:6837/1193570849] up:boot 2024-09-10T21:52:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: fsmap 4 up:standby 2024-09-10T21:52:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:30 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: Deploying daemon mds.e on smithi070 2024-09-10T21:52:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6836/1193570849,v1:172.21.15.39:6837/1193570849] up:boot 2024-09-10T21:52:31.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: fsmap 4 up:standby 2024-09-10T21:52:31.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:30 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:52:31.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.312+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b34105e20 con 0x7f7b34103ce0 2024-09-10T21:52:31.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.313+0000 7f7b32ffd640 1 -- 172.21.15.39:0/824100758 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f7b240b1420 con 0x7f7b34103ce0 2024-09-10T21:52:31.314 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:31.314 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"btime":"2024-09-10T21:52:30:515413+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T21:52:31.314 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 msgr2=0x7f7b1c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 0x7f7b1c0b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000c00 tx=0x7f7b28031400 comp rx=0 tx=0).stop 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 msgr2=0x7f7b34104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400ebc0 tx=0x7f7b2400c6a0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 shutdown_connections 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7b1c0b52e0 0x7f7b1c0b77a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b3410d140 0x7f7b341055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b34104600 0x7f7b34105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 --2- 172.21.15.39:0/824100758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b34103ce0 0x7f7b34104b20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:31.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 >> 172.21.15.39:0/824100758 conn(0x7f7b340fd720 msgr2=0x7f7b340fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:31.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 shutdown_connections 2024-09-10T21:52:31.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:31.315+0000 7f7b3be4a640 1 -- 172.21.15.39:0/824100758 wait complete. 2024-09-10T21:52:31.862 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:31 smithi070 systemd[1]: Starting Ceph mds.e for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:31.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:31 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/824100758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:32.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:31 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/824100758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:31 smithi070 podman[63675]: 2024-09-10 21:52:31.768356962 +0000 UTC m=+0.015669056 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:31 smithi070 podman[63675]: 2024-09-10 21:52:31.87410677 +0000 UTC m=+0.121418860 container create 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 podman[63675]: 2024-09-10 21:52:32.076288448 +0000 UTC m=+0.323600542 container init 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 podman[63675]: 2024-09-10 21:52:32.079068226 +0000 UTC m=+0.326380326 container start 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mds[63694]: -- 172.21.15.70:0/3072757363 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d39b81f860 con 0x55d39b7fd400 2024-09-10T21:52:32.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: starting mds.e at 2024-09-10T21:52:32.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:31 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/824100758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:32.655 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 bash[63675]: 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad 2024-09-10T21:52:32.655 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 21:52:32 smithi070 systemd[1]: Started Ceph mds.e for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:32.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:32 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:32 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:32 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:33.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:33 smithi173 ceph-mon[35294]: Deploying daemon mds.f on smithi173 2024-09-10T21:52:33.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:33 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6834/4263006579,v1:172.21.15.70:6835/4263006579] up:boot 2024-09-10T21:52:33.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:33 smithi173 ceph-mon[35294]: fsmap 5 up:standby 2024-09-10T21:52:33.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:33 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:52:33.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:34.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:33 smithi070 ceph-mon[34909]: Deploying daemon mds.f on smithi173 2024-09-10T21:52:34.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:33 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6834/4263006579,v1:172.21.15.70:6835/4263006579] up:boot 2024-09-10T21:52:34.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:33 smithi070 ceph-mon[34909]: fsmap 5 up:standby 2024-09-10T21:52:34.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:33 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:52:34.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:33 smithi039 ceph-mon[30872]: Deploying daemon mds.f on smithi173 2024-09-10T21:52:34.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:33 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6834/4263006579,v1:172.21.15.70:6835/4263006579] up:boot 2024-09-10T21:52:34.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:33 smithi039 ceph-mon[30872]: fsmap 5 up:standby 2024-09-10T21:52:34.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:33 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:52:34.242 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 systemd[1]: Starting Ceph mds.f for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:34.612 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 podman[65188]: 2024-09-10 21:52:34.260487875 +0000 UTC m=+0.015690502 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:34.612 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 podman[65188]: 2024-09-10 21:52:34.366354323 +0000 UTC m=+0.121556934 container create ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T21:52:34.612 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 podman[65188]: 2024-09-10 21:52:34.585300666 +0000 UTC m=+0.340503277 container init ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T21:52:34.612 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 podman[65188]: 2024-09-10 21:52:34.588308089 +0000 UTC m=+0.343510701 container start ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 -- 172.21.15.39:0/1394586019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe8108060 msgr2=0x7f5fe810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/1394586019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe8108060 0x7f5fe810e860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009ca0 tx=0x7f5fe002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 -- 172.21.15.39:0/1394586019 shutdown_connections 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/1394586019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe8108060 0x7f5fe810e860 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/1394586019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe81076e0 0x7f5fe8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/1394586019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8101cd0 0x7f5fe81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 -- 172.21.15.39:0/1394586019 >> 172.21.15.39:0/1394586019 conn(0x7f5fe80fd700 msgr2=0x7f5fe80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 -- 172.21.15.39:0/1394586019 shutdown_connections 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.712+0000 7f5fefc7f640 1 -- 172.21.15.39:0/1394586019 wait complete. 2024-09-10T21:52:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 Processor -- start 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 -- start start 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe8101cd0 0x7f5fe80fde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8108060 0x7f5fe80fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8111d30 con 0x7f5fe81076e0 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8111bb0 con 0x7f5fe8101cd0 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fefc7f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8111eb0 con 0x7f5fe8108060 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fed21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fed21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47892/0 (socket says 172.21.15.39:47892) 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fed21a640 1 -- 172.21.15.39:0/3562955636 learned_addr learned my addr 172.21.15.39:0/3562955636 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5fee21c640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8108060 0x7f5fe80fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.713+0000 7f5feda1b640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe8101cd0 0x7f5fe80fde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 -- 172.21.15.39:0/3562955636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8108060 msgr2=0x7f5fe80fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8108060 0x7f5fe80fe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 -- 172.21.15.39:0/3562955636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe8101cd0 msgr2=0x7f5fe80fde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe8101cd0 0x7f5fe80fde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 -- 172.21.15.39:0/3562955636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe81a7650 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fed21a640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800d950 tx=0x7f5fd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8017070 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe81a7940 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fd8009c30 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800f620 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.714+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe81a7ed0 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.715+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe81020b0 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.717+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5fd8010460 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.718+0000 7f5fdeffd640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 0x7f5fd40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.718+0000 7f5feda1b640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 0x7f5fd40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.718+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f5fd80e5250 con 0x7f5fe81076e0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.718+0000 7f5feda1b640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 0x7f5fd40b77a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005d00 tx=0x7f5fe400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.721+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5fd8009de0 con 0x7f5fe81076e0 2024-09-10T21:52:34.886 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mds[65207]: -- 172.21.15.173:0/683918331 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55984167d860 con 0x55984165b000 2024-09-10T21:52:34.886 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: starting mds.f at 2024-09-10T21:52:34.886 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 bash[65188]: ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 2024-09-10T21:52:34.886 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 21:52:34 smithi173 systemd[1]: Started Ceph mds.f for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:34.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:34.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:34.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:34.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:34.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:34.887 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.949+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fe802e5c0 con 0x7f5fe81076e0 2024-09-10T21:52:34.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.950+0000 7f5fdeffd640 1 -- 172.21.15.39:0/3562955636 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f5fd80abf60 con 0x7f5fe81076e0 2024-09-10T21:52:34.951 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:34.951 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"btime":"2024-09-10T21:52:34:877662+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-10T21:52:34.951 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2024-09-10T21:52:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 msgr2=0x7f5fd40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 0x7f5fd40b77a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005d00 tx=0x7f5fe400b410 comp rx=0 tx=0).stop 2024-09-10T21:52:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 msgr2=0x7f5fe80fe370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800d950 tx=0x7f5fd800de10 comp rx=0 tx=0).stop 2024-09-10T21:52:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 shutdown_connections 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5fd40b52e0 0x7f5fd40b77a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8108060 0x7f5fe80fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe81076e0 0x7f5fe80fe370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 --2- 172.21.15.39:0/3562955636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fe8101cd0 0x7f5fe80fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 >> 172.21.15.39:0/3562955636 conn(0x7f5fe80fd700 msgr2=0x7f5fe806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.952+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 shutdown_connections 2024-09-10T21:52:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:34.953+0000 7f5fefc7f640 1 -- 172.21.15.39:0/3562955636 wait complete. 2024-09-10T21:52:35.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:35.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:34 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:34 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:35.188 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:34 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:36.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:35 smithi070 ceph-mon[34909]: Deploying daemon mds.c on smithi173 2024-09-10T21:52:36.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:35 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:boot 2024-09-10T21:52:36.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:35 smithi070 ceph-mon[34909]: fsmap 6 up:standby 2024-09-10T21:52:36.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:35 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:52:36.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:35 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3562955636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:36.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:35 smithi039 ceph-mon[30872]: Deploying daemon mds.c on smithi173 2024-09-10T21:52:36.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:35 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:boot 2024-09-10T21:52:36.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:35 smithi039 ceph-mon[30872]: fsmap 6 up:standby 2024-09-10T21:52:36.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:35 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:52:36.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:35 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3562955636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:36.175 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:35 smithi173 ceph-mon[35294]: Deploying daemon mds.c on smithi173 2024-09-10T21:52:36.175 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:35 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:boot 2024-09-10T21:52:36.176 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:35 smithi173 ceph-mon[35294]: fsmap 6 up:standby 2024-09-10T21:52:36.176 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:35 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:52:36.176 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:35 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3562955636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:36.742 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:36 smithi173 systemd[1]: Starting Ceph mds.c for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:37.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:36 smithi173 ceph-mon[35294]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:37.120 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:36 smithi173 podman[65491]: 2024-09-10 21:52:36.760277234 +0000 UTC m=+0.016049343 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:37.120 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:36 smithi173 podman[65491]: 2024-09-10 21:52:36.869308465 +0000 UTC m=+0.125080607 container create a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T21:52:37.120 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 podman[65491]: 2024-09-10 21:52:37.120198099 +0000 UTC m=+0.375970199 container init a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T21:52:37.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:36 smithi070 ceph-mon[34909]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:37.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:36 smithi039 ceph-mon[30872]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:37.492 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 podman[65491]: 2024-09-10 21:52:37.123220803 +0000 UTC m=+0.378992904 container start a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T21:52:37.492 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 ceph-mds[65511]: -- 172.21.15.173:0/3086018646 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea1f0cf860 con 0x55ea1f0ad400 2024-09-10T21:52:37.492 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: starting mds.c at 2024-09-10T21:52:37.492 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 bash[65491]: a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 2024-09-10T21:52:37.492 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 21:52:37 smithi173 systemd[1]: Started Ceph mds.c for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:37.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 -- 172.21.15.39:0/406596781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0102dc0 msgr2=0x7f22a01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 --2- 172.21.15.39:0/406596781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0102dc0 0x7f22a01031a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2290009900 tx=0x7f229002a410 comp rx=0 tx=0).stop 2024-09-10T21:52:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 -- 172.21.15.39:0/406596781 shutdown_connections 2024-09-10T21:52:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 --2- 172.21.15.39:0/406596781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a0109150 0x7f22a010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 --2- 172.21.15.39:0/406596781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a01087d0 0x7f22a0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 --2- 172.21.15.39:0/406596781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0102dc0 0x7f22a01031a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 -- 172.21.15.39:0/406596781 >> 172.21.15.39:0/406596781 conn(0x7f22a00fe830 msgr2=0x7f22a0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 -- 172.21.15.39:0/406596781 shutdown_connections 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.253+0000 7f22a568f640 1 -- 172.21.15.39:0/406596781 wait complete. 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 Processor -- start 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 -- start start 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a0102dc0 0x7f22a00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a01087d0 0x7f22a00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0112e10 con 0x7f22a0109150 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0112c90 con 0x7f22a0102dc0 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.254+0000 7f22a568f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0112f90 con 0x7f22a01087d0 2024-09-10T21:52:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f2297fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a01087d0 0x7f22a00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a0102dc0 0x7f22a00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47900/0 (socket says 172.21.15.39:47900) 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 -- 172.21.15.39:0/4150960810 learned_addr learned my addr 172.21.15.39:0/4150960810 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 -- 172.21.15.39:0/4150960810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a01087d0 msgr2=0x7f22a00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a01087d0 0x7f22a00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 -- 172.21.15.39:0/4150960810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a0102dc0 msgr2=0x7f22a00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a0102dc0 0x7f22a00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 -- 172.21.15.39:0/4150960810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a01a76c0 con 0x7f22a0109150 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229f7fe640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f229800eaa0 tx=0x7f229800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229800cdb0 con 0x7f22a0109150 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2298005020 con 0x7f22a0109150 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a01a79b0 con 0x7f22a0109150 2024-09-10T21:52:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.255+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980116d0 con 0x7f22a0109150 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.256+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a01a7f40 con 0x7f22a0109150 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.257+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a01031a0 con 0x7f22a0109150 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.258+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f2298022060 con 0x7f22a0109150 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.259+0000 7f229cff9640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 0x7f228c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.259+0000 7f229effd640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 0x7f228c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.259+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f22980e5160 con 0x7f22a0109150 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.259+0000 7f229effd640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 0x7f228c0b78a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2290031440 tx=0x7f2290005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.263+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2298016030 con 0x7f22a0109150 2024-09-10T21:52:38.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.487+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22a002e5c0 con 0x7f22a0109150 2024-09-10T21:52:38.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.488+0000 7f229cff9640 1 -- 172.21.15.39:0/4150960810 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f22980abdd0 con 0x7f22a0109150 2024-09-10T21:52:38.489 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:38.489 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"btime":"2024-09-10T21:52:37:898308+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T21:52:38.489 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-09-10T21:52:38.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 msgr2=0x7f228c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:38.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 0x7f228c0b78a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2290031440 tx=0x7f2290005b50 comp rx=0 tx=0).stop 2024-09-10T21:52:38.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 msgr2=0x7f22a0075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:38.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f229800eaa0 tx=0x7f229800ef60 comp rx=0 tx=0).stop 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 shutdown_connections 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f228c0b53e0 0x7f228c0b78a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22a0109150 0x7f22a0075f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a01087d0 0x7f22a00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 --2- 172.21.15.39:0/4150960810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22a0102dc0 0x7f22a00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.490+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 >> 172.21.15.39:0/4150960810 conn(0x7f22a00fe830 msgr2=0x7f22a0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.491+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 shutdown_connections 2024-09-10T21:52:38.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:38.491+0000 7f22a568f640 1 -- 172.21.15.39:0/4150960810 wait complete. 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:38.519 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:38.520 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: Deploying daemon mds.h on smithi070 2024-09-10T21:52:38.520 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:38.520 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:boot 2024-09-10T21:52:38.520 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: fsmap 7 up:standby 2024-09-10T21:52:38.520 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:38 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:52:38.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: Deploying daemon mds.h on smithi070 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:boot 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: fsmap 7 up:standby 2024-09-10T21:52:38.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:38 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: Deploying daemon mds.h on smithi070 2024-09-10T21:52:38.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:38.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:boot 2024-09-10T21:52:38.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: fsmap 7 up:standby 2024-09-10T21:52:38.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:38 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:52:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:39 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4150960810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:39 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4150960810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:39.714 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 21:52:39 smithi070 podman[63975]: 2024-09-10 21:52:39.690577498 +0000 UTC m=+0.351900830 container start c978537ba4a858c7d4ce85f17c5612eb16f6e0437eaadddbc9250de265261a2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T21:52:39.714 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 21:52:39 smithi070 ceph-mds[63994]: -- 172.21.15.70:0/2792217314 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ece36f5c20 con 0x55ece36d2800 2024-09-10T21:52:39.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:39 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4150960810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:40.155 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 21:52:39 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: starting mds.h at 2024-09-10T21:52:40.156 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 21:52:39 smithi070 bash[63975]: c978537ba4a858c7d4ce85f17c5612eb16f6e0437eaadddbc9250de265261a2f 2024-09-10T21:52:40.156 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 21:52:39 smithi070 systemd[1]: Started Ceph mds.h for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: Deploying daemon mds.i on smithi173 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:boot 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: fsmap 8 up:standby 2024-09-10T21:52:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:40 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:52:41.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: Deploying daemon mds.i on smithi173 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:boot 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: fsmap 8 up:standby 2024-09-10T21:52:41.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:40 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: Deploying daemon mds.i on smithi173 2024-09-10T21:52:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:boot 2024-09-10T21:52:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: fsmap 8 up:standby 2024-09-10T21:52:41.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:40 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:52:41.447 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 -- 172.21.15.39:0/3220695719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 msgr2=0x7fb9b01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 --2- 172.21.15.39:0/3220695719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01031a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009900 tx=0x7fb9a002a410 comp rx=0 tx=0).stop 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 -- 172.21.15.39:0/3220695719 shutdown_connections 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 --2- 172.21.15.39:0/3220695719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 0x7fb9b010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 --2- 172.21.15.39:0/3220695719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.904+0000 7fb9b5017640 1 --2- 172.21.15.39:0/3220695719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01031a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.905+0000 7fb9b5017640 1 -- 172.21.15.39:0/3220695719 >> 172.21.15.39:0/3220695719 conn(0x7fb9b00fe830 msgr2=0x7fb9b0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.905+0000 7fb9b5017640 1 -- 172.21.15.39:0/3220695719 shutdown_connections 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.905+0000 7fb9b5017640 1 -- 172.21.15.39:0/3220695719 wait complete. 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.905+0000 7fb9b5017640 1 Processor -- start 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.905+0000 7fb9b5017640 1 -- start start 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 0x7fb9b019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b0112e60 con 0x7fb9b0102dc0 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b0112ce0 con 0x7fb9b0109150 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9b5017640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b0112fe0 con 0x7fb9b01087d0 2024-09-10T21:52:41.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9ae59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35024/0 (socket says 172.21.15.39:35024) 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 -- 172.21.15.39:0/339134798 learned_addr learned my addr 172.21.15.39:0/339134798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9af59e640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 0x7fb9b019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 -- 172.21.15.39:0/339134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 msgr2=0x7fb9b0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 -- 172.21.15.39:0/339134798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 msgr2=0x7fb9b019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 0x7fb9b019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 -- 172.21.15.39:0/339134798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b019f380 con 0x7fb9b0102dc0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9ae59c640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.906+0000 7fb9aed9d640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0005ab0 tx=0x7fb9a0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.907+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a003f070 con 0x7fb9b0102dc0 2024-09-10T21:52:41.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.907+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b019f610 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.907+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9a0031d60 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.907+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0035030 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.907+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b01a5d30 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.908+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b01031a0 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.909+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb9a003b4f0 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.910+0000 7fb997fff640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 0x7fb9980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.910+0000 7fb9ae59c640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 0x7fb9980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.910+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7fb9a01067f0 con 0x7fb9b0102dc0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.910+0000 7fb9ae59c640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 0x7fb9980b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0101d90 tx=0x7fb9a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:41.913+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb9a00cd500 con 0x7fb9b0102dc0 2024-09-10T21:52:41.985 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:41 smithi173 systemd[1]: Starting Ceph mds.i for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:41.986 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:41 smithi173 podman[65797]: 2024-09-10 21:52:41.88766754 +0000 UTC m=+0.016172638 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:42.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.134+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9b010af30 con 0x7fb9b0102dc0 2024-09-10T21:52:42.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.135+0000 7fb997fff640 1 -- 172.21.15.39:0/339134798 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7fb9a00d1f30 con 0x7fb9b0102dc0 2024-09-10T21:52:42.135 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"btime":"2024-09-10T21:52:40:296465+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T21:52:42.136 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 msgr2=0x7fb9980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 0x7fb9980b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0101d90 tx=0x7fb9a4005f90 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 msgr2=0x7fb9b01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0005ab0 tx=0x7fb9a0003c80 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 shutdown_connections 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb9980b52e0 0x7fb9980b77a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b0109150 0x7fb9b019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9b01087d0 0x7fb9b0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 --2- 172.21.15.39:0/339134798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b0102dc0 0x7fb9b01992d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 >> 172.21.15.39:0/339134798 conn(0x7fb9b00fe830 msgr2=0x7fb9b0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 shutdown_connections 2024-09-10T21:52:42.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:42.137+0000 7fb9b5017640 1 -- 172.21.15.39:0/339134798 wait complete. 2024-09-10T21:52:42.242 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 podman[65797]: 2024-09-10 21:52:42.020603121 +0000 UTC m=+0.149108212 container create 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 podman[65797]: 2024-09-10 21:52:42.260505921 +0000 UTC m=+0.389011016 container init 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 podman[65797]: 2024-09-10 21:52:42.263432749 +0000 UTC m=+0.391937843 container start 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mds[65816]: -- 172.21.15.173:0/3921330311 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b240a49860 con 0x55b240a27400 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: starting mds.i at 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 bash[65797]: 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba 2024-09-10T21:52:42.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 21:52:42 smithi173 systemd[1]: Started Ceph mds.i for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/339134798' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:43.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:42 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/339134798' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:42 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/339134798' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:43.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:42 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:43.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:43 smithi039 ceph-mon[30872]: Deploying daemon mds.g on smithi039 2024-09-10T21:52:43.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:43 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:boot 2024-09-10T21:52:43.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:43 smithi039 ceph-mon[30872]: fsmap 9 up:standby 2024-09-10T21:52:43.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:52:44.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:43 smithi070 ceph-mon[34909]: Deploying daemon mds.g on smithi039 2024-09-10T21:52:44.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:43 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:boot 2024-09-10T21:52:44.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:43 smithi070 ceph-mon[34909]: fsmap 9 up:standby 2024-09-10T21:52:44.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:52:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:43 smithi173 ceph-mon[35294]: Deploying daemon mds.g on smithi039 2024-09-10T21:52:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:43 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:boot 2024-09-10T21:52:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:43 smithi173 ceph-mon[35294]: fsmap 9 up:standby 2024-09-10T21:52:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:52:44.510 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 systemd[1]: Starting Ceph mds.g for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:44.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:44.762 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 podman[74328]: 2024-09-10 21:52:44.509113091 +0000 UTC m=+0.111303818 container create bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T21:52:44.762 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 podman[74328]: 2024-09-10 21:52:44.414483513 +0000 UTC m=+0.016674191 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:44.762 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 podman[74328]: 2024-09-10 21:52:44.74474452 +0000 UTC m=+0.346935190 container init bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T21:52:44.762 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 podman[74328]: 2024-09-10 21:52:44.747754896 +0000 UTC m=+0.349945571 container start bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T21:52:45.013 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:45.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:45.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-mds[74356]: -- 172.21.15.39:0/4235820965 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631999b5860 con 0x563199993000 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: starting mds.g at 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 bash[74328]: bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 2024-09-10T21:52:45.136 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 21:52:44 smithi039 systemd[1]: Started Ceph mds.g for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:45.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:45.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:45.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 -- 172.21.15.39:0/885393511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b80109150 msgr2=0x7f8b8010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 --2- 172.21.15.39:0/885393511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b80109150 0x7f8b8010f950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009ca0 tx=0x7f8b7802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 -- 172.21.15.39:0/885393511 shutdown_connections 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 --2- 172.21.15.39:0/885393511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b80109150 0x7f8b8010f950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 --2- 172.21.15.39:0/885393511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b801087d0 0x7f8b80108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 --2- 172.21.15.39:0/885393511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80102dc0 0x7f8b801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 -- 172.21.15.39:0/885393511 >> 172.21.15.39:0/885393511 conn(0x7f8b800fe830 msgr2=0x7f8b80100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 -- 172.21.15.39:0/885393511 shutdown_connections 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.490+0000 7f8b86898640 1 -- 172.21.15.39:0/885393511 wait complete. 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 Processor -- start 2024-09-10T21:52:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 -- start start 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b80102dc0 0x7f8b800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 0x7f8b80075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80112e20 con 0x7f8b801087d0 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80112ca0 con 0x7f8b80109150 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b86898640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80112fa0 con 0x7f8b80102dc0 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35058/0 (socket says 172.21.15.39:35058) 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b77fff640 1 -- 172.21.15.39:0/1224220709 learned_addr learned my addr 172.21.15.39:0/1224220709 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.491+0000 7f8b7ffff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b80102dc0 0x7f8b800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b84e35640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 0x7f8b80075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 -- 172.21.15.39:0/1224220709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b80102dc0 msgr2=0x7f8b800754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:45.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b80102dc0 0x7f8b800754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 -- 172.21.15.39:0/1224220709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 msgr2=0x7f8b80075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 0x7f8b80075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 -- 172.21.15.39:0/1224220709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801a7530 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b84e35640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 0x7f8b80075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b77fff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d770 tx=0x7f8b6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68017070 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b680054d0 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b801a7820 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68004c30 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.492+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801a7d60 con 0x7f8b801087d0 2024-09-10T21:52:45.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.493+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b800767a0 con 0x7f8b801087d0 2024-09-10T21:52:45.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.495+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8b68004dd0 con 0x7f8b801087d0 2024-09-10T21:52:45.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.495+0000 7f8b7dffb640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:45.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.495+0000 7f8b7ffff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:45.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.495+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f8b680e5510 con 0x7f8b801087d0 2024-09-10T21:52:45.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.496+0000 7f8b7ffff640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b700058c0 tx=0x7f8b7000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:45.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.498+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b680ac8f0 con 0x7f8b801087d0 2024-09-10T21:52:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.731+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b801a80e0 con 0x7f8b801087d0 2024-09-10T21:52:45.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.732+0000 7f8b7dffb640 1 -- 172.21.15.39:0/1224220709 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f8b680ac1f0 con 0x7f8b801087d0 2024-09-10T21:52:45.733 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:45.733 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":11,"btime":"2024-09-10T21:52:44:872419+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T21:52:45.733 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 11 2024-09-10T21:52:45.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 msgr2=0x7f8b6c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b700058c0 tx=0x7f8b7000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 msgr2=0x7f8b800759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d770 tx=0x7f8b6800dc30 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 shutdown_connections 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b80109150 0x7f8b80075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b801087d0 0x7f8b800759e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 --2- 172.21.15.39:0/1224220709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b80102dc0 0x7f8b800754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 >> 172.21.15.39:0/1224220709 conn(0x7f8b800fe830 msgr2=0x7f8b800fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 shutdown_connections 2024-09-10T21:52:45.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:45.734+0000 7f8b86898640 1 -- 172.21.15.39:0/1224220709 wait complete. 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6838/4288267736,v1:172.21.15.39:6839/4288267736] up:boot 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: fsmap 10 up:standby 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: Deploying daemon mds.a on smithi039 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:52:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1224220709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:46.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:46.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6838/4288267736,v1:172.21.15.39:6839/4288267736] up:boot 2024-09-10T21:52:46.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: fsmap 10 up:standby 2024-09-10T21:52:46.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: Deploying daemon mds.a on smithi039 2024-09-10T21:52:46.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:52:46.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1224220709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6838/4288267736,v1:172.21.15.39:6839/4288267736] up:boot 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: fsmap 10 up:standby 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: Deploying daemon mds.a on smithi039 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:52:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1224220709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:46 smithi039 ceph-mon[30872]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:46 smithi070 ceph-mon[34909]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:47.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:46 smithi173 ceph-mon[35294]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:47.673 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:47 smithi039 systemd[1]: Starting Ceph mds.a for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:47 smithi039 podman[74739]: 2024-09-10 21:52:47.733615225 +0000 UTC m=+0.016851105 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:47 smithi039 podman[74739]: 2024-09-10 21:52:47.845300111 +0000 UTC m=+0.128536033 container create 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 podman[74739]: 2024-09-10 21:52:48.014555925 +0000 UTC m=+0.297791806 container init 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 podman[74739]: 2024-09-10 21:52:48.018278611 +0000 UTC m=+0.301514494 container start 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 ceph-mds[74758]: -- 172.21.15.39:0/2354710589 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f86ba3c20 con 0x564f86b81400 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: starting mds.a at 2024-09-10T21:52:48.084 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 bash[74739]: 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f 2024-09-10T21:52:48.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:48.409 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 21:52:48 smithi039 systemd[1]: Started Ceph mds.a for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:49.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 -- 172.21.15.39:0/1355361356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148108020 msgr2=0x7fe14810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 --2- 172.21.15.39:0/1355361356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148108020 0x7fe14810e820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe140009900 tx=0x7fe14002a410 comp rx=0 tx=0).stop 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 -- 172.21.15.39:0/1355361356 shutdown_connections 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 --2- 172.21.15.39:0/1355361356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148108020 0x7fe14810e820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 --2- 172.21.15.39:0/1355361356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1481076a0 0x7fe148107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 --2- 172.21.15.39:0/1355361356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148101c90 0x7fe148102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 -- 172.21.15.39:0/1355361356 >> 172.21.15.39:0/1355361356 conn(0x7fe1480fd700 msgr2=0x7fe1480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 -- 172.21.15.39:0/1355361356 shutdown_connections 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.067+0000 7fe14de4d640 1 -- 172.21.15.39:0/1355361356 wait complete. 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 Processor -- start 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 -- start start 2024-09-10T21:52:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 0x7fe14819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148108020 0x7fe14819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111ca0 con 0x7fe1481076a0 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111b20 con 0x7fe148108020 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe14de4d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111e20 con 0x7fe148101c90 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35084/0 (socket says 172.21.15.39:35084) 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 -- 172.21.15.39:0/3821272328 learned_addr learned my addr 172.21.15.39:0/3821272328 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe1477fe640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 0x7fe14819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe147fff640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148108020 0x7fe14819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 -- 172.21.15.39:0/3821272328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 msgr2=0x7fe14819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 0x7fe14819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 -- 172.21.15.39:0/3821272328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148108020 msgr2=0x7fe14819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:49.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148108020 0x7fe14819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe146ffd640 1 -- 172.21.15.39:0/3821272328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1481a5430 con 0x7fe1481076a0 2024-09-10T21:52:49.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.068+0000 7fe1477fe640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 0x7fe14819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:52:49.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe146ffd640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d950 tx=0x7fe13000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:49.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130017070 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe130009c30 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1481a5720 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13000f620 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.069+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481a5cb0 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.070+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe148102070 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.072+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe130010460 con 0x7fe1481076a0 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.072+0000 7fe144ff9640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 0x7fe1340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:49.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.072+0000 7fe1477fe640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 0x7fe1340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.073+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7fe1300e53a0 con 0x7fe1481076a0 2024-09-10T21:52:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.073+0000 7fe1477fe640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 0x7fe1340b7820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe138005fd0 tx=0x7fe138009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.075+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1300ac780 con 0x7fe1481076a0 2024-09-10T21:52:49.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.299+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe14806aec0 con 0x7fe1481076a0 2024-09-10T21:52:49.301 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:49.301 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6840/2073917136,v1:172.21.15.39:6841/2073917136] up:boot 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: fsmap 11 up:standby 2024-09-10T21:52:49.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:49 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:52:49.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.300+0000 7fe144ff9640 1 -- 172.21.15.39:0/3821272328 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7fe130009de0 con 0x7fe1481076a0 2024-09-10T21:52:49.303 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:49.303 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":12,"btime":"2024-09-10T21:52:48:886784+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T21:52:49.303 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 12 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 msgr2=0x7fe1340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 0x7fe1340b7820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe138005fd0 tx=0x7fe138009500 comp rx=0 tx=0).stop 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 msgr2=0x7fe14819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d950 tx=0x7fe13000de10 comp rx=0 tx=0).stop 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 shutdown_connections 2024-09-10T21:52:49.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1340b5360 0x7fe1340b7820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148108020 0x7fe14819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1481076a0 0x7fe14819a590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 --2- 172.21.15.39:0/3821272328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe148101c90 0x7fe14819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 >> 172.21.15.39:0/3821272328 conn(0x7fe1480fd700 msgr2=0x7fe1480fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 shutdown_connections 2024-09-10T21:52:49.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:49.302+0000 7fe14de4d640 1 -- 172.21.15.39:0/3821272328 wait complete. 2024-09-10T21:52:49.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6840/2073917136,v1:172.21.15.39:6841/2073917136] up:boot 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: fsmap 11 up:standby 2024-09-10T21:52:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:49 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:52:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:52:49.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:49.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6840/2073917136,v1:172.21.15.39:6841/2073917136] up:boot 2024-09-10T21:52:49.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: fsmap 11 up:standby 2024-09-10T21:52:49.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:49 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:52:50.355 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:50 smithi070 ceph-mon[34909]: Deploying daemon mds.b on smithi070 2024-09-10T21:52:50.355 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:50 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3821272328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:50.355 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 systemd[1]: Starting Ceph mds.b for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T21:52:50.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:50 smithi039 ceph-mon[30872]: Deploying daemon mds.b on smithi070 2024-09-10T21:52:50.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:50 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3821272328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:50 smithi173 ceph-mon[35294]: Deploying daemon mds.b on smithi070 2024-09-10T21:52:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:50 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3821272328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:50.617 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 podman[64272]: 2024-09-10 21:52:50.257166575 +0000 UTC m=+0.016020166 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:52:50.617 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 podman[64272]: 2024-09-10 21:52:50.480277525 +0000 UTC m=+0.239131104 container create 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:52:50.905 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 podman[64272]: 2024-09-10 21:52:50.723449345 +0000 UTC m=+0.482302923 container init 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T21:52:50.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 podman[64272]: 2024-09-10 21:52:50.726501132 +0000 UTC m=+0.485354710 container start 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:52:50.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 ceph-mds[64291]: -- 172.21.15.70:0/2599222839 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d862d07860 con 0x55d862ce5000 2024-09-10T21:52:50.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: starting mds.b at 2024-09-10T21:52:50.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 bash[64272]: 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef 2024-09-10T21:52:50.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:52:50 smithi070 systemd[1]: Started Ceph mds.b for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T21:52:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:51 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:51 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:51 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:51.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:52:52.257 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:52.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:52 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:boot 2024-09-10T21:52:52.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:52 smithi039 ceph-mon[30872]: fsmap 12 up:standby 2024-09-10T21:52:52.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:52 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:52:52.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:52 smithi039 ceph-mon[30872]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:52 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:boot 2024-09-10T21:52:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:52 smithi070 ceph-mon[34909]: fsmap 12 up:standby 2024-09-10T21:52:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:52 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:52:52.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:52 smithi070 ceph-mon[34909]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:52.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:52 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:boot 2024-09-10T21:52:52.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:52 smithi173 ceph-mon[35294]: fsmap 12 up:standby 2024-09-10T21:52:52.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:52 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:52:52.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:52 smithi173 ceph-mon[35294]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:52.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- 172.21.15.39:0/136405841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2810d140 msgr2=0x7fba2810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 --2- 172.21.15.39:0/136405841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2810d140 0x7fba2810f550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fba18009ca0 tx=0x7fba1802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- 172.21.15.39:0/136405841 shutdown_connections 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 --2- 172.21.15.39:0/136405841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2810d140 0x7fba2810f550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 --2- 172.21.15.39:0/136405841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28104590 0x7fba2810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 --2- 172.21.15.39:0/136405841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba28103b90 0x7fba28103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- 172.21.15.39:0/136405841 >> 172.21.15.39:0/136405841 conn(0x7fba280fd700 msgr2=0x7fba280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- 172.21.15.39:0/136405841 shutdown_connections 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- 172.21.15.39:0/136405841 wait complete. 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 Processor -- start 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.635+0000 7fba2ef98640 1 -- start start 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28103b90 0x7fba28199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 0x7fba2819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba28112d60 con 0x7fba28104590 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba28112be0 con 0x7fba2810d140 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2ef98640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fba28112ee0 con 0x7fba28103b90 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48460/0 (socket says 172.21.15.39:48460) 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 -- 172.21.15.39:0/3613107212 learned_addr learned my addr 172.21.15.39:0/3613107212 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2d535640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 0x7fba2819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2cd34640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28103b90 0x7fba28199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 -- 172.21.15.39:0/3613107212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28103b90 msgr2=0x7fba28199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28103b90 0x7fba28199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 -- 172.21.15.39:0/3613107212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 msgr2=0x7fba2819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 0x7fba2819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 -- 172.21.15.39:0/3613107212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2819f340 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba2d535640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 0x7fba2819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.636+0000 7fba27fff640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba1000d770 tx=0x7fba1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.637+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10017070 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.637+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba100054d0 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.637+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2819f630 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.637+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10004c30 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.637+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba281a5cf0 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.638+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba28103f70 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.639+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fba10004df0 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.640+0000 7fba25ffb640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 0x7fba140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.640+0000 7fba2cd34640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 0x7fba140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.641+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7fba100e5090 con 0x7fba28104590 2024-09-10T21:52:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.641+0000 7fba2cd34640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 0x7fba140b7820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba20005d00 tx=0x7fba2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:52.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.645+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fba100abda0 con 0x7fba28104590 2024-09-10T21:52:52.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.891+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba2802e5c0 con 0x7fba28104590 2024-09-10T21:52:52.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.893+0000 7fba25ffb640 1 -- 172.21.15.39:0/3613107212 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fba100b07d0 con 0x7fba28104590 2024-09-10T21:52:52.895 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:52.895 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":13,"btime":"2024-09-10T21:52:51:140460+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24515,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24550,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24590,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T21:52:52.896 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 13 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 msgr2=0x7fba140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 0x7fba140b7820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba20005d00 tx=0x7fba2000b410 comp rx=0 tx=0).stop 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 msgr2=0x7fba281997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba1000d770 tx=0x7fba1000dc30 comp rx=0 tx=0).stop 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 shutdown_connections 2024-09-10T21:52:52.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fba140b5360 0x7fba140b7820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba2810d140 0x7fba2819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba28104590 0x7fba281997d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 --2- 172.21.15.39:0/3613107212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba28103b90 0x7fba28199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 >> 172.21.15.39:0/3613107212 conn(0x7fba280fd700 msgr2=0x7fba280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 shutdown_connections 2024-09-10T21:52:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:52.896+0000 7fba2ef98640 1 -- 172.21.15.39:0/3613107212 wait complete. 2024-09-10T21:52:53.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3613107212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:53 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.743 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3613107212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.744 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:53 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.913 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3613107212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:52:53.913 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:53.913 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:53.913 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:53.913 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:53 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:52:54.486 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:54.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:54.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:54.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:54.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:54.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:54.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:54 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 -- 172.21.15.39:0/3408976425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24108020 msgr2=0x7f5c2410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 --2- 172.21.15.39:0/3408976425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24108020 0x7f5c2410e820 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009ca0 tx=0x7f5c1c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 -- 172.21.15.39:0/3408976425 shutdown_connections 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 --2- 172.21.15.39:0/3408976425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24108020 0x7f5c2410e820 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 --2- 172.21.15.39:0/3408976425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c241076a0 0x7f5c24107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 --2- 172.21.15.39:0/3408976425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c24101c90 0x7f5c24102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 -- 172.21.15.39:0/3408976425 >> 172.21.15.39:0/3408976425 conn(0x7f5c240fd700 msgr2=0x7f5c240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 -- 172.21.15.39:0/3408976425 shutdown_connections 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.962+0000 7f5c2af60640 1 -- 172.21.15.39:0/3408976425 wait complete. 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 Processor -- start 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 -- start start 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 0x7f5c241986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 0x7f5c2419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24111ca0 con 0x7f5c24101c90 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24111b20 con 0x7f5c24108020 2024-09-10T21:52:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c2af60640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24111e20 con 0x7f5c241076a0 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c28cfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c28cfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48478/0 (socket says 172.21.15.39:48478) 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.963+0000 7f5c28cfc640 1 -- 172.21.15.39:0/979653873 learned_addr learned my addr 172.21.15.39:0/979653873 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c23fff640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 0x7f5c241986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c294fd640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 0x7f5c2419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 -- 172.21.15.39:0/979653873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 msgr2=0x7f5c241986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 0x7f5c241986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 -- 172.21.15.39:0/979653873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 msgr2=0x7f5c2419da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 0x7f5c2419da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 -- 172.21.15.39:0/979653873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2419e260 con 0x7f5c24101c90 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c23fff640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 0x7f5c241986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:52:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c294fd640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 0x7f5c2419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c28cfc640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800d950 tx=0x7f5c1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18017030 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c18004020 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2419e550 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c180047a0 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.964+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c241a4de0 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.965+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c24102070 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.967+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5c18009a30 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.967+0000 7f5c21ffb640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 0x7f5c140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.967+0000 7f5c23fff640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 0x7f5c140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.968+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f5c180e5210 con 0x7f5c24101c90 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.968+0000 7f5c23fff640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 0x7f5c140b7820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c24103d70 tx=0x7f5c10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:54.971+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c180ac570 con 0x7f5c24101c90 2024-09-10T21:52:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:54 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.182+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5c241992e0 con 0x7f5c24101c90 2024-09-10T21:52:55.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.182+0000 7f5c21ffb640 1 -- 172.21.15.39:0/979653873 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) ==== 84+0+65 (secure 0 0 0) 0x7f5c180abe70 con 0x7f5c24101c90 2024-09-10T21:52:55.184 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:52:55.184 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-09-10T21:52:55.184 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T21:52:55.185 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-09-10T21:52:55.185 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-09-10T21:52:55.185 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:52:55.185 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-09-10T21:52:55.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 msgr2=0x7f5c140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:55.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 0x7f5c140b7820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c24103d70 tx=0x7f5c10005f90 comp rx=0 tx=0).stop 2024-09-10T21:52:55.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 msgr2=0x7f5c241981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800d950 tx=0x7f5c1800de10 comp rx=0 tx=0).stop 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 shutdown_connections 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5c140b5360 0x7f5c140b7820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c24108020 0x7f5c2419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c241076a0 0x7f5c241986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 --2- 172.21.15.39:0/979653873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24101c90 0x7f5c241981b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 >> 172.21.15.39:0/979653873 conn(0x7f5c240fd700 msgr2=0x7f5c240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 shutdown_connections 2024-09-10T21:52:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:55.185+0000 7f5c2af60640 1 -- 172.21.15.39:0/979653873 wait complete. 2024-09-10T21:52:55.241 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:54 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:55.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T21:52:55.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T21:52:55.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:55 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/979653873' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:52:56.099 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:56.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:55 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/979653873' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:52:56.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:55 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/979653873' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:52:56.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 -- 172.21.15.39:0/2294833494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 msgr2=0x7fddd010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:56.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 --2- 172.21.15.39:0/2294833494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd010f970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009ca0 tx=0x7fddc002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 -- 172.21.15.39:0/2294833494 shutdown_connections 2024-09-10T21:52:56.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 --2- 172.21.15.39:0/2294833494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd010f970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 --2- 172.21.15.39:0/2294833494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 0x7fddd0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 --2- 172.21.15.39:0/2294833494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.578+0000 7fddd565d640 1 -- 172.21.15.39:0/2294833494 >> 172.21.15.39:0/2294833494 conn(0x7fddd00fe830 msgr2=0x7fddd0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.579+0000 7fddd565d640 1 -- 172.21.15.39:0/2294833494 shutdown_connections 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.579+0000 7fddd565d640 1 -- 172.21.15.39:0/2294833494 wait complete. 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.579+0000 7fddd565d640 1 Processor -- start 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.579+0000 7fddd565d640 1 -- start start 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 0x7fddd01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0112df0 con 0x7fddd0109170 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0112c70 con 0x7fddd0102de0 2024-09-10T21:52:56.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddd565d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0112f70 con 0x7fddd01087f0 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48498/0 (socket says 172.21.15.39:48498) 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddceffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 -- 172.21.15.39:0/2328284422 learned_addr learned my addr 172.21.15.39:0/2328284422 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddce7fc640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 0x7fddd01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 -- 172.21.15.39:0/2328284422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 msgr2=0x7fddd01997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 0x7fddd01997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 -- 172.21.15.39:0/2328284422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 msgr2=0x7fddd0199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd0199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 -- 172.21.15.39:0/2328284422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd019f320 con 0x7fddd0109170 2024-09-10T21:52:56.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddceffd640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.580+0000 7fddcf7fe640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddc0005cc0 tx=0x7fddc0031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.581+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0003b70 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.581+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc00318f0 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.581+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd019f5b0 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.581+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc002f950 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.581+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd01a5cd0 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.582+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd01031c0 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.584+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fddc002fb10 con 0x7fddd0109170 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.585+0000 7fddc7fff640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 0x7fddbc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.585+0000 7fddceffd640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 0x7fddbc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:56.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.585+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7fddc0106940 con 0x7fddd0109170 2024-09-10T21:52:56.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.585+0000 7fddceffd640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 0x7fddbc0b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009fc0 tx=0x7fddc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:56.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.588+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fddc00cdca0 con 0x7fddd0109170 2024-09-10T21:52:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.774+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fddd019a3a0 con 0x7fddd0109170 2024-09-10T21:52:56.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.969+0000 7fddc7fff640 1 -- 172.21.15.39:0/2328284422 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) ==== 138+0+0 (secure 0 0 0) 0x7fddd019a3a0 con 0x7fddd0109170 2024-09-10T21:52:56.971 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 msgr2=0x7fddbc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 0x7fddbc0b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009fc0 tx=0x7fddc8005f90 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 msgr2=0x7fddd019eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddc0005cc0 tx=0x7fddc0031700 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 shutdown_connections 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddbc0b5360 0x7fddbc0b7820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd0109170 0x7fddd019eb50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd01087f0 0x7fddd01997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 --2- 172.21.15.39:0/2328284422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0102de0 0x7fddd0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:56.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 >> 172.21.15.39:0/2328284422 conn(0x7fddd00fe830 msgr2=0x7fddd0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:56.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 shutdown_connections 2024-09-10T21:52:56.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:56.972+0000 7fddd565d640 1 -- 172.21.15.39:0/2328284422 wait complete. 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:56 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:56 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:52:57.274 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:56 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:52:57.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T21:52:57.817 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:52:58.208 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:57 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:52:58.209 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:57 smithi039 ceph-mon[30872]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:52:58.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:57 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:52:58.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:57 smithi173 ceph-mon[35294]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:52:58.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 -- 172.21.15.39:0/3487000042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54810d0e0 msgr2=0x7fe54810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:58.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 --2- 172.21.15.39:0/3487000042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54810d0e0 0x7fe54810f550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe540009ca0 tx=0x7fe54002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 -- 172.21.15.39:0/3487000042 shutdown_connections 2024-09-10T21:52:58.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 --2- 172.21.15.39:0/3487000042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54810d0e0 0x7fe54810f550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 --2- 172.21.15.39:0/3487000042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 0x7fe54810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 --2- 172.21.15.39:0/3487000042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe548103b30 0x7fe548103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 -- 172.21.15.39:0/3487000042 >> 172.21.15.39:0/3487000042 conn(0x7fe5480fd700 msgr2=0x7fe5480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 -- 172.21.15.39:0/3487000042 shutdown_connections 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.300+0000 7fe54e5de640 1 -- 172.21.15.39:0/3487000042 wait complete. 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 Processor -- start 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 -- start start 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 0x7fe548199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe54810d0e0 0x7fe54819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe548112db0 con 0x7fe548103b30 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe548112c30 con 0x7fe548104530 2024-09-10T21:52:58.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54e5de640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe548112f30 con 0x7fe54810d0e0 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48528/0 (socket says 172.21.15.39:48528) 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 -- 172.21.15.39:0/2224480866 learned_addr learned my addr 172.21.15.39:0/2224480866 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe54cb7b640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe54810d0e0 0x7fe54819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe53ffff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 0x7fe548199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 -- 172.21.15.39:0/2224480866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe54810d0e0 msgr2=0x7fe54819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe54810d0e0 0x7fe54819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 -- 172.21.15.39:0/2224480866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 msgr2=0x7fe548199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 0x7fe548199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 -- 172.21.15.39:0/2224480866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54819f370 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.301+0000 7fe547fff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9f0 tx=0x7fe53800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.302+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53800cd80 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.302+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54819f660 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.302+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5380108e0 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.302+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538018980 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.302+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481a5ef0 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.303+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54806b150 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.304+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe538010430 con 0x7fe548103b30 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.305+0000 7fe545ffb640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 0x7fe5340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:52:58.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.306+0000 7fe53ffff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 0x7fe5340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:52:58.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.306+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7497+0+0 (secure 0 0 0) 0x7fe5380e60a0 con 0x7fe548103b30 2024-09-10T21:52:58.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.306+0000 7fe53ffff640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 0x7fe5340b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5480fff70 tx=0x7fe53000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:52:58.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.309+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe5380acc40 con 0x7fe548103b30 2024-09-10T21:52:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:57 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2328284422' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:52:58.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:57 smithi070 ceph-mon[34909]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:52:58.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.497+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe548103f10 con 0x7fe548103b30 2024-09-10T21:52:58.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.987+0000 7fe545ffb640 1 -- 172.21.15.39:0/2224480866 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) ==== 170+0+0 (secure 0 0 0) 0x7fe5380b1670 con 0x7fe548103b30 2024-09-10T21:52:58.989 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-09-10T21:52:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.989+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 msgr2=0x7fe5340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.989+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 0x7fe5340b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5480fff70 tx=0x7fe53000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.989+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 msgr2=0x7fe5481992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.989+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9f0 tx=0x7fe53800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 shutdown_connections 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5340b52e0 0x7fe5340b77a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe54810d0e0 0x7fe54819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe548104530 0x7fe548199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 --2- 172.21.15.39:0/2224480866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe548103b30 0x7fe5481992c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 >> 172.21.15.39:0/2224480866 conn(0x7fe5480fd700 msgr2=0x7fe5480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 shutdown_connections 2024-09-10T21:52:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:52:58.990+0000 7fe54e5de640 1 -- 172.21.15.39:0/2224480866 wait complete. 2024-09-10T21:52:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:58 smithi173 ceph-mon[35294]: pgmap v274: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:58 smithi173 ceph-mon[35294]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:52:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:58 smithi173 ceph-mon[35294]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:52:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:58 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:52:59.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:58 smithi039 ceph-mon[30872]: pgmap v274: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:59.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:58 smithi039 ceph-mon[30872]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:52:59.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:58 smithi039 ceph-mon[30872]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:52:59.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:58 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:52:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:58 smithi070 ceph-mon[34909]: pgmap v274: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:52:59.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:58 smithi070 ceph-mon[34909]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:52:59.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:58 smithi070 ceph-mon[34909]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:52:59.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:58 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:52:59.617 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T21:52:59.876 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:00.249 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:59 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:53:00.249 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:52:59 smithi039 ceph-mon[30872]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:53:00.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 -- 172.21.15.39:0/3200596412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 msgr2=0x7f85b8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:00.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 --2- 172.21.15.39:0/3200596412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8108c10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009900 tx=0x7f85ac02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 -- 172.21.15.39:0/3200596412 shutdown_connections 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 --2- 172.21.15.39:0/3200596412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 0x7f85b810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 --2- 172.21.15.39:0/3200596412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8108c10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 --2- 172.21.15.39:0/3200596412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.332+0000 7f85be776640 1 -- 172.21.15.39:0/3200596412 >> 172.21.15.39:0/3200596412 conn(0x7f85b80fe830 msgr2=0x7f85b8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.333+0000 7f85be776640 1 -- 172.21.15.39:0/3200596412 shutdown_connections 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.333+0000 7f85be776640 1 -- 172.21.15.39:0/3200596412 wait complete. 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.333+0000 7f85be776640 1 Processor -- start 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.333+0000 7f85be776640 1 -- start start 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:00.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 0x7f85b819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8112e50 con 0x7f85b81087d0 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8112cd0 con 0x7f85b8102dc0 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85be776640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8112fd0 con 0x7f85b8109150 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34312/0 (socket says 172.21.15.39:34312) 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 -- 172.21.15.39:0/3804154506 learned_addr learned my addr 172.21.15.39:0/3804154506 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85bcd13640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 0x7f85b819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b7fff640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 -- 172.21.15.39:0/3804154506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 msgr2=0x7f85b819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 0x7f85b819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 -- 172.21.15.39:0/3804154506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 msgr2=0x7f85b8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:00.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 -- 172.21.15.39:0/3804154506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b819f4f0 con 0x7f85b81087d0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b7fff640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.334+0000 7f85b77fe640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85ac006010 tx=0x7f85ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.335+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac03f030 con 0x7f85b81087d0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.335+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85ac003800 con 0x7f85b81087d0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.335+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b819f780 con 0x7f85b81087d0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.335+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac035070 con 0x7f85b81087d0 2024-09-10T21:53:00.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.335+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b81a5ea0 con 0x7f85b81087d0 2024-09-10T21:53:00.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.336+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b8103220 con 0x7f85b81087d0 2024-09-10T21:53:00.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.338+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f85ac031b10 con 0x7f85b81087d0 2024-09-10T21:53:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.339+0000 7f85b57fa640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 0x7f85a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.339+0000 7f85b7fff640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 0x7f85a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.339+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7879+0+0 (secure 0 0 0) 0x7f85ac106630 con 0x7f85b81087d0 2024-09-10T21:53:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.339+0000 7f85b7fff640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 0x7f85a00b7820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009930 tx=0x7f85a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.342+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85ac0cd600 con 0x7f85b81087d0 2024-09-10T21:53:00.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:59 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:53:00.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:52:59 smithi070 ceph-mon[34909]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:53:00.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:59 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2224480866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:53:00.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:52:59 smithi173 ceph-mon[35294]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:53:00.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:00.563+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f85b819a570 con 0x7f85b81087d0 2024-09-10T21:53:01.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.014+0000 7f85b57fa640 1 -- 172.21.15.39:0/3804154506 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f85b819a570 con 0x7f85b81087d0 2024-09-10T21:53:01.015 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T21:53:01.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 msgr2=0x7f85a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 0x7f85a00b7820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009930 tx=0x7f85a8008040 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 msgr2=0x7f85b8199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85ac006010 tx=0x7f85ac0042f0 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 shutdown_connections 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f85a00b5360 0x7f85a00b7820 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85b8109150 0x7f85b819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b81087d0 0x7f85b8199980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 --2- 172.21.15.39:0/3804154506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85b8102dc0 0x7f85b8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 >> 172.21.15.39:0/3804154506 conn(0x7f85b80fe830 msgr2=0x7f85b8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 shutdown_connections 2024-09-10T21:53:01.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:01.017+0000 7f85be776640 1 -- 172.21.15.39:0/3804154506 wait complete. 2024-09-10T21:53:01.336 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:01 smithi039 ceph-mon[30872]: pgmap v277: 97 pgs: 3 creating+activating, 15 creating+peering, 9 active+clean, 70 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:01.336 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:01 smithi039 ceph-mon[30872]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:53:01.336 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:01 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:53:01.336 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:01 smithi039 ceph-mon[30872]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:53:01.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:00 smithi070 ceph-mon[34909]: pgmap v277: 97 pgs: 3 creating+activating, 15 creating+peering, 9 active+clean, 70 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:00 smithi070 ceph-mon[34909]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:53:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:00 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:53:01.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:00 smithi070 ceph-mon[34909]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:53:01.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:00 smithi173 ceph-mon[35294]: pgmap v277: 97 pgs: 3 creating+activating, 15 creating+peering, 9 active+clean, 70 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:01.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:00 smithi173 ceph-mon[35294]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:53:01.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:00 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:53:01.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:00 smithi173 ceph-mon[35294]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:53:01.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:53:01.891 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:active 2024-09-10T21:53:02.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:02 smithi039 ceph-mon[30872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.363+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2888565524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810b350 msgr2=0x7fd578111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.363+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2888565524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810b350 0x7fd578111b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd570009ca0 tx=0x7fd57002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2888565524 shutdown_connections 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2888565524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810b350 0x7fd578111b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2888565524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810a9d0 0x7fd57810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2888565524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 0x7fd5781053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2888565524 >> 172.21.15.39:0/2888565524 conn(0x7fd5781009f0 msgr2=0x7fd578102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2888565524 shutdown_connections 2024-09-10T21:53:02.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2888565524 wait complete. 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 Processor -- start 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 -- start start 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.364+0000 7fd57f8c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 0x7fd57819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810b350 0x7fd5781a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd578114f80 con 0x7fd57810a9d0 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd578114e00 con 0x7fd578104fc0 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd578115100 con 0x7fd57810b350 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34316/0 (socket says 172.21.15.39:34316) 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 -- 172.21.15.39:0/2526877488 learned_addr learned my addr 172.21.15.39:0/2526877488 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:02.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57d65d640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 0x7fd57819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57de5e640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810b350 0x7fd5781a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 -- 172.21.15.39:0/2526877488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810b350 msgr2=0x7fd5781a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810b350 0x7fd5781a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 -- 172.21.15.39:0/2526877488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 msgr2=0x7fd57819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 0x7fd57819b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 -- 172.21.15.39:0/2526877488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5781a14e0 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57ce5c640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c970 tx=0x7fd56800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568007bb0 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd568007d50 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5781a17d0 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56800f450 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.365+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5781a7e90 con 0x7fd57810a9d0 2024-09-10T21:53:02.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.366+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5781053a0 con 0x7fd57810a9d0 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.368+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd568004f00 con 0x7fd57810a9d0 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.368+0000 7fd56e7fc640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 0x7fd5640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.369+0000 7fd57d65d640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 0x7fd5640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.369+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fd5680e5b20 con 0x7fd57810a9d0 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.369+0000 7fd57d65d640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 0x7fd5640b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5740058c0 tx=0x7fd57400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:02.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.372+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd568014030 con 0x7fd57810a9d0 2024-09-10T21:53:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:53:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:53:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:53:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:53:02.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:active 2024-09-10T21:53:02.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:02 smithi070 ceph-mon[34909]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3804154506' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] up:active 2024-09-10T21:53:02.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:02 smithi173 ceph-mon[35294]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:02.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.558+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd57819c560 con 0x7fd57810a9d0 2024-09-10T21:53:02.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.560+0000 7fd56e7fc640 1 -- 172.21.15.39:0/2526877488 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+22219 (secure 0 0 0) 0x7fd57819c560 con 0x7fd57810a9d0 2024-09-10T21:53:02.561 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:02.561 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:00.566056+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 msgr2=0x7fd5640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 0x7fd5640b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5740058c0 tx=0x7fd57400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 msgr2=0x7fd57819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c970 tx=0x7fd56800ce30 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 shutdown_connections 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5640b5360 0x7fd5640b7820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd57810b350 0x7fd5781a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd57810a9d0 0x7fd57819b970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 --2- 172.21.15.39:0/2526877488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd578104fc0 0x7fd57819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:02.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 >> 172.21.15.39:0/2526877488 conn(0x7fd5781009f0 msgr2=0x7fd578102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:02.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 shutdown_connections 2024-09-10T21:53:02.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:02.562+0000 7fd57f8c1640 1 -- 172.21.15.39:0/2526877488 wait complete. 2024-09-10T21:53:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:03 smithi039 ceph-mon[30872]: pgmap v280: 97 pgs: 3 creating+activating, 21 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:03 smithi039 ceph-mon[30872]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:53:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:03 smithi039 ceph-mon[30872]: Cluster is now healthy 2024-09-10T21:53:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:03 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2526877488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:03.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:53:03.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:03 smithi070 ceph-mon[34909]: pgmap v280: 97 pgs: 3 creating+activating, 21 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:03.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:03 smithi070 ceph-mon[34909]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:53:03.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:03 smithi070 ceph-mon[34909]: Cluster is now healthy 2024-09-10T21:53:03.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:03 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2526877488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:03 smithi173 ceph-mon[35294]: pgmap v280: 97 pgs: 3 creating+activating, 21 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:53:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:03 smithi173 ceph-mon[35294]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:53:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:03 smithi173 ceph-mon[35294]: Cluster is now healthy 2024-09-10T21:53:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:03 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2526877488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:03.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.955+0000 7f47f8c80640 1 -- 172.21.15.39:0/2697802392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4102dc0 msgr2=0x7f47f41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.955+0000 7f47f8c80640 1 --2- 172.21.15.39:0/2697802392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4102dc0 0x7f47f41031a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 -- 172.21.15.39:0/2697802392 shutdown_connections 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 --2- 172.21.15.39:0/2697802392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f4109150 0x7f47f410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 --2- 172.21.15.39:0/2697802392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f41087d0 0x7f47f4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 --2- 172.21.15.39:0/2697802392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4102dc0 0x7f47f41031a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 -- 172.21.15.39:0/2697802392 >> 172.21.15.39:0/2697802392 conn(0x7f47f40fe830 msgr2=0x7f47f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 -- 172.21.15.39:0/2697802392 shutdown_connections 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 -- 172.21.15.39:0/2697802392 wait complete. 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 Processor -- start 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.956+0000 7f47f8c80640 1 -- start start 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4102dc0 0x7f47f419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:03.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f41087d0 0x7f47f419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4112dd0 con 0x7f47f4109150 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4112c50 con 0x7f47f41087d0 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4112f50 con 0x7f47f4102dc0 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34344/0 (socket says 172.21.15.39:34344) 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 -- 172.21.15.39:0/149546706 learned_addr learned my addr 172.21.15.39:0/149546706 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f259c640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4102dc0 0x7f47f419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f1d9b640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f41087d0 0x7f47f419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 -- 172.21.15.39:0/149546706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4102dc0 msgr2=0x7f47f419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4102dc0 0x7f47f419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 -- 172.21.15.39:0/149546706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f41087d0 msgr2=0x7f47f419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:03.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f41087d0 0x7f47f419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 -- 172.21.15.39:0/149546706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41a1570 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f2d9d640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00eaa0 tx=0x7f47ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00cdb0 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f41a1860 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.957+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47ec005020 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.958+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0116d0 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.958+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a7f20 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.959+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f41031a0 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.960+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f47ec00f040 con 0x7f47f4109150 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.961+0000 7f47e37fe640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 0x7f47dc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.961+0000 7f47f259c640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 0x7f47dc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:03.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.961+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f47ec0e5930 con 0x7f47f4109150 2024-09-10T21:53:03.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.961+0000 7f47f259c640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 0x7f47dc0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031440 tx=0x7f47e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:03.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:03.965+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f47ec016030 con 0x7f47f4109150 2024-09-10T21:53:04.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.151+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47f402e5c0 con 0x7f47f4109150 2024-09-10T21:53:04.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.153+0000 7f47e37fe640 1 -- 172.21.15.39:0/149546706 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+22219 (secure 0 0 0) 0x7f47ec0ac940 con 0x7f47f4109150 2024-09-10T21:53:04.153 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:04.154 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:00.566056+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 msgr2=0x7f47dc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 0x7f47dc0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031440 tx=0x7f47e4005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 msgr2=0x7f47f41a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00eaa0 tx=0x7f47ec00ef60 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 shutdown_connections 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f47dc0b52e0 0x7f47dc0b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47f4109150 0x7f47f41a0da0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47f41087d0 0x7f47f419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 --2- 172.21.15.39:0/149546706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4102dc0 0x7f47f419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 >> 172.21.15.39:0/149546706 conn(0x7f47f40fe830 msgr2=0x7f47f4104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 shutdown_connections 2024-09-10T21:53:04.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:04.155+0000 7f47f8c80640 1 -- 172.21.15.39:0/149546706 wait complete. 2024-09-10T21:53:04.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T21:53:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:05.270 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:05 smithi039 ceph-mon[30872]: pgmap v281: 97 pgs: 6 creating+peering, 84 active+clean, 7 unknown; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-10T21:53:05.270 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:05 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/149546706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:05.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:05 smithi070 ceph-mon[34909]: pgmap v281: 97 pgs: 6 creating+peering, 84 active+clean, 7 unknown; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-10T21:53:05.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:05 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/149546706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 -- 172.21.15.39:0/3599044377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20102dc0 msgr2=0x7f0f201031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/3599044377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20102dc0 0x7f0f201031a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009900 tx=0x7f0f1c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 -- 172.21.15.39:0/3599044377 shutdown_connections 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/3599044377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20109150 0x7f0f2010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/3599044377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 0x7f0f20108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/3599044377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20102dc0 0x7f0f201031a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 -- 172.21.15.39:0/3599044377 >> 172.21.15.39:0/3599044377 conn(0x7f0f200fe830 msgr2=0x7f0f20100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 -- 172.21.15.39:0/3599044377 shutdown_connections 2024-09-10T21:53:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.456+0000 7f0f27c6f640 1 -- 172.21.15.39:0/3599044377 wait complete. 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 Processor -- start 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 -- start start 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20102dc0 0x7f0f200754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 0x7f0f200759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112e50 con 0x7f0f20109150 2024-09-10T21:53:05.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112cd0 con 0x7f0f201087d0 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f27c6f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112fd0 con 0x7f0f20102dc0 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34370/0 (socket says 172.21.15.39:34370) 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 -- 172.21.15.39:0/1644218909 learned_addr learned my addr 172.21.15.39:0/1644218909 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2520a640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 0x7f0f200759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f25a0b640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20102dc0 0x7f0f200754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 -- 172.21.15.39:0/1644218909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20102dc0 msgr2=0x7f0f200754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20102dc0 0x7f0f200754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 -- 172.21.15.39:0/1644218909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 msgr2=0x7f0f200759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 0x7f0f200759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.457+0000 7f0f2620c640 1 -- 172.21.15.39:0/1644218909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f201a7860 con 0x7f0f20109150 2024-09-10T21:53:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f2620c640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800b970 tx=0x7f0f1800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18019070 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f18014440 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f201a7b50 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180075d0 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.458+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f201a8090 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.459+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20103220 con 0x7f0f20109150 2024-09-10T21:53:05.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.461+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0f180145f0 con 0x7f0f20109150 2024-09-10T21:53:05.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.461+0000 7f0f16ffd640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 0x7f0f0c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:05.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.461+0000 7f0f25a0b640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 0x7f0f0c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:05.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.461+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f0f180e5630 con 0x7f0f20109150 2024-09-10T21:53:05.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.462+0000 7f0f25a0b640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 0x7f0f0c0b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c031440 tx=0x7f0f1c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:05.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.464+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f180ac640 con 0x7f0f20109150 2024-09-10T21:53:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:05 smithi173 ceph-mon[35294]: pgmap v281: 97 pgs: 6 creating+peering, 84 active+clean, 7 unknown; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-10T21:53:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:05 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/149546706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:05.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:05.690+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0f2002e5c0 con 0x7f0f20109150 2024-09-10T21:53:06.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.035+0000 7f0f16ffd640 1 -- 172.21.15.39:0/1644218909 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f0f180abf40 con 0x7f0f20109150 2024-09-10T21:53:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 msgr2=0x7f0f0c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 0x7f0f0c0b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c031440 tx=0x7f0f1c0095f0 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 msgr2=0x7f0f20075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800b970 tx=0x7f0f1800bd70 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 shutdown_connections 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f0c0b52e0 0x7f0f0c0b77a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f20109150 0x7f0f20075f20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f201087d0 0x7f0f200759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 --2- 172.21.15.39:0/1644218909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f20102dc0 0x7f0f200754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 >> 172.21.15.39:0/1644218909 conn(0x7f0f200fe830 msgr2=0x7f0f20100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 shutdown_connections 2024-09-10T21:53:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:06.039+0000 7f0f27c6f640 1 -- 172.21.15.39:0/1644218909 wait complete. 2024-09-10T21:53:06.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:06 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:53:06.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:06 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:53:06.406 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:53:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T21:53:06.155+0000 7fb90b7ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:53:06.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:06 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:53:06.700 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T21:53:06.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T21:53:06.960 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:07.344 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:07 smithi070 ceph-mon[34909]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:53:07.344 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:07 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:53:07.345 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:07 smithi070 ceph-mon[34909]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:07.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:07 smithi039 ceph-mon[30872]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:53:07.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:07 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:53:07.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:07 smithi039 ceph-mon[30872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:07.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 -- 172.21.15.39:0/383788683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 msgr2=0x7f5ddc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:07.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 --2- 172.21.15.39:0/383788683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc102070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009ca0 tx=0x7f5dcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 -- 172.21.15.39:0/383788683 shutdown_connections 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 --2- 172.21.15.39:0/383788683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 0x7f5ddc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 --2- 172.21.15.39:0/383788683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 0x7f5ddc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 --2- 172.21.15.39:0/383788683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc102070 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 -- 172.21.15.39:0/383788683 >> 172.21.15.39:0/383788683 conn(0x7f5ddc0fd700 msgr2=0x7f5ddc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 -- 172.21.15.39:0/383788683 shutdown_connections 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.446+0000 7f5de15ab640 1 -- 172.21.15.39:0/383788683 wait complete. 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 Processor -- start 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 -- start start 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 0x7f5ddc1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 0x7f5ddc19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:07.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc111d20 con 0x7f5ddc101c90 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc111ba0 con 0x7f5ddc1076a0 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.447+0000 7f5de15ab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc111ea0 con 0x7f5ddc108020 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34388/0 (socket says 172.21.15.39:34388) 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 -- 172.21.15.39:0/4151565717 learned_addr learned my addr 172.21.15.39:0/4151565717 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5dda7fc640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 0x7f5ddc1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddb7fe640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 0x7f5ddc19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 -- 172.21.15.39:0/4151565717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 msgr2=0x7f5ddc19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 0x7f5ddc19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 -- 172.21.15.39:0/4151565717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 msgr2=0x7f5ddc1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 0x7f5ddc1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:07.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 -- 172.21.15.39:0/4151565717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc19f510 con 0x7f5ddc101c90 2024-09-10T21:53:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5ddaffd640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02ade0 tx=0x7f5dcc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc003d60 con 0x7f5ddc101c90 2024-09-10T21:53:07.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dcc0044f0 con 0x7f5ddc101c90 2024-09-10T21:53:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc02fd10 con 0x7f5ddc101c90 2024-09-10T21:53:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc19f7a0 con 0x7f5ddc101c90 2024-09-10T21:53:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.448+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc1a5ec0 con 0x7f5ddc101c90 2024-09-10T21:53:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.449+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc1020f0 con 0x7f5ddc101c90 2024-09-10T21:53:07.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.451+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5dcc004040 con 0x7f5ddc101c90 2024-09-10T21:53:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.452+0000 7f5dd3fff640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 0x7f5dc80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.452+0000 7f5dda7fc640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 0x7f5dc80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.452+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f5dcc107190 con 0x7f5ddc101c90 2024-09-10T21:53:07.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.452+0000 7f5dda7fc640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 0x7f5dc80b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc1073f0 tx=0x7f5dc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:07.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.455+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5dcc03b410 con 0x7f5ddc101c90 2024-09-10T21:53:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:07 smithi173 ceph-mon[35294]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:53:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:07 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1644218909' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:53:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:07 smithi173 ceph-mon[35294]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:07.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:07.681+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f5ddc10ae70 con 0x7f5ddc101c90 2024-09-10T21:53:08.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.059+0000 7f5dd3fff640 1 -- 172.21.15.39:0/4151565717 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f5dcc0ce140 con 0x7f5ddc101c90 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 msgr2=0x7f5dc80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 0x7f5dc80b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc1073f0 tx=0x7f5dc4008040 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 msgr2=0x7f5ddc199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02ade0 tx=0x7f5dcc003970 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 shutdown_connections 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5dc80b5360 0x7f5dc80b7820 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ddc108020 0x7f5ddc19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ddc1076a0 0x7f5ddc1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 --2- 172.21.15.39:0/4151565717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ddc101c90 0x7f5ddc199460 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 >> 172.21.15.39:0/4151565717 conn(0x7f5ddc0fd700 msgr2=0x7f5ddc06ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.061+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 shutdown_connections 2024-09-10T21:53:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:08.062+0000 7f5de15ab640 1 -- 172.21.15.39:0/4151565717 wait complete. 2024-09-10T21:53:08.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:08 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:53:08.358 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:08 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:53:08.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:08 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:53:08.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T21:53:08.933 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:53:09.346 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:09 smithi039 ceph-mon[30872]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:53:09.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 -- 172.21.15.39:0/1791580519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 msgr2=0x7fcca01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:09.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/1791580519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca01031a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009900 tx=0x7fcc9402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 -- 172.21.15.39:0/1791580519 shutdown_connections 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/1791580519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/1791580519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 0x7fcca0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/1791580519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca01031a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 -- 172.21.15.39:0/1791580519 >> 172.21.15.39:0/1791580519 conn(0x7fcca00fe830 msgr2=0x7fcca0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 -- 172.21.15.39:0/1791580519 shutdown_connections 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 -- 172.21.15.39:0/1791580519 wait complete. 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.365+0000 7fcca6fb5640 1 Processor -- start 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 -- start start 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 0x7fcca019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca01a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:09.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0112e10 con 0x7fcca0102dc0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0112c90 con 0x7fcca0109150 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca6fb5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0112f90 con 0x7fcca01087d0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34414/0 (socket says 172.21.15.39:34414) 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 -- 172.21.15.39:0/4264218132 learned_addr learned my addr 172.21.15.39:0/4264218132 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca5552640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca01a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcc9ffff640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 0x7fcca019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 -- 172.21.15.39:0/4264218132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 msgr2=0x7fcca019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 0x7fcca019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 -- 172.21.15.39:0/4264218132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 msgr2=0x7fcca01a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca01a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca4d51640 1 -- 172.21.15.39:0/4264218132 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01a1580 con 0x7fcca0102dc0 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.366+0000 7fcca5552640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca01a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:09.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcca4d51640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc94005940 tx=0x7fcc94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:09.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9403f030 con 0x7fcca0102dc0 2024-09-10T21:53:09.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01a1810 con 0x7fcca0102dc0 2024-09-10T21:53:09.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc94003aa0 con 0x7fcca0102dc0 2024-09-10T21:53:09.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94035070 con 0x7fcca0102dc0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.367+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca01a7f30 con 0x7fcca0102dc0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.368+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca01031a0 con 0x7fcca0102dc0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.369+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fcc9403bce0 con 0x7fcca0102dc0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.370+0000 7fcc9dffb640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 0x7fcc900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.370+0000 7fcc9ffff640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 0x7fcc900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.370+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fcc94106510 con 0x7fcca0102dc0 2024-09-10T21:53:09.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.371+0000 7fcc9ffff640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 0x7fcc900b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcca01082a0 tx=0x7fcc8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:09.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.374+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc940cd520 con 0x7fcca0102dc0 2024-09-10T21:53:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T21:53:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:53:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:53:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:53:09.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:09.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:53:09.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:09 smithi070 ceph-mon[34909]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4151565717' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:53:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:09 smithi173 ceph-mon[35294]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:53:09.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:09.597+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fcca002e5c0 con 0x7fcca0102dc0 2024-09-10T21:53:10.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.082+0000 7fcc9dffb640 1 -- 172.21.15.39:0/4264218132 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fcc940cce20 con 0x7fcca0102dc0 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 msgr2=0x7fcc900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 0x7fcc900b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcca01082a0 tx=0x7fcc8c005f90 comp rx=0 tx=0).stop 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 msgr2=0x7fcca019b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc94005940 tx=0x7fcc94004270 comp rx=0 tx=0).stop 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 shutdown_connections 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcc900b52e0 0x7fcc900b77a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:10.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcca0109150 0x7fcca01a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:10.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca01087d0 0x7fcca019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:10.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 --2- 172.21.15.39:0/4264218132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcca0102dc0 0x7fcca019b4d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:10.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 >> 172.21.15.39:0/4264218132 conn(0x7fcca00fe830 msgr2=0x7fcca0104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:10.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 shutdown_connections 2024-09-10T21:53:10.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:10.085+0000 7fcca6fb5640 1 -- 172.21.15.39:0/4264218132 wait complete. 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:active 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:53:10.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:10 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:53:10.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:active 2024-09-10T21:53:10.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:53:10.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:53:10.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:53:10.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:53:10.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:10 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] up:active 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:53:10.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:10 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:53:10.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T21:53:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:11.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: pgmap v284: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:active 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:53:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:11 smithi039 ceph-mon[30872]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T21:53:11.155+0000 7fb90b7ac640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T21:53:11.155+0000 7fb90b7ac640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T21:53:11.155+0000 7fb90b7ac640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: pgmap v284: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:active 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:53:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:11 smithi070 ceph-mon[34909]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: pgmap v284: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4264218132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] up:active 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:53:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:11 smithi173 ceph-mon[35294]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 -- 172.21.15.39:0/1126824929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 msgr2=0x7fcd1c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 --2- 172.21.15.39:0/1126824929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c108c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009900 tx=0x7fcd1002a410 comp rx=0 tx=0).stop 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 -- 172.21.15.39:0/1126824929 shutdown_connections 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 --2- 172.21.15.39:0/1126824929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 0x7fcd1c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 --2- 172.21.15.39:0/1126824929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c108c10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 --2- 172.21.15.39:0/1126824929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:11.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 -- 172.21.15.39:0/1126824929 >> 172.21.15.39:0/1126824929 conn(0x7fcd1c0fe830 msgr2=0x7fcd1c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 -- 172.21.15.39:0/1126824929 shutdown_connections 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.526+0000 7fcd23092640 1 -- 172.21.15.39:0/1126824929 wait complete. 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 Processor -- start 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 -- start start 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 0x7fcd1c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c112dd0 con 0x7fcd1c1087d0 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c112c50 con 0x7fcd1c102dc0 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd23092640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c112f50 con 0x7fcd1c109150 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.527+0000 7fcd1bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53618/0 (socket says 172.21.15.39:53618) 2024-09-10T21:53:11.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 -- 172.21.15.39:0/1310081241 learned_addr learned my addr 172.21.15.39:0/1310081241 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd20e2e640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd2162f640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 0x7fcd1c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 -- 172.21.15.39:0/1310081241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 msgr2=0x7fcd1c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 0x7fcd1c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 -- 172.21.15.39:0/1310081241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 msgr2=0x7fcd1c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 -- 172.21.15.39:0/1310081241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c19f390 con 0x7fcd1c1087d0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd20e2e640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd1bfff640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005940 tx=0x7fcd100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1003f030 con 0x7fcd1c1087d0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd10003cb0 con 0x7fcd1c1087d0 2024-09-10T21:53:11.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c19f620 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.528+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10035070 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.529+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c1a5d40 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.530+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c1031a0 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.531+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fcd1003bbf0 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.532+0000 7fcd19ffb640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 0x7fcd040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.532+0000 7fcd20e2e640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 0x7fcd040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.532+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fcd10106920 con 0x7fcd1c1087d0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.533+0000 7fcd20e2e640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 0x7fcd040b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0058c0 tx=0x7fcd0c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:11.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.535+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd100cd910 con 0x7fcd1c1087d0 2024-09-10T21:53:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:11.760+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fcd1c19a410 con 0x7fcd1c1087d0 2024-09-10T21:53:12.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.255+0000 7fcd19ffb640 1 -- 172.21.15.39:0/1310081241 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fcd100cd210 con 0x7fcd1c1087d0 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 msgr2=0x7fcd040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 0x7fcd040b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0058c0 tx=0x7fcd0c005ec0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 msgr2=0x7fcd1c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005940 tx=0x7fcd100042f0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 shutdown_connections 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd040b5360 0x7fcd040b7820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd1c109150 0x7fcd1c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1c1087d0 0x7fcd1c199820 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 --2- 172.21.15.39:0/1310081241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd1c102dc0 0x7fcd1c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:12.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 >> 172.21.15.39:0/1310081241 conn(0x7fcd1c0fe830 msgr2=0x7fcd1c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:12.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 shutdown_connections 2024-09-10T21:53:12.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:12.258+0000 7fcd23092640 1 -- 172.21.15.39:0/1310081241 wait complete. 2024-09-10T21:53:12.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:active 2024-09-10T21:53:12.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:53:12.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:53:12.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: Cluster is now healthy 2024-09-10T21:53:12.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:53:12.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:53:12.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:53:12.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:active 2024-09-10T21:53:12.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:12.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:12 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:active 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: Cluster is now healthy 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:active 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:12.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] up:active 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: Cluster is now healthy 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:53:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:53:12.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] up:active 2024-09-10T21:53:12.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:12.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:12 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:53:12.768 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T21:53:12.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T21:53:13.032 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:13 smithi070 ceph-mon[34909]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T21:53:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:13 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:53:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:13 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-mon[30872]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T21:53:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:53:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:13 smithi173 ceph-mon[35294]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T21:53:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:13 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1310081241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:53:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:13 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:53:13.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/194341210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 msgr2=0x7f1fa410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:13.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/194341210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa410f960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009ca0 tx=0x7f1f9c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/194341210 shutdown_connections 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/194341210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa410f960 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/194341210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41087e0 0x7f1fa4108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/194341210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa4102dd0 0x7f1fa41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/194341210 >> 172.21.15.39:0/194341210 conn(0x7f1fa40fe860 msgr2=0x7f1fa4100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/194341210 shutdown_connections 2024-09-10T21:53:13.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.497+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/194341210 wait complete. 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 Processor -- start 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 -- start start 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4102dd0 0x7f1fa40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa41087e0 0x7f1fa40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4112de0 con 0x7f1fa4109160 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4112c60 con 0x7f1fa41087e0 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa8b7a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4112f60 con 0x7f1fa4102dd0 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4102dd0 0x7f1fa40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53630/0 (socket says 172.21.15.39:53630) 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa2d9d640 1 -- 172.21.15.39:0/766310557 learned_addr learned my addr 172.21.15.39:0/766310557 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.498+0000 7f1fa1d9b640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa41087e0 0x7f1fa40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 -- 172.21.15.39:0/766310557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4102dd0 msgr2=0x7f1fa40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4102dd0 0x7f1fa40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 -- 172.21.15.39:0/766310557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa41087e0 msgr2=0x7f1fa40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa41087e0 0x7f1fa40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 -- 172.21.15.39:0/766310557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa41a7690 con 0x7f1fa4109160 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa2d9d640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005cc0 tx=0x7f1f9c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c003bf0 con 0x7f1fa4109160 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa41a7920 con 0x7f1fa4109160 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f9c003d90 con 0x7f1fa4109160 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c02fbc0 con 0x7f1fa4109160 2024-09-10T21:53:13.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.499+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa41a7eb0 con 0x7f1fa4109160 2024-09-10T21:53:13.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.500+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa41031b0 con 0x7f1fa4109160 2024-09-10T21:53:13.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.502+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1f9c004610 con 0x7f1fa4109160 2024-09-10T21:53:13.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.503+0000 7f1f937fe640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 0x7f1f8c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:13.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.503+0000 7f1fa259c640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 0x7f1f8c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:13.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.503+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f1f9c106ed0 con 0x7f1fa4109160 2024-09-10T21:53:13.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.503+0000 7f1fa259c640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 0x7f1f8c0b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400bbe0 tx=0x7f1f9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:13.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.507+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1f9c0cdee0 con 0x7f1fa4109160 2024-09-10T21:53:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.720+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1fa4063590 con 0x7f1f8c0b52e0 2024-09-10T21:53:13.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.748+0000 7f1f937fe640 1 -- 172.21.15.39:0/766310557 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1fa4063590 con 0x7f1f8c0b52e0 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 msgr2=0x7f1f8c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 0x7f1f8c0b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400bbe0 tx=0x7f1f9400b390 comp rx=0 tx=0).stop 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 msgr2=0x7f1fa4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005cc0 tx=0x7f1f9c02f380 comp rx=0 tx=0).stop 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 shutdown_connections 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1f8c0b52e0 0x7f1f8c0b77a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa4109160 0x7f1fa4075f20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa41087e0 0x7f1fa40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 --2- 172.21.15.39:0/766310557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4102dd0 0x7f1fa40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:13.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 >> 172.21.15.39:0/766310557 conn(0x7f1fa40fe860 msgr2=0x7f1fa4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:13.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 shutdown_connections 2024-09-10T21:53:13.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:13.750+0000 7f1fa8b7a640 1 -- 172.21.15.39:0/766310557 wait complete. 2024-09-10T21:53:14.108 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:53:13.725+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:53:14.108 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:53:13.725+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:53:14.108 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:53:13.725+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:53:14.108 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:53:13.725+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:53:14.108 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:53:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:53:13.725+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:53:14.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T21:53:14.701 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 -- 172.21.15.39:0/259873907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc1087d0 msgr2=0x7f18bc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 --2- 172.21.15.39:0/259873907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc1087d0 0x7f18bc108c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009ca0 tx=0x7f18ac02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 -- 172.21.15.39:0/259873907 shutdown_connections 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 --2- 172.21.15.39:0/259873907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 0x7f18bc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 --2- 172.21.15.39:0/259873907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc1087d0 0x7f18bc108c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 --2- 172.21.15.39:0/259873907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc102dc0 0x7f18bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 -- 172.21.15.39:0/259873907 >> 172.21.15.39:0/259873907 conn(0x7f18bc0fe830 msgr2=0x7f18bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 -- 172.21.15.39:0/259873907 shutdown_connections 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.181+0000 7f18c318e640 1 -- 172.21.15.39:0/259873907 wait complete. 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 Processor -- start 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 -- start start 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc1087d0 0x7f18bc199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 0x7f18bc19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112e50 con 0x7f18bc102dc0 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112cd0 con 0x7f18bc109150 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c318e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112fd0 con 0x7f18bc1087d0 2024-09-10T21:53:15.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53670/0 (socket says 172.21.15.39:53670) 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 -- 172.21.15.39:0/2534513061 learned_addr learned my addr 172.21.15.39:0/2534513061 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c172b640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 0x7f18bc19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18bbfff640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc1087d0 0x7f18bc199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 -- 172.21.15.39:0/2534513061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc1087d0 msgr2=0x7f18bc199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc1087d0 0x7f18bc199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 -- 172.21.15.39:0/2534513061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 msgr2=0x7f18bc19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 0x7f18bc19ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 -- 172.21.15.39:0/2534513061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc19f4d0 con 0x7f18bc102dc0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.182+0000 7f18c0f2a640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18a400b4a0 tx=0x7f18a400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.183+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4014070 con 0x7f18bc102dc0 2024-09-10T21:53:15.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.183+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18a4010ac0 con 0x7f18bc102dc0 2024-09-10T21:53:15.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.183+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18bc19f7c0 con 0x7f18bc102dc0 2024-09-10T21:53:15.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.183+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4017c30 con 0x7f18bc102dc0 2024-09-10T21:53:15.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.183+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18bc1a6050 con 0x7f18bc102dc0 2024-09-10T21:53:15.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.184+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18bc103220 con 0x7f18bc102dc0 2024-09-10T21:53:15.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.185+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f18a4010610 con 0x7f18bc102dc0 2024-09-10T21:53:15.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.186+0000 7f18b9ffb640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 0x7f18a80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:15.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.186+0000 7f18bbfff640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 0x7f18a80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:15.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.186+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f18a40e52b0 con 0x7f18bc102dc0 2024-09-10T21:53:15.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.186+0000 7f18bbfff640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 0x7f18a80b7820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009430 tx=0x7f18ac02f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:15.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.190+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f18a40ac2c0 con 0x7f18bc102dc0 2024-09-10T21:53:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.401+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f18bc063590 con 0x7f18a80b5360 2024-09-10T21:53:15.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:15 smithi039 ceph-mon[30872]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-09-10T21:53:15.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:15 smithi039 ceph-mon[30872]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:15.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:15 smithi070 ceph-mon[34909]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-09-10T21:53:15.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:15 smithi070 ceph-mon[34909]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:15.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.433+0000 7f18b9ffb640 1 -- 172.21.15.39:0/2534513061 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f18bc063590 con 0x7f18a80b5360 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 msgr2=0x7f18a80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 0x7f18a80b7820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009430 tx=0x7f18ac02f310 comp rx=0 tx=0).stop 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 msgr2=0x7f18bc199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18a400b4a0 tx=0x7f18a400b960 comp rx=0 tx=0).stop 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 shutdown_connections 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f18a80b5360 0x7f18a80b7820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18bc109150 0x7f18bc19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18bc1087d0 0x7f18bc199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 --2- 172.21.15.39:0/2534513061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18bc102dc0 0x7f18bc199420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 >> 172.21.15.39:0/2534513061 conn(0x7f18bc0fe830 msgr2=0x7f18bc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 shutdown_connections 2024-09-10T21:53:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:15.435+0000 7f18c318e640 1 -- 172.21.15.39:0/2534513061 wait complete. 2024-09-10T21:53:15.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:15 smithi173 ceph-mon[35294]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-09-10T21:53:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:15 smithi173 ceph-mon[35294]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:16.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T21:53:16.311 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:16.655 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 21:53:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T21:53:16.155+0000 7fb90b7ac640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 -- 172.21.15.39:0/905991021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8780102dc0 msgr2=0x7f87801031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 --2- 172.21.15.39:0/905991021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8780102dc0 0x7f87801031a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8774009900 tx=0x7f877402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 -- 172.21.15.39:0/905991021 shutdown_connections 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 --2- 172.21.15.39:0/905991021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780109150 0x7f878010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 --2- 172.21.15.39:0/905991021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87801087d0 0x7f8780108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 --2- 172.21.15.39:0/905991021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8780102dc0 0x7f87801031a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 -- 172.21.15.39:0/905991021 >> 172.21.15.39:0/905991021 conn(0x7f87800fe830 msgr2=0x7f8780100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:16.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 -- 172.21.15.39:0/905991021 shutdown_connections 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.756+0000 7f8786d3c640 1 -- 172.21.15.39:0/905991021 wait complete. 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 Processor -- start 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 -- start start 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 0x7f87800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8780109150 0x7f8780075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8780112dd0 con 0x7f87801087d0 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8780112c50 con 0x7f8780109150 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8786d3c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8780112f50 con 0x7f8780102dc0 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53688/0 (socket says 172.21.15.39:53688) 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 -- 172.21.15.39:0/3259796393 learned_addr learned my addr 172.21.15.39:0/3259796393 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f87852d9640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8780109150 0x7f8780075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:16.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8784ad8640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 0x7f87800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 -- 172.21.15.39:0/3259796393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 msgr2=0x7f87800754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 0x7f87800754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 -- 172.21.15.39:0/3259796393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8780109150 msgr2=0x7f8780075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8780109150 0x7f8780075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f877ffff640 1 -- 172.21.15.39:0/3259796393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87801a76e0 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.757+0000 7f8784ad8640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 0x7f87800754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f877ffff640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f876c00c920 tx=0x7f876c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c007c70 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87801a79d0 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f876c007e10 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c018820 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.758+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801a7f10 con 0x7f87801087d0 2024-09-10T21:53:16.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.759+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87801031a0 con 0x7f87801087d0 2024-09-10T21:53:16.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.760+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f876c00f450 con 0x7f87801087d0 2024-09-10T21:53:16.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.761+0000 7f877dffb640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 0x7f87700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:16.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.761+0000 7f8784ad8640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 0x7f87700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:16.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.761+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f876c0e6030 con 0x7f87801087d0 2024-09-10T21:53:16.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.762+0000 7f8784ad8640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 0x7f87700b7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8774000c00 tx=0x7f8774031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:16.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.764+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f876c014030 con 0x7f87801087d0 2024-09-10T21:53:16.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.978+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8780063590 con 0x7f87700b5370 2024-09-10T21:53:16.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.983+0000 7f877dffb640 1 -- 172.21.15.39:0/3259796393 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8780063590 con 0x7f87700b5370 2024-09-10T21:53:16.983 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_0/21c7bc69-552e-419f-9046-8cae17e6a6f7 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 msgr2=0x7f87700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 0x7f87700b7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8774000c00 tx=0x7f8774031400 comp rx=0 tx=0).stop 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 msgr2=0x7f87800759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f876c00c920 tx=0x7f876c00cde0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 shutdown_connections 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87700b5370 0x7f87700b7830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8780109150 0x7f8780075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87801087d0 0x7f87800759e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 --2- 172.21.15.39:0/3259796393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8780102dc0 0x7f87800754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:16.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 >> 172.21.15.39:0/3259796393 conn(0x7f87800fe830 msgr2=0x7f8780100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:16.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 shutdown_connections 2024-09-10T21:53:16.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:16.985+0000 7f8786d3c640 1 -- 172.21.15.39:0/3259796393 wait complete. 2024-09-10T21:53:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:17 smithi070 ceph-mon[34909]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:17 smithi070 ceph-mon[34909]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-09-10T21:53:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:17 smithi070 ceph-mon[34909]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:53:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:17 smithi039 ceph-mon[30872]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:17 smithi039 ceph-mon[30872]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-09-10T21:53:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:17 smithi039 ceph-mon[30872]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:53:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:17 smithi173 ceph-mon[35294]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:17 smithi173 ceph-mon[35294]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-09-10T21:53:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:17 smithi173 ceph-mon[35294]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:53:17.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T21:53:17.849 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:18.270 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:18 smithi039 ceph-mon[30872]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:18.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 -- 172.21.15.39:0/273010418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 msgr2=0x7f3790107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 --2- 172.21.15.39:0/273010418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790107ae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3780009900 tx=0x7f378002a410 comp rx=0 tx=0).stop 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 -- 172.21.15.39:0/273010418 shutdown_connections 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 --2- 172.21.15.39:0/273010418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790108020 0x7f379010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 --2- 172.21.15.39:0/273010418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790107ae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 --2- 172.21.15.39:0/273010418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790101c90 0x7f3790102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 -- 172.21.15.39:0/273010418 >> 172.21.15.39:0/273010418 conn(0x7f37900fd700 msgr2=0x7f37900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 -- 172.21.15.39:0/273010418 shutdown_connections 2024-09-10T21:53:18.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 -- 172.21.15.39:0/273010418 wait complete. 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.282+0000 7f379874b640 1 Processor -- start 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 -- start start 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790101c90 0x7f3790199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790108020 0x7f379019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3790111ce0 con 0x7f37901076a0 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3790111b60 con 0x7f3790108020 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f379874b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3790111e60 con 0x7f3790101c90 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53716/0 (socket says 172.21.15.39:53716) 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 -- 172.21.15.39:0/2886819449 learned_addr learned my addr 172.21.15.39:0/2886819449 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:18.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f37964e7640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790101c90 0x7f3790199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3796ce8640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790108020 0x7f379019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 -- 172.21.15.39:0/2886819449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790101c90 msgr2=0x7f3790199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790101c90 0x7f3790199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 -- 172.21.15.39:0/2886819449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790108020 msgr2=0x7f379019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790108020 0x7f379019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.283+0000 7f3795ce6640 1 -- 172.21.15.39:0/2886819449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379019f3c0 con 0x7f37901076a0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f3795ce6640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3780005940 tx=0x7f37800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378003f030 con 0x7f37901076a0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3780003cb0 con 0x7f37901076a0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780035070 con 0x7f37901076a0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379019f650 con 0x7f37901076a0 2024-09-10T21:53:18.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.284+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37901a5d70 con 0x7f37901076a0 2024-09-10T21:53:18.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.285+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3790102070 con 0x7f37901076a0 2024-09-10T21:53:18.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.286+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3780003800 con 0x7f37901076a0 2024-09-10T21:53:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.287+0000 7f37877fe640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 0x7f377c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.287+0000 7f37964e7640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 0x7f377c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.287+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f3780106650 con 0x7f37901076a0 2024-09-10T21:53:18.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.287+0000 7f37964e7640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 0x7f377c0b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f378c009990 tx=0x7f378c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:18.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.291+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37800cd560 con 0x7f37901076a0 2024-09-10T21:53:18.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:18 smithi070 ceph-mon[34909]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:18 smithi173 ceph-mon[35294]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.504+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3790104460 con 0x7f377c0b5370 2024-09-10T21:53:18.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.528+0000 7f37877fe640 1 -- 172.21.15.39:0/2886819449 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3790104460 con 0x7f377c0b5370 2024-09-10T21:53:18.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 msgr2=0x7f377c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:18.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 0x7f377c0b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f378c009990 tx=0x7f378c009110 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 msgr2=0x7f3790199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3780005940 tx=0x7f37800042f0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 shutdown_connections 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f377c0b5370 0x7f377c0b7830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3790108020 0x7f379019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37901076a0 0x7f3790199850 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 --2- 172.21.15.39:0/2886819449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790101c90 0x7f3790199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 >> 172.21.15.39:0/2886819449 conn(0x7f37900fd700 msgr2=0x7f379006adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 shutdown_connections 2024-09-10T21:53:18.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:18.531+0000 7f379874b640 1 -- 172.21.15.39:0/2886819449 wait complete. 2024-09-10T21:53:19.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T21:53:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:19 smithi070 ceph-mon[34909]: pgmap v288: 97 pgs: 97 active+clean; 609 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.3 KiB/s wr, 20 op/s 2024-09-10T21:53:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:19 smithi039 ceph-mon[30872]: pgmap v288: 97 pgs: 97 active+clean; 609 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.3 KiB/s wr, 20 op/s 2024-09-10T21:53:19.438 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:19 smithi173 ceph-mon[35294]: pgmap v288: 97 pgs: 97 active+clean; 609 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.3 KiB/s wr, 20 op/s 2024-09-10T21:53:19.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 -- 172.21.15.39:0/1697325282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b810d140 msgr2=0x7fc9b810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:19.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/1697325282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b810d140 0x7fc9b810f5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009ca0 tx=0x7fc9b002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 -- 172.21.15.39:0/1697325282 shutdown_connections 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/1697325282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b810d140 0x7fc9b810f5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/1697325282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 0x7fc9b810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/1697325282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b8103ce0 0x7fc9b81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 -- 172.21.15.39:0/1697325282 >> 172.21.15.39:0/1697325282 conn(0x7fc9b80fd700 msgr2=0x7fc9b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 -- 172.21.15.39:0/1697325282 shutdown_connections 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.906+0000 7fc9bdd48640 1 -- 172.21.15.39:0/1697325282 wait complete. 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 Processor -- start 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 -- start start 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 0x7fc9b8101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b810d140 0x7fc9b8102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8112e10 con 0x7fc9b8103ce0 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8112c90 con 0x7fc9b810d140 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9bdd48640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8112f90 con 0x7fc9b8104600 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.907+0000 7fc9b77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42374/0 (socket says 172.21.15.39:42374) 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 -- 172.21.15.39:0/662648322 learned_addr learned my addr 172.21.15.39:0/662648322 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b7fff640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b810d140 0x7fc9b8102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b6ffd640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 0x7fc9b8101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 -- 172.21.15.39:0/662648322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 msgr2=0x7fc9b8101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 0x7fc9b8101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 -- 172.21.15.39:0/662648322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b810d140 msgr2=0x7fc9b8102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b810d140 0x7fc9b8102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 -- 172.21.15.39:0/662648322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b81a76a0 con 0x7fc9b8103ce0 2024-09-10T21:53:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b77fe640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c920 tx=0x7fc9a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8007c70 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b81a7990 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a8007e10 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8018820 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.908+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b81a7fa0 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.909+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b81040c0 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.911+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc9a800f450 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.912+0000 7fc9b4ff9640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 0x7fc9a00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.912+0000 7fc9b6ffd640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 0x7fc9a00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.912+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fc9a80e5f40 con 0x7fc9b8103ce0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.912+0000 7fc9b6ffd640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 0x7fc9a00b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8103480 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:19.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:19.914+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9a8014030 con 0x7fc9b8103ce0 2024-09-10T21:53:20.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.129+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fc9b80ff310 con 0x7fc9a00b5370 2024-09-10T21:53:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.134+0000 7fc9b4ff9640 1 -- 172.21.15.39:0/662648322 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc9b80ff310 con 0x7fc9a00b5370 2024-09-10T21:53:20.135 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 msgr2=0x7fc9a00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 0x7fc9a00b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8103480 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 msgr2=0x7fc9b8101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c920 tx=0x7fc9a800cde0 comp rx=0 tx=0).stop 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 shutdown_connections 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9a00b5370 0x7fc9a00b7830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9b810d140 0x7fc9b8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9b8104600 0x7fc9b8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 --2- 172.21.15.39:0/662648322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9b8103ce0 0x7fc9b8101990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 >> 172.21.15.39:0/662648322 conn(0x7fc9b80fd700 msgr2=0x7fc9b810f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 shutdown_connections 2024-09-10T21:53:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:20.136+0000 7fc9bdd48640 1 -- 172.21.15.39:0/662648322 wait complete. 2024-09-10T21:53:20.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:20 smithi070 ceph-mon[34909]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:20.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:20 smithi039 ceph-mon[30872]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:20.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:20 smithi173 ceph-mon[35294]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:20.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:53:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:21 smithi070 ceph-mon[34909]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-10T21:53:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:21 smithi070 ceph-mon[34909]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:21 smithi039 ceph-mon[30872]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-10T21:53:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:21 smithi039 ceph-mon[30872]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 -- 172.21.15.39:0/1004240685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 msgr2=0x7f0a4810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 --2- 172.21.15.39:0/1004240685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4810e820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009900 tx=0x7f0a4002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 -- 172.21.15.39:0/1004240685 shutdown_connections 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 --2- 172.21.15.39:0/1004240685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4810e820 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 --2- 172.21.15.39:0/1004240685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a481076a0 0x7f0a48107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 --2- 172.21.15.39:0/1004240685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a48101c90 0x7f0a48102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 -- 172.21.15.39:0/1004240685 >> 172.21.15.39:0/1004240685 conn(0x7f0a480fd700 msgr2=0x7f0a480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 -- 172.21.15.39:0/1004240685 shutdown_connections 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.443+0000 7f0a504a9640 1 -- 172.21.15.39:0/1004240685 wait complete. 2024-09-10T21:53:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 Processor -- start 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 -- start start 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 0x7f0a48199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 0x7f0a481998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48111ce0 con 0x7f0a48108020 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48111b60 con 0x7f0a48101c90 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a504a9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48111e60 con 0x7f0a481076a0 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a4ea46640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a4ea46640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42398/0 (socket says 172.21.15.39:42398) 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a4ea46640 1 -- 172.21.15.39:0/3281176095 learned_addr learned my addr 172.21.15.39:0/3281176095 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a4da44640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 0x7f0a481998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.444+0000 7f0a4e245640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 0x7f0a48199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 -- 172.21.15.39:0/3281176095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 msgr2=0x7f0a481998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 0x7f0a481998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 -- 172.21.15.39:0/3281176095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 msgr2=0x7f0a48199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 0x7f0a48199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 -- 172.21.15.39:0/3281176095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4819f430 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4e245640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 0x7f0a48199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4da44640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 0x7f0a481998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a4ea46640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009a20 tx=0x7f0a40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4003f030 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4819f6c0 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a40003aa0 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40035070 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.445+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a481a5de0 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.446+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a48102f40 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.447+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0a400035f0 con 0x7f0a48108020 2024-09-10T21:53:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.448+0000 7f0a477fe640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 0x7f0a300b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.448+0000 7f0a4e245640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 0x7f0a300b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.448+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f0a401069a0 con 0x7f0a48108020 2024-09-10T21:53:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.449+0000 7f0a4e245640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 0x7f0a300b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a38005c40 tx=0x7f0a3800a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.451+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0a400cd8b0 con 0x7f0a48108020 2024-09-10T21:53:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:21 smithi173 ceph-mon[35294]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-10T21:53:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:21 smithi173 ceph-mon[35294]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:53:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.673+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a48102070 con 0x7f0a48108020 2024-09-10T21:53:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.673+0000 7f0a477fe640 1 -- 172.21.15.39:0/3281176095 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7f0a48102070 con 0x7f0a48108020 2024-09-10T21:53:21.674 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:21.674 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:53:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 msgr2=0x7f0a300b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 0x7f0a300b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0a38005c40 tx=0x7f0a3800a430 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 msgr2=0x7f0a4819ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009a20 tx=0x7f0a40004270 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 shutdown_connections 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a300b5370 0x7f0a300b7830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a48108020 0x7f0a4819ec60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a481076a0 0x7f0a481998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 --2- 172.21.15.39:0/3281176095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a48101c90 0x7f0a48199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 >> 172.21.15.39:0/3281176095 conn(0x7f0a480fd700 msgr2=0x7f0a4806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 shutdown_connections 2024-09-10T21:53:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:21.676+0000 7f0a504a9640 1 -- 172.21.15.39:0/3281176095 wait complete. 2024-09-10T21:53:22.208 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:22 smithi039 ceph-mon[30872]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-09-10T21:53:22.208 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:22 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3281176095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:53:22.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:53:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:22 smithi173 ceph-mon[35294]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-09-10T21:53:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:22 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3281176095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:53:22.492 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:22.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:22 smithi070 ceph-mon[34909]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-09-10T21:53:22.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:22 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3281176095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.933+0000 7f16a3772640 1 -- 172.21.15.39:0/3358368942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c103ce0 msgr2=0x7f169c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.933+0000 7f16a3772640 1 --2- 172.21.15.39:0/3358368942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c103ce0 0x7f169c1040c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1698009900 tx=0x7f169802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 -- 172.21.15.39:0/3358368942 shutdown_connections 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 --2- 172.21.15.39:0/3358368942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c10d140 0x7f169c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 --2- 172.21.15.39:0/3358368942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c104600 0x7f169c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:22.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 --2- 172.21.15.39:0/3358368942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c103ce0 0x7f169c1040c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 -- 172.21.15.39:0/3358368942 >> 172.21.15.39:0/3358368942 conn(0x7f169c0fd700 msgr2=0x7f169c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 -- 172.21.15.39:0/3358368942 shutdown_connections 2024-09-10T21:53:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 -- 172.21.15.39:0/3358368942 wait complete. 2024-09-10T21:53:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 Processor -- start 2024-09-10T21:53:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.934+0000 7f16a3772640 1 -- start start 2024-09-10T21:53:22.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 0x7f169c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c104600 0x7f169c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f169c112df0 con 0x7f169c10d140 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f169c112c70 con 0x7f169c103ce0 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a3772640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f169c112f70 con 0x7f169c104600 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42428/0 (socket says 172.21.15.39:42428) 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 -- 172.21.15.39:0/1807897444 learned_addr learned my addr 172.21.15.39:0/1807897444 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a0d0d640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c104600 0x7f169c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a150e640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 0x7f169c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 -- 172.21.15.39:0/1807897444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c104600 msgr2=0x7f169c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c104600 0x7f169c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 -- 172.21.15.39:0/1807897444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 msgr2=0x7f169c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 0x7f169c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 -- 172.21.15.39:0/1807897444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19f3b0 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a150e640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 0x7f169c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f16a1d0f640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f169400b970 tx=0x7f169400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.935+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694019070 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.936+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1694014440 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.936+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16940075d0 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.936+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c19f6a0 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.936+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a5f30 con 0x7f169c10d140 2024-09-10T21:53:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.937+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c1040c0 con 0x7f169c10d140 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.938+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f169400cb40 con 0x7f169c10d140 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.939+0000 7f168e7fc640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 0x7f16880b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.939+0000 7f16a150e640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 0x7f16880b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.939+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f16940e5710 con 0x7f169c10d140 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.939+0000 7f16a150e640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 0x7f16880b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1698031440 tx=0x7f1698005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:22.942+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f16940abfd0 con 0x7f169c10d140 2024-09-10T21:53:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.129+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f169c19a430 con 0x7f169c10d140 2024-09-10T21:53:23.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.130+0000 7f168e7fc640 1 -- 172.21.15.39:0/1807897444 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+22219 (secure 0 0 0) 0x7f169c19a430 con 0x7f169c10d140 2024-09-10T21:53:23.131 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:23.132 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:00.566056+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 msgr2=0x7f16880b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 0x7f16880b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1698031440 tx=0x7f1698005a20 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 msgr2=0x7f169c19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f169400b970 tx=0x7f169400be30 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 shutdown_connections 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f16880b53f0 0x7f16880b78b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f169c10d140 0x7f169c19ebe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c104600 0x7f169c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 --2- 172.21.15.39:0/1807897444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c103ce0 0x7f169c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 >> 172.21.15.39:0/1807897444 conn(0x7f169c0fd700 msgr2=0x7f169c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 shutdown_connections 2024-09-10T21:53:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:23.133+0000 7f16a3772640 1 -- 172.21.15.39:0/1807897444 wait complete. 2024-09-10T21:53:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:23 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1807897444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:23 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1807897444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:23.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:23 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1807897444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:23.886 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T21:53:23.887 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:53:24.154 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:24 smithi173 ceph-mon[35294]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-09-10T21:53:24.529 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:24 smithi039 ceph-mon[30872]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/4148932324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f38102dc0 msgr2=0x7f8f381031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/4148932324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f38102dc0 0x7f8f381031a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009900 tx=0x7f8f2c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/4148932324 shutdown_connections 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/4148932324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38109150 0x7f8f3810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/4148932324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f381087d0 0x7f8f38108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/4148932324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f38102dc0 0x7f8f381031a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/4148932324 >> 172.21.15.39:0/4148932324 conn(0x7f8f380fe830 msgr2=0x7f8f38100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/4148932324 shutdown_connections 2024-09-10T21:53:24.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.610+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/4148932324 wait complete. 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 Processor -- start 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 -- start start 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38102dc0 0x7f8f3819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f38109150 0x7f8f381a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38112e60 con 0x7f8f381087d0 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38112ce0 con 0x7f8f38109150 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3f5b6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38112fe0 con 0x7f8f38102dc0 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42450/0 (socket says 172.21.15.39:42450) 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 -- 172.21.15.39:0/278634815 learned_addr learned my addr 172.21.15.39:0/278634815 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3d352640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38102dc0 0x7f8f3819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:24.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3db53640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f38109150 0x7f8f381a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 -- 172.21.15.39:0/278634815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38102dc0 msgr2=0x7f8f3819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38102dc0 0x7f8f3819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 -- 172.21.15.39:0/278634815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f38109150 msgr2=0x7f8f381a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f38109150 0x7f8f381a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.611+0000 7f8f3cb51640 1 -- 172.21.15.39:0/278634815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f381a1510 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f3cb51640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c920 tx=0x7f8f3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007c70 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f381a1800 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34007e10 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34018820 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.612+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f381a7ec0 con 0x7f8f381087d0 2024-09-10T21:53:24.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.613+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f381031a0 con 0x7f8f381087d0 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.614+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8f3400f450 con 0x7f8f381087d0 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.615+0000 7f8f2a7fc640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 0x7f8f240b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.615+0000 7f8f3d352640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 0x7f8f240b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.615+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f8f340e5c80 con 0x7f8f381087d0 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.616+0000 7f8f3d352640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 0x7f8f240b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005ab0 tx=0x7f8f2c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:24.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.619+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8f34014030 con 0x7f8f381087d0 2024-09-10T21:53:24.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:24 smithi070 ceph-mon[34909]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-09-10T21:53:24.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.801+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f38105d90 con 0x7f8f240b5370 2024-09-10T21:53:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.808+0000 7f8f2a7fc640 1 -- 172.21.15.39:0/278634815 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7f8f38105d90 con 0x7f8f240b5370 2024-09-10T21:53:24.811 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:53:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 msgr2=0x7f8f240b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 0x7f8f240b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005ab0 tx=0x7f8f2c005a20 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 msgr2=0x7f8f3819b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c920 tx=0x7f8f3400cde0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 shutdown_connections 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f240b5370 0x7f8f240b7830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f38109150 0x7f8f381a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f381087d0 0x7f8f3819b9a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 --2- 172.21.15.39:0/278634815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f38102dc0 0x7f8f3819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 >> 172.21.15.39:0/278634815 conn(0x7f8f380fe830 msgr2=0x7f8f38101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 shutdown_connections 2024-09-10T21:53:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:24.811+0000 7f8f3f5b6640 1 -- 172.21.15.39:0/278634815 wait complete. 2024-09-10T21:53:25.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:25 smithi173 ceph-mon[35294]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:25.509 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:25 smithi039 ceph-mon[30872]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:25.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:25 smithi070 ceph-mon[34909]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:25.695 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-10T21:53:23.458414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647016,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":359,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368728,"kb_used_data":11160,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573096,"statfs":{"total":1151940427776,"available":1151562850304,"internally_reserved":0,"allocated":11427840,"data_stored":6371808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52944,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":149,"num_read_kb":136,"num_write":172,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002915"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025314+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:01.025314+0000","last_peered":"2024-09-10T21:53:01.025314+0000","last_clean":"2024-09-10T21:53:01.025314+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:01.025314+0000","last_undegraded":"2024-09-10T21:53:01.025314+0000","last_fullsized":"2024-09-10T21:53:01.025314+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027270+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:01.027270+0000","last_peered":"2024-09-10T21:53:01.027270+0000","last_clean":"2024-09-10T21:53:01.027270+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:01.027270+0000","last_undegraded":"2024-09-10T21:53:01.027270+0000","last_fullsized":"2024-09-10T21:53:01.027270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027354+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:01.027354+0000","last_peered":"2024-09-10T21:53:01.027354+0000","last_clean":"2024-09-10T21:53:01.027354+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:01.027354+0000","last_undegraded":"2024-09-10T21:53:01.027354+0000","last_fullsized":"2024-09-10T21:53:01.027354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999914+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:00.999914+0000","last_peered":"2024-09-10T21:53:00.999914+0000","last_clean":"2024-09-10T21:53:00.999914+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:00.999914+0000","last_undegraded":"2024-09-10T21:53:00.999914+0000","last_fullsized":"2024-09-10T21:53:00.999914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023834+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:53:01.023834+0000","last_peered":"2024-09-10T21:53:01.023834+0000","last_clean":"2024-09-10T21:53:01.023834+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:53:01.023834+0000","last_undegraded":"2024-09-10T21:53:01.023834+0000","last_fullsized":"2024-09-10T21:53:01.023834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023093+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:53:01.023093+0000","last_peered":"2024-09-10T21:53:01.023093+0000","last_clean":"2024-09-10T21:53:01.023093+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:53:01.023093+0000","last_undegraded":"2024-09-10T21:53:01.023093+0000","last_fullsized":"2024-09-10T21:53:01.023093+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023200+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:53:01.023200+0000","last_peered":"2024-09-10T21:53:01.023200+0000","last_clean":"2024-09-10T21:53:01.023200+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:53:01.023200+0000","last_undegraded":"2024-09-10T21:53:01.023200+0000","last_fullsized":"2024-09-10T21:53:01.023200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023513+0000","last_change":"2024-09-10T21:53:00.020994+0000","last_active":"2024-09-10T21:53:01.023513+0000","last_peered":"2024-09-10T21:53:01.023513+0000","last_clean":"2024-09-10T21:53:01.023513+0000","last_became_active":"2024-09-10T21:53:00.020700+0000","last_became_peered":"2024-09-10T21:53:00.020700+0000","last_unstale":"2024-09-10T21:53:01.023513+0000","last_undegraded":"2024-09-10T21:53:01.023513+0000","last_fullsized":"2024-09-10T21:53:01.023513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:42.683943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028900+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:53:01.028900+0000","last_peered":"2024-09-10T21:53:01.028900+0000","last_clean":"2024-09-10T21:53:01.028900+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:53:01.028900+0000","last_undegraded":"2024-09-10T21:53:01.028900+0000","last_fullsized":"2024-09-10T21:53:01.028900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025054+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:53:01.025054+0000","last_peered":"2024-09-10T21:53:01.025054+0000","last_clean":"2024-09-10T21:53:01.025054+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:53:01.025054+0000","last_undegraded":"2024-09-10T21:53:01.025054+0000","last_fullsized":"2024-09-10T21:53:01.025054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023597+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:53:01.023597+0000","last_peered":"2024-09-10T21:53:01.023597+0000","last_clean":"2024-09-10T21:53:01.023597+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:53:01.023597+0000","last_undegraded":"2024-09-10T21:53:01.023597+0000","last_fullsized":"2024-09-10T21:53:01.023597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999893+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:00.999893+0000","last_peered":"2024-09-10T21:53:00.999893+0000","last_clean":"2024-09-10T21:53:00.999893+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:00.999893+0000","last_undegraded":"2024-09-10T21:53:00.999893+0000","last_fullsized":"2024-09-10T21:53:00.999893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024094+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:53:01.024094+0000","last_peered":"2024-09-10T21:53:01.024094+0000","last_clean":"2024-09-10T21:53:01.024094+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:53:01.024094+0000","last_undegraded":"2024-09-10T21:53:01.024094+0000","last_fullsized":"2024-09-10T21:53:01.024094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027482+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:01.027482+0000","last_peered":"2024-09-10T21:53:01.027482+0000","last_clean":"2024-09-10T21:53:01.027482+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:01.027482+0000","last_undegraded":"2024-09-10T21:53:01.027482+0000","last_fullsized":"2024-09-10T21:53:01.027482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027125+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:01.027125+0000","last_peered":"2024-09-10T21:53:01.027125+0000","last_clean":"2024-09-10T21:53:01.027125+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:01.027125+0000","last_undegraded":"2024-09-10T21:53:01.027125+0000","last_fullsized":"2024-09-10T21:53:01.027125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.026714+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:53:01.026714+0000","last_peered":"2024-09-10T21:53:01.026714+0000","last_clean":"2024-09-10T21:53:01.026714+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:53:01.026714+0000","last_undegraded":"2024-09-10T21:53:01.026714+0000","last_fullsized":"2024-09-10T21:53:01.026714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025348+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:01.025348+0000","last_peered":"2024-09-10T21:53:01.025348+0000","last_clean":"2024-09-10T21:53:01.025348+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:01.025348+0000","last_undegraded":"2024-09-10T21:53:01.025348+0000","last_fullsized":"2024-09-10T21:53:01.025348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007643+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:01.007643+0000","last_peered":"2024-09-10T21:53:01.007643+0000","last_clean":"2024-09-10T21:53:01.007643+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:01.007643+0000","last_undegraded":"2024-09-10T21:53:01.007643+0000","last_fullsized":"2024-09-10T21:53:01.007643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999874+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:00.999874+0000","last_peered":"2024-09-10T21:53:00.999874+0000","last_clean":"2024-09-10T21:53:00.999874+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:00.999874+0000","last_undegraded":"2024-09-10T21:53:00.999874+0000","last_fullsized":"2024-09-10T21:53:00.999874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024307+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:01.024307+0000","last_peered":"2024-09-10T21:53:01.024307+0000","last_clean":"2024-09-10T21:53:01.024307+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:01.024307+0000","last_undegraded":"2024-09-10T21:53:01.024307+0000","last_fullsized":"2024-09-10T21:53:01.024307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024538+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:53:01.024538+0000","last_peered":"2024-09-10T21:53:01.024538+0000","last_clean":"2024-09-10T21:53:01.024538+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:53:01.024538+0000","last_undegraded":"2024-09-10T21:53:01.024538+0000","last_fullsized":"2024-09-10T21:53:01.024538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028760+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:53:01.028760+0000","last_peered":"2024-09-10T21:53:01.028760+0000","last_clean":"2024-09-10T21:53:01.028760+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:53:01.028760+0000","last_undegraded":"2024-09-10T21:53:01.028760+0000","last_fullsized":"2024-09-10T21:53:01.028760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023751+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:53:01.023751+0000","last_peered":"2024-09-10T21:53:01.023751+0000","last_clean":"2024-09-10T21:53:01.023751+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:53:01.023751+0000","last_undegraded":"2024-09-10T21:53:01.023751+0000","last_fullsized":"2024-09-10T21:53:01.023751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024597+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:01.024597+0000","last_peered":"2024-09-10T21:53:01.024597+0000","last_clean":"2024-09-10T21:53:01.024597+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:01.024597+0000","last_undegraded":"2024-09-10T21:53:01.024597+0000","last_fullsized":"2024-09-10T21:53:01.024597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025089+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:53:01.025089+0000","last_peered":"2024-09-10T21:53:01.025089+0000","last_clean":"2024-09-10T21:53:01.025089+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:53:01.025089+0000","last_undegraded":"2024-09-10T21:53:01.025089+0000","last_fullsized":"2024-09-10T21:53:01.025089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999959+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:00.999959+0000","last_peered":"2024-09-10T21:53:00.999959+0000","last_clean":"2024-09-10T21:53:00.999959+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:00.999959+0000","last_undegraded":"2024-09-10T21:53:00.999959+0000","last_fullsized":"2024-09-10T21:53:00.999959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024984+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:01.024984+0000","last_peered":"2024-09-10T21:53:01.024984+0000","last_clean":"2024-09-10T21:53:01.024984+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:01.024984+0000","last_undegraded":"2024-09-10T21:53:01.024984+0000","last_fullsized":"2024-09-10T21:53:01.024984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024422+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:53:01.024422+0000","last_peered":"2024-09-10T21:53:01.024422+0000","last_clean":"2024-09-10T21:53:01.024422+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:53:01.024422+0000","last_undegraded":"2024-09-10T21:53:01.024422+0000","last_fullsized":"2024-09-10T21:53:01.024422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027448+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:01.027448+0000","last_peered":"2024-09-10T21:53:01.027448+0000","last_clean":"2024-09-10T21:53:01.027448+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:01.027448+0000","last_undegraded":"2024-09-10T21:53:01.027448+0000","last_fullsized":"2024-09-10T21:53:01.027448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999478+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:00.999478+0000","last_peered":"2024-09-10T21:53:00.999478+0000","last_clean":"2024-09-10T21:53:00.999478+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:00.999478+0000","last_undegraded":"2024-09-10T21:53:00.999478+0000","last_fullsized":"2024-09-10T21:53:00.999478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999573+0000","last_change":"2024-09-10T21:53:00.014522+0000","last_active":"2024-09-10T21:53:00.999573+0000","last_peered":"2024-09-10T21:53:00.999573+0000","last_clean":"2024-09-10T21:53:00.999573+0000","last_became_active":"2024-09-10T21:53:00.013344+0000","last_became_peered":"2024-09-10T21:53:00.013344+0000","last_unstale":"2024-09-10T21:53:00.999573+0000","last_undegraded":"2024-09-10T21:53:00.999573+0000","last_fullsized":"2024-09-10T21:53:00.999573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.145005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024628+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:01.024628+0000","last_peered":"2024-09-10T21:53:01.024628+0000","last_clean":"2024-09-10T21:53:01.024628+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:01.024628+0000","last_undegraded":"2024-09-10T21:53:01.024628+0000","last_fullsized":"2024-09-10T21:53:01.024628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.029980+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:53:01.029980+0000","last_peered":"2024-09-10T21:53:01.029980+0000","last_clean":"2024-09-10T21:53:01.029980+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:53:01.029980+0000","last_undegraded":"2024-09-10T21:53:01.029980+0000","last_fullsized":"2024-09-10T21:53:01.029980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.273092+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:53:21.273092+0000","last_peered":"2024-09-10T21:53:21.273092+0000","last_clean":"2024-09-10T21:53:21.273092+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:53:21.273092+0000","last_undegraded":"2024-09-10T21:53:21.273092+0000","last_fullsized":"2024-09-10T21:53:21.273092+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023585+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:01.023585+0000","last_peered":"2024-09-10T21:53:01.023585+0000","last_clean":"2024-09-10T21:53:01.023585+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:01.023585+0000","last_undegraded":"2024-09-10T21:53:01.023585+0000","last_fullsized":"2024-09-10T21:53:01.023585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.098241+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:10.098241+0000","last_peered":"2024-09-10T21:53:10.098241+0000","last_clean":"2024-09-10T21:53:10.098241+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:10.098241+0000","last_undegraded":"2024-09-10T21:53:10.098241+0000","last_fullsized":"2024-09-10T21:53:10.098241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:09.084501+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:09.084501+0000","last_peered":"2024-09-10T21:53:09.084501+0000","last_clean":"2024-09-10T21:53:09.084501+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:09.084501+0000","last_undegraded":"2024-09-10T21:53:09.084501+0000","last_fullsized":"2024-09-10T21:53:09.084501+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.026225+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:53:01.026225+0000","last_peered":"2024-09-10T21:53:01.026225+0000","last_clean":"2024-09-10T21:53:01.026225+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:53:01.026225+0000","last_undegraded":"2024-09-10T21:53:01.026225+0000","last_fullsized":"2024-09-10T21:53:01.026225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111812+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:11.111812+0000","last_peered":"2024-09-10T21:53:11.111812+0000","last_clean":"2024-09-10T21:53:11.111812+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:11.111812+0000","last_undegraded":"2024-09-10T21:53:11.111812+0000","last_fullsized":"2024-09-10T21:53:11.111812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007248+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:01.007248+0000","last_peered":"2024-09-10T21:53:01.007248+0000","last_clean":"2024-09-10T21:53:01.007248+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:01.007248+0000","last_undegraded":"2024-09-10T21:53:01.007248+0000","last_fullsized":"2024-09-10T21:53:01.007248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272225+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:53:21.272225+0000","last_peered":"2024-09-10T21:53:21.272225+0000","last_clean":"2024-09-10T21:53:21.272225+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:53:21.272225+0000","last_undegraded":"2024-09-10T21:53:21.272225+0000","last_fullsized":"2024-09-10T21:53:21.272225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027459+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:53:01.027459+0000","last_peered":"2024-09-10T21:53:01.027459+0000","last_clean":"2024-09-10T21:53:01.027459+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:53:01.027459+0000","last_undegraded":"2024-09-10T21:53:01.027459+0000","last_fullsized":"2024-09-10T21:53:01.027459+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111455+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:11.111455+0000","last_peered":"2024-09-10T21:53:11.111455+0000","last_clean":"2024-09-10T21:53:11.111455+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:11.111455+0000","last_undegraded":"2024-09-10T21:53:11.111455+0000","last_fullsized":"2024-09-10T21:53:11.111455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027758+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:01.027758+0000","last_peered":"2024-09-10T21:53:01.027758+0000","last_clean":"2024-09-10T21:53:01.027758+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:01.027758+0000","last_undegraded":"2024-09-10T21:53:01.027758+0000","last_fullsized":"2024-09-10T21:53:01.027758+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.097474+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:10.097474+0000","last_peered":"2024-09-10T21:53:10.097474+0000","last_clean":"2024-09-10T21:53:10.097474+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:10.097474+0000","last_undegraded":"2024-09-10T21:53:10.097474+0000","last_fullsized":"2024-09-10T21:53:10.097474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027751+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:53:01.027751+0000","last_peered":"2024-09-10T21:53:01.027751+0000","last_clean":"2024-09-10T21:53:01.027751+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:53:01.027751+0000","last_undegraded":"2024-09-10T21:53:01.027751+0000","last_fullsized":"2024-09-10T21:53:01.027751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'27","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.273197+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:53:21.273197+0000","last_peered":"2024-09-10T21:53:21.273197+0000","last_clean":"2024-09-10T21:53:21.273197+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:53:21.273197+0000","last_undegraded":"2024-09-10T21:53:21.273197+0000","last_fullsized":"2024-09-10T21:53:21.273197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49601,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":62,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023991+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:53:01.023991+0000","last_peered":"2024-09-10T21:53:01.023991+0000","last_clean":"2024-09-10T21:53:01.023991+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:53:01.023991+0000","last_undegraded":"2024-09-10T21:53:01.023991+0000","last_fullsized":"2024-09-10T21:53:01.023991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":30,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.255013+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:11.255013+0000","last_peered":"2024-09-10T21:53:11.255013+0000","last_clean":"2024-09-10T21:53:11.255013+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:11.255013+0000","last_undegraded":"2024-09-10T21:53:11.255013+0000","last_fullsized":"2024-09-10T21:53:11.255013+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023775+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:53:01.023775+0000","last_peered":"2024-09-10T21:53:01.023775+0000","last_clean":"2024-09-10T21:53:01.023775+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:53:01.023775+0000","last_undegraded":"2024-09-10T21:53:01.023775+0000","last_fullsized":"2024-09-10T21:53:01.023775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112404+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:11.112404+0000","last_peered":"2024-09-10T21:53:11.112404+0000","last_clean":"2024-09-10T21:53:11.112404+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:11.112404+0000","last_undegraded":"2024-09-10T21:53:11.112404+0000","last_fullsized":"2024-09-10T21:53:11.112404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023284+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:53:01.023284+0000","last_peered":"2024-09-10T21:53:01.023284+0000","last_clean":"2024-09-10T21:53:01.023284+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:53:01.023284+0000","last_undegraded":"2024-09-10T21:53:01.023284+0000","last_fullsized":"2024-09-10T21:53:01.023284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":38,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272551+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:53:21.272551+0000","last_peered":"2024-09-10T21:53:21.272551+0000","last_clean":"2024-09-10T21:53:21.272551+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:53:21.272551+0000","last_undegraded":"2024-09-10T21:53:21.272551+0000","last_fullsized":"2024-09-10T21:53:21.272551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023615+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:53:01.023615+0000","last_peered":"2024-09-10T21:53:01.023615+0000","last_clean":"2024-09-10T21:53:01.023615+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:53:01.023615+0000","last_undegraded":"2024-09-10T21:53:01.023615+0000","last_fullsized":"2024-09-10T21:53:01.023615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.113292+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:11.113292+0000","last_peered":"2024-09-10T21:53:11.113292+0000","last_clean":"2024-09-10T21:53:11.113292+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:11.113292+0000","last_undegraded":"2024-09-10T21:53:11.113292+0000","last_fullsized":"2024-09-10T21:53:11.113292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023467+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:01.023467+0000","last_peered":"2024-09-10T21:53:01.023467+0000","last_clean":"2024-09-10T21:53:01.023467+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:01.023467+0000","last_undegraded":"2024-09-10T21:53:01.023467+0000","last_fullsized":"2024-09-10T21:53:01.023467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.079959+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:11.079959+0000","last_peered":"2024-09-10T21:53:11.079959+0000","last_clean":"2024-09-10T21:53:11.079959+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:11.079959+0000","last_undegraded":"2024-09-10T21:53:11.079959+0000","last_fullsized":"2024-09-10T21:53:11.079959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024779+0000","last_change":"2024-09-10T21:53:00.014765+0000","last_active":"2024-09-10T21:53:01.024779+0000","last_peered":"2024-09-10T21:53:01.024779+0000","last_clean":"2024-09-10T21:53:01.024779+0000","last_became_active":"2024-09-10T21:53:00.013996+0000","last_became_peered":"2024-09-10T21:53:00.013996+0000","last_unstale":"2024-09-10T21:53:01.024779+0000","last_undegraded":"2024-09-10T21:53:01.024779+0000","last_fullsized":"2024-09-10T21:53:01.024779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:55.039257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111396+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:11.111396+0000","last_peered":"2024-09-10T21:53:11.111396+0000","last_clean":"2024-09-10T21:53:11.111396+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:11.111396+0000","last_undegraded":"2024-09-10T21:53:11.111396+0000","last_fullsized":"2024-09-10T21:53:11.111396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024389+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:53:01.024389+0000","last_peered":"2024-09-10T21:53:01.024389+0000","last_clean":"2024-09-10T21:53:01.024389+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:53:01.024389+0000","last_undegraded":"2024-09-10T21:53:01.024389+0000","last_fullsized":"2024-09-10T21:53:01.024389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112966+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:11.112966+0000","last_peered":"2024-09-10T21:53:11.112966+0000","last_clean":"2024-09-10T21:53:11.112966+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:11.112966+0000","last_undegraded":"2024-09-10T21:53:11.112966+0000","last_fullsized":"2024-09-10T21:53:11.112966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:02.082073+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:53:02.082073+0000","last_peered":"2024-09-10T21:53:02.082073+0000","last_clean":"2024-09-10T21:53:02.082073+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:53:02.082073+0000","last_undegraded":"2024-09-10T21:53:02.082073+0000","last_fullsized":"2024-09-10T21:53:02.082073+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":38,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272836+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:53:21.272836+0000","last_peered":"2024-09-10T21:53:21.272836+0000","last_clean":"2024-09-10T21:53:21.272836+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:53:21.272836+0000","last_undegraded":"2024-09-10T21:53:21.272836+0000","last_fullsized":"2024-09-10T21:53:21.272836+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023783+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:53:01.023783+0000","last_peered":"2024-09-10T21:53:01.023783+0000","last_clean":"2024-09-10T21:53:01.023783+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:53:01.023783+0000","last_undegraded":"2024-09-10T21:53:01.023783+0000","last_fullsized":"2024-09-10T21:53:01.023783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023993+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:01.023993+0000","last_peered":"2024-09-10T21:53:01.023993+0000","last_clean":"2024-09-10T21:53:01.023993+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:01.023993+0000","last_undegraded":"2024-09-10T21:53:01.023993+0000","last_fullsized":"2024-09-10T21:53:01.023993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.256419+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:11.256419+0000","last_peered":"2024-09-10T21:53:11.256419+0000","last_clean":"2024-09-10T21:53:11.256419+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:11.256419+0000","last_undegraded":"2024-09-10T21:53:11.256419+0000","last_fullsized":"2024-09-10T21:53:11.256419+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024210+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:53:01.024210+0000","last_peered":"2024-09-10T21:53:01.024210+0000","last_clean":"2024-09-10T21:53:01.024210+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:53:01.024210+0000","last_undegraded":"2024-09-10T21:53:01.024210+0000","last_fullsized":"2024-09-10T21:53:01.024210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:09.085491+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:09.085491+0000","last_peered":"2024-09-10T21:53:09.085491+0000","last_clean":"2024-09-10T21:53:09.085491+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:09.085491+0000","last_undegraded":"2024-09-10T21:53:09.085491+0000","last_fullsized":"2024-09-10T21:53:09.085491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024046+0000","last_change":"2024-09-10T21:53:00.001410+0000","last_active":"2024-09-10T21:53:01.024046+0000","last_peered":"2024-09-10T21:53:01.024046+0000","last_clean":"2024-09-10T21:53:01.024046+0000","last_became_active":"2024-09-10T21:53:00.000938+0000","last_became_peered":"2024-09-10T21:53:00.000938+0000","last_unstale":"2024-09-10T21:53:01.024046+0000","last_undegraded":"2024-09-10T21:53:01.024046+0000","last_fullsized":"2024-09-10T21:53:01.024046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:54.754878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:18.268189+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:53:18.268189+0000","last_peered":"2024-09-10T21:53:18.268189+0000","last_clean":"2024-09-10T21:53:18.268189+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:53:18.268189+0000","last_undegraded":"2024-09-10T21:53:18.268189+0000","last_fullsized":"2024-09-10T21:53:18.268189+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024141+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:01.024141+0000","last_peered":"2024-09-10T21:53:01.024141+0000","last_clean":"2024-09-10T21:53:01.024141+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:01.024141+0000","last_undegraded":"2024-09-10T21:53:01.024141+0000","last_fullsized":"2024-09-10T21:53:01.024141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:20.270747+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:53:20.270747+0000","last_peered":"2024-09-10T21:53:20.270747+0000","last_clean":"2024-09-10T21:53:20.270747+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:53:20.270747+0000","last_undegraded":"2024-09-10T21:53:20.270747+0000","last_fullsized":"2024-09-10T21:53:20.270747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024380+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:53:01.024380+0000","last_peered":"2024-09-10T21:53:01.024380+0000","last_clean":"2024-09-10T21:53:01.024380+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:53:01.024380+0000","last_undegraded":"2024-09-10T21:53:01.024380+0000","last_fullsized":"2024-09-10T21:53:01.024380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007539+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:01.007539+0000","last_peered":"2024-09-10T21:53:01.007539+0000","last_clean":"2024-09-10T21:53:01.007539+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:01.007539+0000","last_undegraded":"2024-09-10T21:53:01.007539+0000","last_fullsized":"2024-09-10T21:53:01.007539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.637780+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:53:01.637780+0000","last_peered":"2024-09-10T21:53:01.637780+0000","last_clean":"2024-09-10T21:53:01.637780+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:53:01.637780+0000","last_undegraded":"2024-09-10T21:53:01.637780+0000","last_fullsized":"2024-09-10T21:53:01.637780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111729+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:11.111729+0000","last_peered":"2024-09-10T21:53:11.111729+0000","last_clean":"2024-09-10T21:53:11.111729+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:11.111729+0000","last_undegraded":"2024-09-10T21:53:11.111729+0000","last_fullsized":"2024-09-10T21:53:11.111729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024657+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:53:01.024657+0000","last_peered":"2024-09-10T21:53:01.024657+0000","last_clean":"2024-09-10T21:53:01.024657+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:53:01.024657+0000","last_undegraded":"2024-09-10T21:53:01.024657+0000","last_fullsized":"2024-09-10T21:53:01.024657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'12","reported_seq":31,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.023697+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:21.023697+0000","last_peered":"2024-09-10T21:53:21.023697+0000","last_clean":"2024-09-10T21:53:21.023697+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:21.023697+0000","last_undegraded":"2024-09-10T21:53:21.023697+0000","last_fullsized":"2024-09-10T21:53:21.023697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025183+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:53:01.025183+0000","last_peered":"2024-09-10T21:53:01.025183+0000","last_clean":"2024-09-10T21:53:01.025183+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:53:01.025183+0000","last_undegraded":"2024-09-10T21:53:01.025183+0000","last_fullsized":"2024-09-10T21:53:01.025183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112223+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:11.112223+0000","last_peered":"2024-09-10T21:53:11.112223+0000","last_clean":"2024-09-10T21:53:11.112223+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:11.112223+0000","last_undegraded":"2024-09-10T21:53:11.112223+0000","last_fullsized":"2024-09-10T21:53:11.112223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027428+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:01.027428+0000","last_peered":"2024-09-10T21:53:01.027428+0000","last_clean":"2024-09-10T21:53:01.027428+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:01.027428+0000","last_undegraded":"2024-09-10T21:53:01.027428+0000","last_fullsized":"2024-09-10T21:53:01.027428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:08.078358+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:08.078358+0000","last_peered":"2024-09-10T21:53:08.078358+0000","last_clean":"2024-09-10T21:53:08.078358+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:08.078358+0000","last_undegraded":"2024-09-10T21:53:08.078358+0000","last_fullsized":"2024-09-10T21:53:08.078358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023056+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:53:01.023056+0000","last_peered":"2024-09-10T21:53:01.023056+0000","last_clean":"2024-09-10T21:53:01.023056+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:53:01.023056+0000","last_undegraded":"2024-09-10T21:53:01.023056+0000","last_fullsized":"2024-09-10T21:53:01.023056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.110263+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:11.110263+0000","last_peered":"2024-09-10T21:53:11.110263+0000","last_clean":"2024-09-10T21:53:11.110263+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:11.110263+0000","last_undegraded":"2024-09-10T21:53:11.110263+0000","last_fullsized":"2024-09-10T21:53:11.110263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024937+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:01.024937+0000","last_peered":"2024-09-10T21:53:01.024937+0000","last_clean":"2024-09-10T21:53:01.024937+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:01.024937+0000","last_undegraded":"2024-09-10T21:53:01.024937+0000","last_fullsized":"2024-09-10T21:53:01.024937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.098674+0000","last_change":"2024-09-10T21:52:57.993879+0000","last_active":"2024-09-10T21:53:10.098674+0000","last_peered":"2024-09-10T21:53:10.098674+0000","last_clean":"2024-09-10T21:53:10.098674+0000","last_became_active":"2024-09-10T21:52:57.993489+0000","last_became_peered":"2024-09-10T21:52:57.993489+0000","last_unstale":"2024-09-10T21:53:10.098674+0000","last_undegraded":"2024-09-10T21:53:10.098674+0000","last_fullsized":"2024-09-10T21:53:10.098674+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:09.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023756+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:53:01.023756+0000","last_peered":"2024-09-10T21:53:01.023756+0000","last_clean":"2024-09-10T21:53:01.023756+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:53:01.023756+0000","last_undegraded":"2024-09-10T21:53:01.023756+0000","last_fullsized":"2024-09-10T21:53:01.023756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:08.077831+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:08.077831+0000","last_peered":"2024-09-10T21:53:08.077831+0000","last_clean":"2024-09-10T21:53:08.077831+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:08.077831+0000","last_undegraded":"2024-09-10T21:53:08.077831+0000","last_fullsized":"2024-09-10T21:53:08.077831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023589+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:53:01.023589+0000","last_peered":"2024-09-10T21:53:01.023589+0000","last_clean":"2024-09-10T21:53:01.023589+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:53:01.023589+0000","last_undegraded":"2024-09-10T21:53:01.023589+0000","last_fullsized":"2024-09-10T21:53:01.023589+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027114+0000","last_change":"2024-09-10T21:53:00.020003+0000","last_active":"2024-09-10T21:53:01.027114+0000","last_peered":"2024-09-10T21:53:01.027114+0000","last_clean":"2024-09-10T21:53:01.027114+0000","last_became_active":"2024-09-10T21:53:00.018836+0000","last_became_peered":"2024-09-10T21:53:00.018836+0000","last_unstale":"2024-09-10T21:53:01.027114+0000","last_undegraded":"2024-09-10T21:53:01.027114+0000","last_fullsized":"2024-09-10T21:53:01.027114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:49.626873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.113089+0000","last_change":"2024-09-10T21:52:57.991798+0000","last_active":"2024-09-10T21:53:11.113089+0000","last_peered":"2024-09-10T21:53:11.113089+0000","last_clean":"2024-09-10T21:53:11.113089+0000","last_became_active":"2024-09-10T21:52:57.991368+0000","last_became_peered":"2024-09-10T21:52:57.991368+0000","last_unstale":"2024-09-10T21:53:11.113089+0000","last_undegraded":"2024-09-10T21:53:11.113089+0000","last_fullsized":"2024-09-10T21:53:11.113089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:28.626806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027260+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:53:01.027260+0000","last_peered":"2024-09-10T21:53:01.027260+0000","last_clean":"2024-09-10T21:53:01.027260+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:53:01.027260+0000","last_undegraded":"2024-09-10T21:53:01.027260+0000","last_fullsized":"2024-09-10T21:53:01.027260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.254909+0000","last_change":"2024-09-10T21:52:57.994292+0000","last_active":"2024-09-10T21:53:11.254909+0000","last_peered":"2024-09-10T21:53:11.254909+0000","last_clean":"2024-09-10T21:53:11.254909+0000","last_became_active":"2024-09-10T21:52:57.993991+0000","last_became_peered":"2024-09-10T21:52:57.993991+0000","last_unstale":"2024-09-10T21:53:11.254909+0000","last_undegraded":"2024-09-10T21:53:11.254909+0000","last_fullsized":"2024-09-10T21:53:11.254909+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:01.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027823+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:01.027823+0000","last_peered":"2024-09-10T21:53:01.027823+0000","last_clean":"2024-09-10T21:53:01.027823+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:01.027823+0000","last_undegraded":"2024-09-10T21:53:01.027823+0000","last_fullsized":"2024-09-10T21:53:01.027823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028490+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:01.028490+0000","last_peered":"2024-09-10T21:53:01.028490+0000","last_clean":"2024-09-10T21:53:01.028490+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:01.028490+0000","last_undegraded":"2024-09-10T21:53:01.028490+0000","last_fullsized":"2024-09-10T21:53:01.028490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024186+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:53:01.024186+0000","last_peered":"2024-09-10T21:53:01.024186+0000","last_clean":"2024-09-10T21:53:01.024186+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:53:01.024186+0000","last_undegraded":"2024-09-10T21:53:01.024186+0000","last_fullsized":"2024-09-10T21:53:01.024186+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.271601+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:53:21.271601+0000","last_peered":"2024-09-10T21:53:21.271601+0000","last_clean":"2024-09-10T21:53:21.271601+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:53:21.271601+0000","last_undegraded":"2024-09-10T21:53:21.271601+0000","last_fullsized":"2024-09-10T21:53:21.271601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56414,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":149,"num_read_kb":136,"num_write":234,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":169242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874257,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":770048,"data_stored":370422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037781,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1458176,"data_stored":1011052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":370352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397535,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":370730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593764,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1388544,"data_stored":963248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724585,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":778240,"data_stored":370069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":962926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717368,"statfs":{"total":95995035648,"available":95966584832,"internally_reserved":0,"allocated":778240,"data_stored":369930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":369894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":421194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40312,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704840,"statfs":{"total":95995035648,"available":95953756160,"internally_reserved":0,"allocated":827392,"data_stored":420583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":798720,"data_stored":371408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:53:25.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:53:25.959 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:26.337 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:26 smithi039 ceph-mon[30872]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T21:53:26.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- 172.21.15.39:0/980459760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 msgr2=0x7f3a18111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:26.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/980459760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a18111850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009ca0 tx=0x7f3a1002a950 comp rx=0 tx=0).stop 2024-09-10T21:53:26.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- 172.21.15.39:0/980459760 shutdown_connections 2024-09-10T21:53:26.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/980459760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a18111850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/980459760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181021d0 0x7f3a1810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/980459760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181018b0 0x7f3a18101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- 172.21.15.39:0/980459760 >> 172.21.15.39:0/980459760 conn(0x7f3a180fd700 msgr2=0x7f3a180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- 172.21.15.39:0/980459760 shutdown_connections 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- 172.21.15.39:0/980459760 wait complete. 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 Processor -- start 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.420+0000 7f3a1dce5640 1 -- start start 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181018b0 0x7f3a1819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181021d0 0x7f3a1819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18114f30 con 0x7f3a1810f460 2024-09-10T21:53:26.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18114db0 con 0x7f3a181021d0 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a1dce5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a181150b0 con 0x7f3a181018b0 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42454/0 (socket says 172.21.15.39:42454) 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 -- 172.21.15.39:0/2358924104 learned_addr learned my addr 172.21.15.39:0/2358924104 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a177fe640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181018b0 0x7f3a1819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:26.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a16ffd640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181021d0 0x7f3a1819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 -- 172.21.15.39:0/2358924104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181018b0 msgr2=0x7f3a1819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181018b0 0x7f3a1819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 -- 172.21.15.39:0/2358924104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181021d0 msgr2=0x7f3a1819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181021d0 0x7f3a1819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 -- 172.21.15.39:0/2358924104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a181a1510 con 0x7f3a1810f460 2024-09-10T21:53:26.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a17fff640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3a1002ae70 tx=0x7f3a1002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.421+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10034040 con 0x7f3a1810f460 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.422+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a100308f0 con 0x7f3a1810f460 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.422+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a181a17a0 con 0x7f3a1810f460 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.422+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a100047f0 con 0x7f3a1810f460 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.422+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a181a7ec0 con 0x7f3a1810f460 2024-09-10T21:53:26.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.423+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a18101c90 con 0x7f3a1810f460 2024-09-10T21:53:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.424+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3a1004d030 con 0x7f3a1810f460 2024-09-10T21:53:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.425+0000 7f3a14ff9640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 0x7f3a040b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.425+0000 7f3a177fe640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 0x7f3a040b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.425+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f3a10106980 con 0x7f3a1810f460 2024-09-10T21:53:26.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.425+0000 7f3a177fe640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 0x7f3a040b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a080058c0 tx=0x7f3a0800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:26.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.429+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a100cd890 con 0x7f3a1810f460 2024-09-10T21:53:26.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:26 smithi173 ceph-mon[35294]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T21:53:26.556 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:26 smithi070 ceph-mon[34909]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T21:53:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.612+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a1810a650 con 0x7f3a040b53f0 2024-09-10T21:53:26.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.617+0000 7f3a14ff9640 1 -- 172.21.15.39:0/2358924104 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258739 (secure 0 0 0) 0x7f3a1810a650 con 0x7f3a040b53f0 2024-09-10T21:53:26.620 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:53:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 msgr2=0x7f3a040b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 0x7f3a040b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a080058c0 tx=0x7f3a0800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 msgr2=0x7f3a181a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3a1002ae70 tx=0x7f3a1002f5d0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 shutdown_connections 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a040b53f0 0x7f3a040b78b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a1810f460 0x7f3a181a0d40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a181021d0 0x7f3a1819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 --2- 172.21.15.39:0/2358924104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a181018b0 0x7f3a1819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.620+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 >> 172.21.15.39:0/2358924104 conn(0x7f3a180fd700 msgr2=0x7f3a180ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.621+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 shutdown_connections 2024-09-10T21:53:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:26.621+0000 7f3a1dce5640 1 -- 172.21.15.39:0/2358924104 wait complete. 2024-09-10T21:53:27.358 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-10T21:53:25.458947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647016,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":230,"num_read_kb":205,"num_write":359,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368728,"kb_used_data":11160,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573096,"statfs":{"total":1151940427776,"available":1151562850304,"internally_reserved":0,"allocated":11427840,"data_stored":6371808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48636,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":38,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003065"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025314+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:01.025314+0000","last_peered":"2024-09-10T21:53:01.025314+0000","last_clean":"2024-09-10T21:53:01.025314+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:01.025314+0000","last_undegraded":"2024-09-10T21:53:01.025314+0000","last_fullsized":"2024-09-10T21:53:01.025314+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027270+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:01.027270+0000","last_peered":"2024-09-10T21:53:01.027270+0000","last_clean":"2024-09-10T21:53:01.027270+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:01.027270+0000","last_undegraded":"2024-09-10T21:53:01.027270+0000","last_fullsized":"2024-09-10T21:53:01.027270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027354+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:01.027354+0000","last_peered":"2024-09-10T21:53:01.027354+0000","last_clean":"2024-09-10T21:53:01.027354+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:01.027354+0000","last_undegraded":"2024-09-10T21:53:01.027354+0000","last_fullsized":"2024-09-10T21:53:01.027354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999914+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:00.999914+0000","last_peered":"2024-09-10T21:53:00.999914+0000","last_clean":"2024-09-10T21:53:00.999914+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:00.999914+0000","last_undegraded":"2024-09-10T21:53:00.999914+0000","last_fullsized":"2024-09-10T21:53:00.999914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023834+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:53:01.023834+0000","last_peered":"2024-09-10T21:53:01.023834+0000","last_clean":"2024-09-10T21:53:01.023834+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:53:01.023834+0000","last_undegraded":"2024-09-10T21:53:01.023834+0000","last_fullsized":"2024-09-10T21:53:01.023834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023093+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:53:01.023093+0000","last_peered":"2024-09-10T21:53:01.023093+0000","last_clean":"2024-09-10T21:53:01.023093+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:53:01.023093+0000","last_undegraded":"2024-09-10T21:53:01.023093+0000","last_fullsized":"2024-09-10T21:53:01.023093+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023200+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:53:01.023200+0000","last_peered":"2024-09-10T21:53:01.023200+0000","last_clean":"2024-09-10T21:53:01.023200+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:53:01.023200+0000","last_undegraded":"2024-09-10T21:53:01.023200+0000","last_fullsized":"2024-09-10T21:53:01.023200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023513+0000","last_change":"2024-09-10T21:53:00.020994+0000","last_active":"2024-09-10T21:53:01.023513+0000","last_peered":"2024-09-10T21:53:01.023513+0000","last_clean":"2024-09-10T21:53:01.023513+0000","last_became_active":"2024-09-10T21:53:00.020700+0000","last_became_peered":"2024-09-10T21:53:00.020700+0000","last_unstale":"2024-09-10T21:53:01.023513+0000","last_undegraded":"2024-09-10T21:53:01.023513+0000","last_fullsized":"2024-09-10T21:53:01.023513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:42.683943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028900+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:53:01.028900+0000","last_peered":"2024-09-10T21:53:01.028900+0000","last_clean":"2024-09-10T21:53:01.028900+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:53:01.028900+0000","last_undegraded":"2024-09-10T21:53:01.028900+0000","last_fullsized":"2024-09-10T21:53:01.028900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025054+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:53:01.025054+0000","last_peered":"2024-09-10T21:53:01.025054+0000","last_clean":"2024-09-10T21:53:01.025054+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:53:01.025054+0000","last_undegraded":"2024-09-10T21:53:01.025054+0000","last_fullsized":"2024-09-10T21:53:01.025054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023597+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:53:01.023597+0000","last_peered":"2024-09-10T21:53:01.023597+0000","last_clean":"2024-09-10T21:53:01.023597+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:53:01.023597+0000","last_undegraded":"2024-09-10T21:53:01.023597+0000","last_fullsized":"2024-09-10T21:53:01.023597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999893+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:00.999893+0000","last_peered":"2024-09-10T21:53:00.999893+0000","last_clean":"2024-09-10T21:53:00.999893+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:00.999893+0000","last_undegraded":"2024-09-10T21:53:00.999893+0000","last_fullsized":"2024-09-10T21:53:00.999893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024094+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:53:01.024094+0000","last_peered":"2024-09-10T21:53:01.024094+0000","last_clean":"2024-09-10T21:53:01.024094+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:53:01.024094+0000","last_undegraded":"2024-09-10T21:53:01.024094+0000","last_fullsized":"2024-09-10T21:53:01.024094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027482+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:01.027482+0000","last_peered":"2024-09-10T21:53:01.027482+0000","last_clean":"2024-09-10T21:53:01.027482+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:01.027482+0000","last_undegraded":"2024-09-10T21:53:01.027482+0000","last_fullsized":"2024-09-10T21:53:01.027482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027125+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:01.027125+0000","last_peered":"2024-09-10T21:53:01.027125+0000","last_clean":"2024-09-10T21:53:01.027125+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:01.027125+0000","last_undegraded":"2024-09-10T21:53:01.027125+0000","last_fullsized":"2024-09-10T21:53:01.027125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.026714+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:53:01.026714+0000","last_peered":"2024-09-10T21:53:01.026714+0000","last_clean":"2024-09-10T21:53:01.026714+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:53:01.026714+0000","last_undegraded":"2024-09-10T21:53:01.026714+0000","last_fullsized":"2024-09-10T21:53:01.026714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025348+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:01.025348+0000","last_peered":"2024-09-10T21:53:01.025348+0000","last_clean":"2024-09-10T21:53:01.025348+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:01.025348+0000","last_undegraded":"2024-09-10T21:53:01.025348+0000","last_fullsized":"2024-09-10T21:53:01.025348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007643+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:01.007643+0000","last_peered":"2024-09-10T21:53:01.007643+0000","last_clean":"2024-09-10T21:53:01.007643+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:01.007643+0000","last_undegraded":"2024-09-10T21:53:01.007643+0000","last_fullsized":"2024-09-10T21:53:01.007643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999874+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:00.999874+0000","last_peered":"2024-09-10T21:53:00.999874+0000","last_clean":"2024-09-10T21:53:00.999874+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:00.999874+0000","last_undegraded":"2024-09-10T21:53:00.999874+0000","last_fullsized":"2024-09-10T21:53:00.999874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024307+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:01.024307+0000","last_peered":"2024-09-10T21:53:01.024307+0000","last_clean":"2024-09-10T21:53:01.024307+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:01.024307+0000","last_undegraded":"2024-09-10T21:53:01.024307+0000","last_fullsized":"2024-09-10T21:53:01.024307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024538+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:53:01.024538+0000","last_peered":"2024-09-10T21:53:01.024538+0000","last_clean":"2024-09-10T21:53:01.024538+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:53:01.024538+0000","last_undegraded":"2024-09-10T21:53:01.024538+0000","last_fullsized":"2024-09-10T21:53:01.024538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028760+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:53:01.028760+0000","last_peered":"2024-09-10T21:53:01.028760+0000","last_clean":"2024-09-10T21:53:01.028760+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:53:01.028760+0000","last_undegraded":"2024-09-10T21:53:01.028760+0000","last_fullsized":"2024-09-10T21:53:01.028760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023751+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:53:01.023751+0000","last_peered":"2024-09-10T21:53:01.023751+0000","last_clean":"2024-09-10T21:53:01.023751+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:53:01.023751+0000","last_undegraded":"2024-09-10T21:53:01.023751+0000","last_fullsized":"2024-09-10T21:53:01.023751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024597+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:01.024597+0000","last_peered":"2024-09-10T21:53:01.024597+0000","last_clean":"2024-09-10T21:53:01.024597+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:01.024597+0000","last_undegraded":"2024-09-10T21:53:01.024597+0000","last_fullsized":"2024-09-10T21:53:01.024597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025089+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:53:01.025089+0000","last_peered":"2024-09-10T21:53:01.025089+0000","last_clean":"2024-09-10T21:53:01.025089+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:53:01.025089+0000","last_undegraded":"2024-09-10T21:53:01.025089+0000","last_fullsized":"2024-09-10T21:53:01.025089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999959+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:00.999959+0000","last_peered":"2024-09-10T21:53:00.999959+0000","last_clean":"2024-09-10T21:53:00.999959+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:00.999959+0000","last_undegraded":"2024-09-10T21:53:00.999959+0000","last_fullsized":"2024-09-10T21:53:00.999959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024984+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:01.024984+0000","last_peered":"2024-09-10T21:53:01.024984+0000","last_clean":"2024-09-10T21:53:01.024984+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:01.024984+0000","last_undegraded":"2024-09-10T21:53:01.024984+0000","last_fullsized":"2024-09-10T21:53:01.024984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024422+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:53:01.024422+0000","last_peered":"2024-09-10T21:53:01.024422+0000","last_clean":"2024-09-10T21:53:01.024422+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:53:01.024422+0000","last_undegraded":"2024-09-10T21:53:01.024422+0000","last_fullsized":"2024-09-10T21:53:01.024422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027448+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:01.027448+0000","last_peered":"2024-09-10T21:53:01.027448+0000","last_clean":"2024-09-10T21:53:01.027448+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:01.027448+0000","last_undegraded":"2024-09-10T21:53:01.027448+0000","last_fullsized":"2024-09-10T21:53:01.027448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999478+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:00.999478+0000","last_peered":"2024-09-10T21:53:00.999478+0000","last_clean":"2024-09-10T21:53:00.999478+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:00.999478+0000","last_undegraded":"2024-09-10T21:53:00.999478+0000","last_fullsized":"2024-09-10T21:53:00.999478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:00.999573+0000","last_change":"2024-09-10T21:53:00.014522+0000","last_active":"2024-09-10T21:53:00.999573+0000","last_peered":"2024-09-10T21:53:00.999573+0000","last_clean":"2024-09-10T21:53:00.999573+0000","last_became_active":"2024-09-10T21:53:00.013344+0000","last_became_peered":"2024-09-10T21:53:00.013344+0000","last_unstale":"2024-09-10T21:53:00.999573+0000","last_undegraded":"2024-09-10T21:53:00.999573+0000","last_fullsized":"2024-09-10T21:53:00.999573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.145005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024628+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:01.024628+0000","last_peered":"2024-09-10T21:53:01.024628+0000","last_clean":"2024-09-10T21:53:01.024628+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:01.024628+0000","last_undegraded":"2024-09-10T21:53:01.024628+0000","last_fullsized":"2024-09-10T21:53:01.024628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.029980+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:53:01.029980+0000","last_peered":"2024-09-10T21:53:01.029980+0000","last_clean":"2024-09-10T21:53:01.029980+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:53:01.029980+0000","last_undegraded":"2024-09-10T21:53:01.029980+0000","last_fullsized":"2024-09-10T21:53:01.029980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.273092+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:53:21.273092+0000","last_peered":"2024-09-10T21:53:21.273092+0000","last_clean":"2024-09-10T21:53:21.273092+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:53:21.273092+0000","last_undegraded":"2024-09-10T21:53:21.273092+0000","last_fullsized":"2024-09-10T21:53:21.273092+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023585+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:01.023585+0000","last_peered":"2024-09-10T21:53:01.023585+0000","last_clean":"2024-09-10T21:53:01.023585+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:01.023585+0000","last_undegraded":"2024-09-10T21:53:01.023585+0000","last_fullsized":"2024-09-10T21:53:01.023585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.098241+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:10.098241+0000","last_peered":"2024-09-10T21:53:10.098241+0000","last_clean":"2024-09-10T21:53:10.098241+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:10.098241+0000","last_undegraded":"2024-09-10T21:53:10.098241+0000","last_fullsized":"2024-09-10T21:53:10.098241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:09.084501+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:09.084501+0000","last_peered":"2024-09-10T21:53:09.084501+0000","last_clean":"2024-09-10T21:53:09.084501+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:09.084501+0000","last_undegraded":"2024-09-10T21:53:09.084501+0000","last_fullsized":"2024-09-10T21:53:09.084501+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.026225+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:53:01.026225+0000","last_peered":"2024-09-10T21:53:01.026225+0000","last_clean":"2024-09-10T21:53:01.026225+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:53:01.026225+0000","last_undegraded":"2024-09-10T21:53:01.026225+0000","last_fullsized":"2024-09-10T21:53:01.026225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111812+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:11.111812+0000","last_peered":"2024-09-10T21:53:11.111812+0000","last_clean":"2024-09-10T21:53:11.111812+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:11.111812+0000","last_undegraded":"2024-09-10T21:53:11.111812+0000","last_fullsized":"2024-09-10T21:53:11.111812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007248+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:01.007248+0000","last_peered":"2024-09-10T21:53:01.007248+0000","last_clean":"2024-09-10T21:53:01.007248+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:01.007248+0000","last_undegraded":"2024-09-10T21:53:01.007248+0000","last_fullsized":"2024-09-10T21:53:01.007248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272225+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:53:21.272225+0000","last_peered":"2024-09-10T21:53:21.272225+0000","last_clean":"2024-09-10T21:53:21.272225+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:53:21.272225+0000","last_undegraded":"2024-09-10T21:53:21.272225+0000","last_fullsized":"2024-09-10T21:53:21.272225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027459+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:53:01.027459+0000","last_peered":"2024-09-10T21:53:01.027459+0000","last_clean":"2024-09-10T21:53:01.027459+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:53:01.027459+0000","last_undegraded":"2024-09-10T21:53:01.027459+0000","last_fullsized":"2024-09-10T21:53:01.027459+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111455+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:11.111455+0000","last_peered":"2024-09-10T21:53:11.111455+0000","last_clean":"2024-09-10T21:53:11.111455+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:11.111455+0000","last_undegraded":"2024-09-10T21:53:11.111455+0000","last_fullsized":"2024-09-10T21:53:11.111455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027758+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:01.027758+0000","last_peered":"2024-09-10T21:53:01.027758+0000","last_clean":"2024-09-10T21:53:01.027758+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:01.027758+0000","last_undegraded":"2024-09-10T21:53:01.027758+0000","last_fullsized":"2024-09-10T21:53:01.027758+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.097474+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:10.097474+0000","last_peered":"2024-09-10T21:53:10.097474+0000","last_clean":"2024-09-10T21:53:10.097474+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:10.097474+0000","last_undegraded":"2024-09-10T21:53:10.097474+0000","last_fullsized":"2024-09-10T21:53:10.097474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027751+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:53:01.027751+0000","last_peered":"2024-09-10T21:53:01.027751+0000","last_clean":"2024-09-10T21:53:01.027751+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:53:01.027751+0000","last_undegraded":"2024-09-10T21:53:01.027751+0000","last_fullsized":"2024-09-10T21:53:01.027751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'27","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.273197+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:53:21.273197+0000","last_peered":"2024-09-10T21:53:21.273197+0000","last_clean":"2024-09-10T21:53:21.273197+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:53:21.273197+0000","last_undegraded":"2024-09-10T21:53:21.273197+0000","last_fullsized":"2024-09-10T21:53:21.273197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49601,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":62,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023991+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:53:01.023991+0000","last_peered":"2024-09-10T21:53:01.023991+0000","last_clean":"2024-09-10T21:53:01.023991+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:53:01.023991+0000","last_undegraded":"2024-09-10T21:53:01.023991+0000","last_fullsized":"2024-09-10T21:53:01.023991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":30,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.255013+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:11.255013+0000","last_peered":"2024-09-10T21:53:11.255013+0000","last_clean":"2024-09-10T21:53:11.255013+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:11.255013+0000","last_undegraded":"2024-09-10T21:53:11.255013+0000","last_fullsized":"2024-09-10T21:53:11.255013+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023775+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:53:01.023775+0000","last_peered":"2024-09-10T21:53:01.023775+0000","last_clean":"2024-09-10T21:53:01.023775+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:53:01.023775+0000","last_undegraded":"2024-09-10T21:53:01.023775+0000","last_fullsized":"2024-09-10T21:53:01.023775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112404+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:11.112404+0000","last_peered":"2024-09-10T21:53:11.112404+0000","last_clean":"2024-09-10T21:53:11.112404+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:11.112404+0000","last_undegraded":"2024-09-10T21:53:11.112404+0000","last_fullsized":"2024-09-10T21:53:11.112404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023284+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:53:01.023284+0000","last_peered":"2024-09-10T21:53:01.023284+0000","last_clean":"2024-09-10T21:53:01.023284+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:53:01.023284+0000","last_undegraded":"2024-09-10T21:53:01.023284+0000","last_fullsized":"2024-09-10T21:53:01.023284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":38,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272551+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:53:21.272551+0000","last_peered":"2024-09-10T21:53:21.272551+0000","last_clean":"2024-09-10T21:53:21.272551+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:53:21.272551+0000","last_undegraded":"2024-09-10T21:53:21.272551+0000","last_fullsized":"2024-09-10T21:53:21.272551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023615+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:53:01.023615+0000","last_peered":"2024-09-10T21:53:01.023615+0000","last_clean":"2024-09-10T21:53:01.023615+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:53:01.023615+0000","last_undegraded":"2024-09-10T21:53:01.023615+0000","last_fullsized":"2024-09-10T21:53:01.023615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.113292+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:11.113292+0000","last_peered":"2024-09-10T21:53:11.113292+0000","last_clean":"2024-09-10T21:53:11.113292+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:11.113292+0000","last_undegraded":"2024-09-10T21:53:11.113292+0000","last_fullsized":"2024-09-10T21:53:11.113292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023467+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:01.023467+0000","last_peered":"2024-09-10T21:53:01.023467+0000","last_clean":"2024-09-10T21:53:01.023467+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:01.023467+0000","last_undegraded":"2024-09-10T21:53:01.023467+0000","last_fullsized":"2024-09-10T21:53:01.023467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.079959+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:11.079959+0000","last_peered":"2024-09-10T21:53:11.079959+0000","last_clean":"2024-09-10T21:53:11.079959+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:11.079959+0000","last_undegraded":"2024-09-10T21:53:11.079959+0000","last_fullsized":"2024-09-10T21:53:11.079959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024779+0000","last_change":"2024-09-10T21:53:00.014765+0000","last_active":"2024-09-10T21:53:01.024779+0000","last_peered":"2024-09-10T21:53:01.024779+0000","last_clean":"2024-09-10T21:53:01.024779+0000","last_became_active":"2024-09-10T21:53:00.013996+0000","last_became_peered":"2024-09-10T21:53:00.013996+0000","last_unstale":"2024-09-10T21:53:01.024779+0000","last_undegraded":"2024-09-10T21:53:01.024779+0000","last_fullsized":"2024-09-10T21:53:01.024779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:55.039257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111396+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:11.111396+0000","last_peered":"2024-09-10T21:53:11.111396+0000","last_clean":"2024-09-10T21:53:11.111396+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:11.111396+0000","last_undegraded":"2024-09-10T21:53:11.111396+0000","last_fullsized":"2024-09-10T21:53:11.111396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024389+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:53:01.024389+0000","last_peered":"2024-09-10T21:53:01.024389+0000","last_clean":"2024-09-10T21:53:01.024389+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:53:01.024389+0000","last_undegraded":"2024-09-10T21:53:01.024389+0000","last_fullsized":"2024-09-10T21:53:01.024389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112966+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:11.112966+0000","last_peered":"2024-09-10T21:53:11.112966+0000","last_clean":"2024-09-10T21:53:11.112966+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:11.112966+0000","last_undegraded":"2024-09-10T21:53:11.112966+0000","last_fullsized":"2024-09-10T21:53:11.112966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:02.082073+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:53:02.082073+0000","last_peered":"2024-09-10T21:53:02.082073+0000","last_clean":"2024-09-10T21:53:02.082073+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:53:02.082073+0000","last_undegraded":"2024-09-10T21:53:02.082073+0000","last_fullsized":"2024-09-10T21:53:02.082073+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":38,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.272836+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:53:21.272836+0000","last_peered":"2024-09-10T21:53:21.272836+0000","last_clean":"2024-09-10T21:53:21.272836+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:53:21.272836+0000","last_undegraded":"2024-09-10T21:53:21.272836+0000","last_fullsized":"2024-09-10T21:53:21.272836+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023783+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:53:01.023783+0000","last_peered":"2024-09-10T21:53:01.023783+0000","last_clean":"2024-09-10T21:53:01.023783+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:53:01.023783+0000","last_undegraded":"2024-09-10T21:53:01.023783+0000","last_fullsized":"2024-09-10T21:53:01.023783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023993+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:01.023993+0000","last_peered":"2024-09-10T21:53:01.023993+0000","last_clean":"2024-09-10T21:53:01.023993+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:01.023993+0000","last_undegraded":"2024-09-10T21:53:01.023993+0000","last_fullsized":"2024-09-10T21:53:01.023993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.256419+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:11.256419+0000","last_peered":"2024-09-10T21:53:11.256419+0000","last_clean":"2024-09-10T21:53:11.256419+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:11.256419+0000","last_undegraded":"2024-09-10T21:53:11.256419+0000","last_fullsized":"2024-09-10T21:53:11.256419+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024210+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:53:01.024210+0000","last_peered":"2024-09-10T21:53:01.024210+0000","last_clean":"2024-09-10T21:53:01.024210+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:53:01.024210+0000","last_undegraded":"2024-09-10T21:53:01.024210+0000","last_fullsized":"2024-09-10T21:53:01.024210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:09.085491+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:09.085491+0000","last_peered":"2024-09-10T21:53:09.085491+0000","last_clean":"2024-09-10T21:53:09.085491+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:09.085491+0000","last_undegraded":"2024-09-10T21:53:09.085491+0000","last_fullsized":"2024-09-10T21:53:09.085491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024046+0000","last_change":"2024-09-10T21:53:00.001410+0000","last_active":"2024-09-10T21:53:01.024046+0000","last_peered":"2024-09-10T21:53:01.024046+0000","last_clean":"2024-09-10T21:53:01.024046+0000","last_became_active":"2024-09-10T21:53:00.000938+0000","last_became_peered":"2024-09-10T21:53:00.000938+0000","last_unstale":"2024-09-10T21:53:01.024046+0000","last_undegraded":"2024-09-10T21:53:01.024046+0000","last_fullsized":"2024-09-10T21:53:01.024046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:54.754878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:23.274621+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:53:23.274621+0000","last_peered":"2024-09-10T21:53:23.274621+0000","last_clean":"2024-09-10T21:53:23.274621+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:53:23.274621+0000","last_undegraded":"2024-09-10T21:53:23.274621+0000","last_fullsized":"2024-09-10T21:53:23.274621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024141+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:01.024141+0000","last_peered":"2024-09-10T21:53:01.024141+0000","last_clean":"2024-09-10T21:53:01.024141+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:01.024141+0000","last_undegraded":"2024-09-10T21:53:01.024141+0000","last_fullsized":"2024-09-10T21:53:01.024141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:20.270747+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:53:20.270747+0000","last_peered":"2024-09-10T21:53:20.270747+0000","last_clean":"2024-09-10T21:53:20.270747+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:53:20.270747+0000","last_undegraded":"2024-09-10T21:53:20.270747+0000","last_fullsized":"2024-09-10T21:53:20.270747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024380+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:53:01.024380+0000","last_peered":"2024-09-10T21:53:01.024380+0000","last_clean":"2024-09-10T21:53:01.024380+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:53:01.024380+0000","last_undegraded":"2024-09-10T21:53:01.024380+0000","last_fullsized":"2024-09-10T21:53:01.024380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.007539+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:01.007539+0000","last_peered":"2024-09-10T21:53:01.007539+0000","last_clean":"2024-09-10T21:53:01.007539+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:01.007539+0000","last_undegraded":"2024-09-10T21:53:01.007539+0000","last_fullsized":"2024-09-10T21:53:01.007539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.637780+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:53:01.637780+0000","last_peered":"2024-09-10T21:53:01.637780+0000","last_clean":"2024-09-10T21:53:01.637780+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:53:01.637780+0000","last_undegraded":"2024-09-10T21:53:01.637780+0000","last_fullsized":"2024-09-10T21:53:01.637780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.111729+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:11.111729+0000","last_peered":"2024-09-10T21:53:11.111729+0000","last_clean":"2024-09-10T21:53:11.111729+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:11.111729+0000","last_undegraded":"2024-09-10T21:53:11.111729+0000","last_fullsized":"2024-09-10T21:53:11.111729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024657+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:53:01.024657+0000","last_peered":"2024-09-10T21:53:01.024657+0000","last_clean":"2024-09-10T21:53:01.024657+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:53:01.024657+0000","last_undegraded":"2024-09-10T21:53:01.024657+0000","last_fullsized":"2024-09-10T21:53:01.024657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'12","reported_seq":31,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.023697+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:21.023697+0000","last_peered":"2024-09-10T21:53:21.023697+0000","last_clean":"2024-09-10T21:53:21.023697+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:21.023697+0000","last_undegraded":"2024-09-10T21:53:21.023697+0000","last_fullsized":"2024-09-10T21:53:21.023697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.025183+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:53:01.025183+0000","last_peered":"2024-09-10T21:53:01.025183+0000","last_clean":"2024-09-10T21:53:01.025183+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:53:01.025183+0000","last_undegraded":"2024-09-10T21:53:01.025183+0000","last_fullsized":"2024-09-10T21:53:01.025183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.112223+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:11.112223+0000","last_peered":"2024-09-10T21:53:11.112223+0000","last_clean":"2024-09-10T21:53:11.112223+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:11.112223+0000","last_undegraded":"2024-09-10T21:53:11.112223+0000","last_fullsized":"2024-09-10T21:53:11.112223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027428+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:01.027428+0000","last_peered":"2024-09-10T21:53:01.027428+0000","last_clean":"2024-09-10T21:53:01.027428+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:01.027428+0000","last_undegraded":"2024-09-10T21:53:01.027428+0000","last_fullsized":"2024-09-10T21:53:01.027428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:08.078358+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:08.078358+0000","last_peered":"2024-09-10T21:53:08.078358+0000","last_clean":"2024-09-10T21:53:08.078358+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:08.078358+0000","last_undegraded":"2024-09-10T21:53:08.078358+0000","last_fullsized":"2024-09-10T21:53:08.078358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023056+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:53:01.023056+0000","last_peered":"2024-09-10T21:53:01.023056+0000","last_clean":"2024-09-10T21:53:01.023056+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:53:01.023056+0000","last_undegraded":"2024-09-10T21:53:01.023056+0000","last_fullsized":"2024-09-10T21:53:01.023056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.110263+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:11.110263+0000","last_peered":"2024-09-10T21:53:11.110263+0000","last_clean":"2024-09-10T21:53:11.110263+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:11.110263+0000","last_undegraded":"2024-09-10T21:53:11.110263+0000","last_fullsized":"2024-09-10T21:53:11.110263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024937+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:01.024937+0000","last_peered":"2024-09-10T21:53:01.024937+0000","last_clean":"2024-09-10T21:53:01.024937+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:01.024937+0000","last_undegraded":"2024-09-10T21:53:01.024937+0000","last_fullsized":"2024-09-10T21:53:01.024937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:10.098674+0000","last_change":"2024-09-10T21:52:57.993879+0000","last_active":"2024-09-10T21:53:10.098674+0000","last_peered":"2024-09-10T21:53:10.098674+0000","last_clean":"2024-09-10T21:53:10.098674+0000","last_became_active":"2024-09-10T21:52:57.993489+0000","last_became_peered":"2024-09-10T21:52:57.993489+0000","last_unstale":"2024-09-10T21:53:10.098674+0000","last_undegraded":"2024-09-10T21:53:10.098674+0000","last_fullsized":"2024-09-10T21:53:10.098674+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:09.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023756+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:53:01.023756+0000","last_peered":"2024-09-10T21:53:01.023756+0000","last_clean":"2024-09-10T21:53:01.023756+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:53:01.023756+0000","last_undegraded":"2024-09-10T21:53:01.023756+0000","last_fullsized":"2024-09-10T21:53:01.023756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:08.077831+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:08.077831+0000","last_peered":"2024-09-10T21:53:08.077831+0000","last_clean":"2024-09-10T21:53:08.077831+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:08.077831+0000","last_undegraded":"2024-09-10T21:53:08.077831+0000","last_fullsized":"2024-09-10T21:53:08.077831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.023589+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:53:01.023589+0000","last_peered":"2024-09-10T21:53:01.023589+0000","last_clean":"2024-09-10T21:53:01.023589+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:53:01.023589+0000","last_undegraded":"2024-09-10T21:53:01.023589+0000","last_fullsized":"2024-09-10T21:53:01.023589+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027114+0000","last_change":"2024-09-10T21:53:00.020003+0000","last_active":"2024-09-10T21:53:01.027114+0000","last_peered":"2024-09-10T21:53:01.027114+0000","last_clean":"2024-09-10T21:53:01.027114+0000","last_became_active":"2024-09-10T21:53:00.018836+0000","last_became_peered":"2024-09-10T21:53:00.018836+0000","last_unstale":"2024-09-10T21:53:01.027114+0000","last_undegraded":"2024-09-10T21:53:01.027114+0000","last_fullsized":"2024-09-10T21:53:01.027114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:49.626873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.113089+0000","last_change":"2024-09-10T21:52:57.991798+0000","last_active":"2024-09-10T21:53:11.113089+0000","last_peered":"2024-09-10T21:53:11.113089+0000","last_clean":"2024-09-10T21:53:11.113089+0000","last_became_active":"2024-09-10T21:52:57.991368+0000","last_became_peered":"2024-09-10T21:52:57.991368+0000","last_unstale":"2024-09-10T21:53:11.113089+0000","last_undegraded":"2024-09-10T21:53:11.113089+0000","last_fullsized":"2024-09-10T21:53:11.113089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:28.626806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027260+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:53:01.027260+0000","last_peered":"2024-09-10T21:53:01.027260+0000","last_clean":"2024-09-10T21:53:01.027260+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:53:01.027260+0000","last_undegraded":"2024-09-10T21:53:01.027260+0000","last_fullsized":"2024-09-10T21:53:01.027260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:11.254909+0000","last_change":"2024-09-10T21:52:57.994292+0000","last_active":"2024-09-10T21:53:11.254909+0000","last_peered":"2024-09-10T21:53:11.254909+0000","last_clean":"2024-09-10T21:53:11.254909+0000","last_became_active":"2024-09-10T21:52:57.993991+0000","last_became_peered":"2024-09-10T21:52:57.993991+0000","last_unstale":"2024-09-10T21:53:11.254909+0000","last_undegraded":"2024-09-10T21:53:11.254909+0000","last_fullsized":"2024-09-10T21:53:11.254909+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:01.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.027823+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:01.027823+0000","last_peered":"2024-09-10T21:53:01.027823+0000","last_clean":"2024-09-10T21:53:01.027823+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:01.027823+0000","last_undegraded":"2024-09-10T21:53:01.027823+0000","last_fullsized":"2024-09-10T21:53:01.027823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.028490+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:01.028490+0000","last_peered":"2024-09-10T21:53:01.028490+0000","last_clean":"2024-09-10T21:53:01.028490+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:01.028490+0000","last_undegraded":"2024-09-10T21:53:01.028490+0000","last_fullsized":"2024-09-10T21:53:01.028490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:01.024186+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:53:01.024186+0000","last_peered":"2024-09-10T21:53:01.024186+0000","last_clean":"2024-09-10T21:53:01.024186+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:53:01.024186+0000","last_undegraded":"2024-09-10T21:53:01.024186+0000","last_fullsized":"2024-09-10T21:53:01.024186+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":45,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-10T21:53:21.271601+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:53:21.271601+0000","last_peered":"2024-09-10T21:53:21.271601+0000","last_clean":"2024-09-10T21:53:21.271601+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:53:21.271601+0000","last_undegraded":"2024-09-10T21:53:21.271601+0000","last_fullsized":"2024-09-10T21:53:21.271601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56414,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":234,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":169242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874258,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":770048,"data_stored":370422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037781,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1458176,"data_stored":1011052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":370352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397535,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":370730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593764,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1388544,"data_stored":963248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":778240,"data_stored":370069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":962926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717368,"statfs":{"total":95995035648,"available":95966584832,"internally_reserved":0,"allocated":778240,"data_stored":369930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":369894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":421194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40312,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704840,"statfs":{"total":95995035648,"available":95953756160,"internally_reserved":0,"allocated":827392,"data_stored":420583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":798720,"data_stored":371408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:53:27.362 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T21:53:27.363 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T21:53:27.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T21:53:27.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:27 smithi173 ceph-mon[35294]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:27.626 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:27.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:27 smithi070 ceph-mon[34909]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:27.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:27 smithi039 ceph-mon[30872]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:53:28.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 -- 172.21.15.39:0/1964588424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8103470 msgr2=0x7fdff8109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:28.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/1964588424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8103470 0x7fdff8109df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009cd0 tx=0x7fdff002a8e0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 -- 172.21.15.39:0/1964588424 shutdown_connections 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/1964588424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8103470 0x7fdff8109df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/1964588424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 0x7fdff8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/1964588424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8101950 0x7fdff8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 -- 172.21.15.39:0/1964588424 >> 172.21.15.39:0/1964588424 conn(0x7fdff80fd200 msgr2=0x7fdff80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 -- 172.21.15.39:0/1964588424 shutdown_connections 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.080+0000 7fdffe2b8640 1 -- 172.21.15.39:0/1964588424 wait complete. 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 Processor -- start 2024-09-10T21:53:28.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 -- start start 2024-09-10T21:53:28.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:28.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 0x7fdff8103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:28.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 0x7fdff81044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:28.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810d600 con 0x7fdff8101950 2024-09-10T21:53:28.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810d480 con 0x7fdff8102ab0 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffe2b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810d780 con 0x7fdff8103470 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42470/0 (socket says 172.21.15.39:42470) 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 -- 172.21.15.39:0/3786169828 learned_addr learned my addr 172.21.15.39:0/3786169828 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffc855640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 0x7fdff81044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff77fe640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 0x7fdff8103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 -- 172.21.15.39:0/3786169828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 msgr2=0x7fdff81044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 0x7fdff81044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 -- 172.21.15.39:0/3786169828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 msgr2=0x7fdff8103f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:28.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 0x7fdff8103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdff7fff640 1 -- 172.21.15.39:0/3786169828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff8104d80 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.081+0000 7fdffc855640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 0x7fdff81044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdff7fff640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81a2ea0 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe8009c30 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800f620 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.082+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff81a3300 con 0x7fdff8101950 2024-09-10T21:53:28.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.083+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff81a3530 con 0x7fdff8101950 2024-09-10T21:53:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.084+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fdfe8010460 con 0x7fdff8101950 2024-09-10T21:53:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.085+0000 7fdff57fa640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 0x7fdfe00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.085+0000 7fdff77fe640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 0x7fdfe00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.085+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fdfe80e5890 con 0x7fdff8101950 2024-09-10T21:53:28.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.086+0000 7fdff77fe640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 0x7fdfe00b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0058c0 tx=0x7fdfec005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:28.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.090+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdfe80ac7a0 con 0x7fdff8101950 2024-09-10T21:53:28.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.349+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdff81a3840 con 0x7fdff8101950 2024-09-10T21:53:28.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:28 smithi039 ceph-mon[30872]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:53:28.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.351+0000 7fdff57fa640 1 -- 172.21.15.39:0/3786169828 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fdfe8009de0 con 0x7fdff8101950 2024-09-10T21:53:28.352 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-09-10T21:53:28.352 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDYv+BmmcflFBAAYyw8yJ0ZAZM0FPWsbIJL9g== 2024-09-10T21:53:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.353+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 msgr2=0x7fdfe00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.353+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 0x7fdfe00b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0058c0 tx=0x7fdfec005c60 comp rx=0 tx=0).stop 2024-09-10T21:53:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.353+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 msgr2=0x7fdff8105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.353+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).stop 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 shutdown_connections 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdfe00b5370 0x7fdfe00b7830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdff8103470 0x7fdff81044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff8102ab0 0x7fdff8103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 --2- 172.21.15.39:0/3786169828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdff8101950 0x7fdff8105710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 >> 172.21.15.39:0/3786169828 conn(0x7fdff80fd200 msgr2=0x7fdff80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 shutdown_connections 2024-09-10T21:53:28.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:28.354+0000 7fdffe2b8640 1 -- 172.21.15.39:0/3786169828 wait complete. 2024-09-10T21:53:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:28 smithi173 ceph-mon[35294]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:53:28.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:28 smithi070 ceph-mon[34909]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:53:28.974 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:53:28.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T21:53:28.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T21:53:29.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T21:53:29.312 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:29.419 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:29 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:53:29.419 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:29 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:53:29.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:29 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:53:29.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:29 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:53:29.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:53:29.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3786169828' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 -- 172.21.15.39:0/2336559095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff30010d100 msgr2=0x7ff30010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 --2- 172.21.15.39:0/2336559095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff30010d100 0x7ff30010f560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009900 tx=0x7ff2f802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 -- 172.21.15.39:0/2336559095 shutdown_connections 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 --2- 172.21.15.39:0/2336559095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff30010d100 0x7ff30010f560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 --2- 172.21.15.39:0/2336559095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 0x7ff30010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 --2- 172.21.15.39:0/2336559095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300103ca0 0x7ff300104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 -- 172.21.15.39:0/2336559095 >> 172.21.15.39:0/2336559095 conn(0x7ff3000fd700 msgr2=0x7ff3000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 -- 172.21.15.39:0/2336559095 shutdown_connections 2024-09-10T21:53:29.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 -- 172.21.15.39:0/2336559095 wait complete. 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.696+0000 7ff305bad640 1 Processor -- start 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 -- start start 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 0x7ff3001997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 0x7ff30019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112db0 con 0x7ff300103ca0 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112c30 con 0x7ff3001045c0 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff305bad640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112f30 con 0x7ff30010d100 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42488/0 (socket says 172.21.15.39:42488) 2024-09-10T21:53:29.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 -- 172.21.15.39:0/1108043585 learned_addr learned my addr 172.21.15.39:0/1108043585 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2feffd640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 0x7ff3001997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2fffff640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 0x7ff30019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 -- 172.21.15.39:0/1108043585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 msgr2=0x7ff30019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 0x7ff30019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 -- 172.21.15.39:0/1108043585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 msgr2=0x7ff3001997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 0x7ff3001997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2ff7fe640 1 -- 172.21.15.39:0/1108043585 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30019f310 con 0x7ff300103ca0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.697+0000 7ff2fffff640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 0x7ff30019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff2ff7fe640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba50 tx=0x7ff2f000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0019070 con 0x7ff300103ca0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30019f600 con 0x7ff300103ca0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f000cbe0 con 0x7ff300103ca0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00075d0 con 0x7ff300103ca0 2024-09-10T21:53:29.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.698+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001a5e90 con 0x7ff300103ca0 2024-09-10T21:53:29.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.699+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300104080 con 0x7ff300103ca0 2024-09-10T21:53:29.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.700+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff2f0007830 con 0x7ff300103ca0 2024-09-10T21:53:29.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.701+0000 7ff2fcff9640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 0x7ff2ec0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:29.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.701+0000 7ff2feffd640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 0x7ff2ec0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:29.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.701+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7ff2f00e5820 con 0x7ff300103ca0 2024-09-10T21:53:29.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.702+0000 7ff2feffd640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 0x7ff2ec0b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3001012c0 tx=0x7ff2e800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:29.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.704+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2f00ac0e0 con 0x7ff300103ca0 2024-09-10T21:53:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.890+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7ff3001a6260 con 0x7ff300103ca0 2024-09-10T21:53:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.891+0000 7ff2fcff9640 1 -- 172.21.15.39:0/1108043585 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7ff2f00b0b10 con 0x7ff300103ca0 2024-09-10T21:53:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 msgr2=0x7ff2ec0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 0x7ff2ec0b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3001012c0 tx=0x7ff2e800b2e0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 msgr2=0x7ff300199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ba50 tx=0x7ff2f000bf10 comp rx=0 tx=0).stop 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 shutdown_connections 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2ec0b5370 0x7ff2ec0b7830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff30010d100 0x7ff30019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3001045c0 0x7ff3001997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 --2- 172.21.15.39:0/1108043585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff300103ca0 0x7ff300199260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 >> 172.21.15.39:0/1108043585 conn(0x7ff3000fd700 msgr2=0x7ff30010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 shutdown_connections 2024-09-10T21:53:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:29.893+0000 7ff305bad640 1 -- 172.21.15.39:0/1108043585 wait complete. 2024-09-10T21:53:30.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:30 smithi039 ceph-mon[30872]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T21:53:30.466 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:30 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1108043585' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:53:30.467 INFO:teuthology.orchestra.run.smithi039.stdout:[{"version":49,"timestamp":"2024-09-10T21:52:50.887608+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T21:53:30.467 INFO:tasks.ceph_manager:config epoch is 49 2024-09-10T21:53:30.468 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T21:53:30.468 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T21:53:30.468 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T21:53:30.491 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:30 smithi173 ceph-mon[35294]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T21:53:30.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:30 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1108043585' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:53:30.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:30 smithi070 ceph-mon[34909]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T21:53:30.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:30 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1108043585' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:53:30.729 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:31.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 -- 172.21.15.39:0/3603155902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08102dc0 msgr2=0x7feb081031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 --2- 172.21.15.39:0/3603155902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08102dc0 0x7feb081031a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb04009900 tx=0x7feb0402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 -- 172.21.15.39:0/3603155902 shutdown_connections 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 --2- 172.21.15.39:0/3603155902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08109150 0x7feb0810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 --2- 172.21.15.39:0/3603155902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 0x7feb08108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 --2- 172.21.15.39:0/3603155902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08102dc0 0x7feb081031a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 -- 172.21.15.39:0/3603155902 >> 172.21.15.39:0/3603155902 conn(0x7feb080fe830 msgr2=0x7feb08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 -- 172.21.15.39:0/3603155902 shutdown_connections 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.121+0000 7feb0f859640 1 -- 172.21.15.39:0/3603155902 wait complete. 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.122+0000 7feb0f859640 1 Processor -- start 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.122+0000 7feb0f859640 1 -- start start 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08102dc0 0x7feb080754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:31.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 0x7feb080759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb08112e20 con 0x7feb08109150 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb08112ca0 con 0x7feb081087d0 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb08112fa0 con 0x7feb08102dc0 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53788/0 (socket says 172.21.15.39:53788) 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 -- 172.21.15.39:0/4209944807 learned_addr learned my addr 172.21.15.39:0/4209944807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0cdf4640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 0x7feb080759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0d5f5640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08102dc0 0x7feb080754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 -- 172.21.15.39:0/4209944807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08102dc0 msgr2=0x7feb080754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08102dc0 0x7feb080754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 -- 172.21.15.39:0/4209944807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 msgr2=0x7feb080759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:31.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 0x7feb080759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 -- 172.21.15.39:0/4209944807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb081a76f0 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0ddf6640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feb0000eaa0 tx=0x7feb0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0000cdb0 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb081a79e0 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb00005020 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.123+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb000116d0 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.124+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081a7f20 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.125+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb081031a0 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.126+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7feb0000f040 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.127+0000 7feafe7fc640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 0x7feaf40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.127+0000 7feb0d5f5640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 0x7feaf40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.127+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7feb000e5e10 con 0x7feb08109150 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.127+0000 7feb0d5f5640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 0x7feaf40b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb04031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:31.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.130+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feb00016030 con 0x7feb08109150 2024-09-10T21:53:31.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.368+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7feb080767a0 con 0x7feb08109150 2024-09-10T21:53:31.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.372+0000 7feafe7fc640 1 -- 172.21.15.39:0/4209944807 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294212 (secure 0 0 0) 0x7feb080767a0 con 0x7feb08109150 2024-09-10T21:53:31.377 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.375+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 msgr2=0x7feaf40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 0x7feaf40b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb04031400 comp rx=0 tx=0).stop 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 msgr2=0x7feb08075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feb0000eaa0 tx=0x7feb0000ef60 comp rx=0 tx=0).stop 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 shutdown_connections 2024-09-10T21:53:31.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7feaf40b5370 0x7feaf40b7830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb08109150 0x7feb08075f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb081087d0 0x7feb080759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 --2- 172.21.15.39:0/4209944807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb08102dc0 0x7feb080754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 >> 172.21.15.39:0/4209944807 conn(0x7feb080fe830 msgr2=0x7feb08100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 shutdown_connections 2024-09-10T21:53:31.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:31.376+0000 7feb0f859640 1 -- 172.21.15.39:0/4209944807 wait complete. 2024-09-10T21:53:31.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:31 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4209944807' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:53:31.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:31 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4209944807' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:53:31.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:31 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4209944807' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:53:32.015 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":423421889},{"type":"v1","addr":"172.21.15.39:6801","nonce":423421889}]},"active_addr":"172.21.15.39:6801/423421889","active_change":"2024-09-10T21:45:43.360780+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24121,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.39:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3587255917}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2509630594}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":673467528}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1568331400}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2402312424}]}]} 2024-09-10T21:53:32.022 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T21:53:32.022 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T21:53:32.022 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:53:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:32.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:32 smithi039 ceph-mon[30872]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T21:53:32.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:32 smithi173 ceph-mon[35294]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T21:53:32.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 -- 172.21.15.39:0/1206443247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c1076e0 msgr2=0x7f8f8c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 --2- 172.21.15.39:0/1206443247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c107b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009900 tx=0x7f8f8002a410 comp rx=0 tx=0).stop 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 -- 172.21.15.39:0/1206443247 shutdown_connections 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 --2- 172.21.15.39:0/1206443247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c108060 0x7f8f8c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 --2- 172.21.15.39:0/1206443247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c107b20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 --2- 172.21.15.39:0/1206443247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.763+0000 7f8f93079640 1 -- 172.21.15.39:0/1206443247 >> 172.21.15.39:0/1206443247 conn(0x7f8f8c0fd720 msgr2=0x7f8f8c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- 172.21.15.39:0/1206443247 shutdown_connections 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- 172.21.15.39:0/1206443247 wait complete. 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 Processor -- start 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- start start 2024-09-10T21:53:32.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 0x7f8f8c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c111d20 con 0x7f8f8c101cd0 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c111ba0 con 0x7f8f8c1076e0 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.764+0000 7f8f93079640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c111ea0 con 0x7f8f8c108060 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53806/0 (socket says 172.21.15.39:53806) 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 -- 172.21.15.39:0/1200463031 learned_addr learned my addr 172.21.15.39:0/1200463031 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f91616640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 0x7f8f8c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f8bfff640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 -- 172.21.15.39:0/1200463031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 msgr2=0x7f8f8c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 0x7f8f8c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 -- 172.21.15.39:0/1200463031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 msgr2=0x7f8f8c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 -- 172.21.15.39:0/1200463031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c1a5530 con 0x7f8f8c101cd0 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f8bfff640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f91616640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 0x7f8f8c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f90e15640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00d770 tx=0x7f8f7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c017070 con 0x7f8f8c101cd0 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f7c0054d0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c1a5820 con 0x7f8f8c101cd0 2024-09-10T21:53:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c004c30 con 0x7f8f8c101cd0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.765+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c1a5de0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.766+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c1020b0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.768+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8f7c004e10 con 0x7f8f8c101cd0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.769+0000 7f8f89ffb640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 0x7f8f740b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.769+0000 7f8f8bfff640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 0x7f8f740b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.769+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f8f7c0e56e0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.769+0000 7f8f8bfff640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 0x7f8f740b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f80000c00 tx=0x7f8f80031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:32.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.773+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8f7c0ac5f0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:32 smithi070 ceph-mon[34909]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T21:53:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.958+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f8c02e5c0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.960+0000 7f8f89ffb640 1 -- 172.21.15.39:0/1200463031 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+22219 (secure 0 0 0) 0x7f8f7c0abef0 con 0x7f8f8c101cd0 2024-09-10T21:53:32.961 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:32.961 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:00.566056+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 msgr2=0x7f8f740b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 0x7f8f740b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f80000c00 tx=0x7f8f80031400 comp rx=0 tx=0).stop 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 msgr2=0x7f8f8c19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00d770 tx=0x7f8f7c00dc30 comp rx=0 tx=0).stop 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 shutdown_connections 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8f740b53f0 0x7f8f740b78b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f8c108060 0x7f8f8c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f8c1076e0 0x7f8f8c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 --2- 172.21.15.39:0/1200463031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f8c101cd0 0x7f8f8c19a150 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:32.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 >> 172.21.15.39:0/1200463031 conn(0x7f8f8c0fd720 msgr2=0x7f8f8c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:32.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 shutdown_connections 2024-09-10T21:53:32.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:32.962+0000 7f8f93079640 1 -- 172.21.15.39:0/1200463031 wait complete. 2024-09-10T21:53:33.575 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T21:53:33.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:53:33.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:33 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1200463031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:33.831 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:33.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:33 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1200463031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:33.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:33 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1200463031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 -- 172.21.15.39:0/641906235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1381087d0 msgr2=0x7fd138108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/641906235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1381087d0 0x7fd138108c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009900 tx=0x7fd12c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 -- 172.21.15.39:0/641906235 shutdown_connections 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/641906235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd138109150 0x7fd13810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/641906235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1381087d0 0x7fd138108c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/641906235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138102dc0 0x7fd1381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.245+0000 7fd13ed9b640 1 -- 172.21.15.39:0/641906235 >> 172.21.15.39:0/641906235 conn(0x7fd1380fe830 msgr2=0x7fd138100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- 172.21.15.39:0/641906235 shutdown_connections 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- 172.21.15.39:0/641906235 wait complete. 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 Processor -- start 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- start start 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 0x7fd138199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 0x7fd13819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd138112e60 con 0x7fd138102dc0 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd138112ce0 con 0x7fd1381087d0 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.246+0000 7fd13ed9b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd138112fe0 con 0x7fd138109150 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53826/0 (socket says 172.21.15.39:53826) 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 -- 172.21.15.39:0/4161181663 learned_addr learned my addr 172.21.15.39:0/4161181663 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13d338640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 0x7fd13819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd137fff640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 0x7fd138199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 -- 172.21.15.39:0/4161181663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 msgr2=0x7fd13819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 0x7fd13819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 -- 172.21.15.39:0/4161181663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 msgr2=0x7fd138199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 0x7fd138199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 -- 172.21.15.39:0/4161181663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13819f3e0 con 0x7fd138102dc0 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13d338640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 0x7fd13819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd137fff640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 0x7fd138199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13cb37640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b4a0 tx=0x7fd12800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128014070 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd128010ac0 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13819f6d0 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.247+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128017c30 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.248+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1381a5e10 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.249+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1381031a0 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.250+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd128010610 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.251+0000 7fd135ffb640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 0x7fd1200b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.251+0000 7fd137fff640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 0x7fd1200b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.251+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fd1280e5550 con 0x7fd138102dc0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.251+0000 7fd137fff640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 0x7fd1200b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd12c000c00 tx=0x7fd12c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.255+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1280ac460 con 0x7fd138102dc0 2024-09-10T21:53:34.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.443+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd13802e5c0 con 0x7fd138102dc0 2024-09-10T21:53:34.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.444+0000 7fd135ffb640 1 -- 172.21.15.39:0/4161181663 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+22219 (secure 0 0 0) 0x7fd1280abd60 con 0x7fd138102dc0 2024-09-10T21:53:34.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:53:34.446 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:00.566056+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 msgr2=0x7fd1200b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 0x7fd1200b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd12c000c00 tx=0x7fd12c005a20 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 msgr2=0x7fd138199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b4a0 tx=0x7fd12800b960 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 shutdown_connections 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd1200b5370 0x7fd1200b7830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd138109150 0x7fd13819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1381087d0 0x7fd138199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 --2- 172.21.15.39:0/4161181663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd138102dc0 0x7fd138199330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 >> 172.21.15.39:0/4161181663 conn(0x7fd1380fe830 msgr2=0x7fd138100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 shutdown_connections 2024-09-10T21:53:34.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:34.447+0000 7fd13ed9b640 1 -- 172.21.15.39:0/4161181663 wait complete. 2024-09-10T21:53:34.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:34 smithi039 ceph-mon[30872]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-10T21:53:34.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:34 smithi173 ceph-mon[35294]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-10T21:53:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:34 smithi070 ceph-mon[34909]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-10T21:53:35.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T21:53:35.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T21:53:35.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T21:53:35.191 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T21:53:35.191 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T21:53:35.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T21:53:35.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T21:53:35.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T21:53:35.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T21:53:35.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T21:53:35.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T21:53:35.195 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T21:53:35.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:35 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4161181663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:35.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:35 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4161181663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:35.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:35 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4161181663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:53:36.007 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:36.279 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:36.279 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 -- 172.21.15.39:0/3556880299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac701087a0 msgr2=0x7fac70108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 --2- 172.21.15.39:0/3556880299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac701087a0 0x7fac70108be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac58009900 tx=0x7fac5802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 -- 172.21.15.39:0/3556880299 shutdown_connections 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 --2- 172.21.15.39:0/3556880299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70109120 0x7fac7010f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 --2- 172.21.15.39:0/3556880299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac701087a0 0x7fac70108be0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 --2- 172.21.15.39:0/3556880299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac70102d90 0x7fac70103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 -- 172.21.15.39:0/3556880299 >> 172.21.15.39:0/3556880299 conn(0x7fac700fe820 msgr2=0x7fac70100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:36.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 -- 172.21.15.39:0/3556880299 shutdown_connections 2024-09-10T21:53:36.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 -- 172.21.15.39:0/3556880299 wait complete. 2024-09-10T21:53:36.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.466+0000 7fac75f8e640 1 Processor -- start 2024-09-10T21:53:36.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 -- start start 2024-09-10T21:53:36.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac70102d90 0x7fac70199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:36.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac701087a0 0x7fac70199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:36.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 0x7fac7019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:36.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac70112dc0 con 0x7fac70109120 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac70112c40 con 0x7fac701087a0 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac75f8e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fac70112f40 con 0x7fac70102d90 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 0x7fac7019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 0x7fac7019eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53844/0 (socket says 172.21.15.39:53844) 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac6ffff640 1 -- 172.21.15.39:0/2674424524 learned_addr learned my addr 172.21.15.39:0/2674424524 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac6f7fe640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac70102d90 0x7fac70199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.467+0000 7fac6effd640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac701087a0 0x7fac70199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 -- 172.21.15.39:0/2674424524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac70102d90 msgr2=0x7fac70199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac70102d90 0x7fac70199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 -- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac701087a0 msgr2=0x7fac70199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac701087a0 0x7fac70199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7019f2e0 con 0x7fac70109120 2024-09-10T21:53:36.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6ffff640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 0x7fac7019eb10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e970 tx=0x7fac6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6800ccc0 con 0x7fac70109120 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7019f5d0 con 0x7fac70109120 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac6800ce60 con 0x7fac70109120 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68010430 con 0x7fac70109120 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.468+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac70075380 con 0x7fac70109120 2024-09-10T21:53:36.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.469+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac700638a0 con 0x7fac70109120 2024-09-10T21:53:36.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.472+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fac68004f70 con 0x7fac70109120 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.473+0000 7fac6cff9640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fac5c0b5370 0x7fac5c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.473+0000 7fac6f7fe640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fac5c0b5370 0x7fac5c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.473+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fac680e6350 con 0x7fac70109120 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6cff9640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] conn(0x7fac5c0beab0 0x7fac5c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac68025ea0 con 0x7fac5c0beab0 2024-09-10T21:53:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fac680e6830 con 0x7fac70109120 2024-09-10T21:53:36.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6f7fe640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fac5c0b5370 0x7fac5c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac60005fd0 tx=0x7fac60009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:36.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6effd640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] conn(0x7fac5c0beab0 0x7fac5c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:36.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.474+0000 7fac6effd640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] conn(0x7fac5c0beab0 0x7fac5c0c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:36.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.475+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== osd.1 v2:172.21.15.70:6800/2437314157 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac68025ea0 con 0x7fac5c0beab0 2024-09-10T21:53:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.489+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 --> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac70063d20 con 0x7fac5c0beab0 2024-09-10T21:53:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac6cff9640 1 -- 172.21.15.39:0/2674424524 <== osd.1 v2:172.21.15.70:6800/2437314157 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac70063d20 con 0x7fac5c0beab0 2024-09-10T21:53:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] conn(0x7fac5c0beab0 msgr2=0x7fac5c0c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] conn(0x7fac5c0beab0 0x7fac5c0c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fac5c0b5370 msgr2=0x7fac5c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fac5c0b5370 0x7fac5c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac60005fd0 tx=0x7fac60009760 comp rx=0 tx=0).stop 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 msgr2=0x7fac7019eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac75f8e640 1 --2- 172.21.15.39:0/2674424524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac70109120 0x7fac7019eb10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e970 tx=0x7fac6800ed70 comp rx=0 tx=0).stop 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.490+0000 7fac6ffff640 1 -- 172.21.15.39:0/2674424524 reap_dead start 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.491+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 shutdown_connections 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.491+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 >> 172.21.15.39:0/2674424524 conn(0x7fac700fe820 msgr2=0x7fac70100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.491+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 shutdown_connections 2024-09-10T21:53:36.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:36.491+0000 7fac75f8e640 1 -- 172.21.15.39:0/2674424524 wait complete. 2024-09-10T21:53:36.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:36 smithi039 ceph-mon[30872]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:53:36.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:36 smithi173 ceph-mon[35294]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:53:36.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:36 smithi070 ceph-mon[34909]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:53:37.313 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.316 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.317 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.318 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.318 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.353 INFO:teuthology.orchestra.run.smithi039.stdout:51539607621 2024-09-10T21:53:37.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T21:53:37.502 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 -- 172.21.15.39:0/844993892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 msgr2=0x7fe64010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 --2- 172.21.15.39:0/844993892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe64010f5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe638009900 tx=0x7fe63802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 -- 172.21.15.39:0/844993892 shutdown_connections 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 --2- 172.21.15.39:0/844993892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe64010f5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 --2- 172.21.15.39:0/844993892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 0x7fe64010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 --2- 172.21.15.39:0/844993892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 0x7fe6401040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 -- 172.21.15.39:0/844993892 >> 172.21.15.39:0/844993892 conn(0x7fe6400fd720 msgr2=0x7fe6400ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 -- 172.21.15.39:0/844993892 shutdown_connections 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.717+0000 7fe647d47640 1 -- 172.21.15.39:0/844993892 wait complete. 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 Processor -- start 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 -- start start 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 0x7fe640101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 0x7fe640101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe640102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe640112e90 con 0x7fe64010d140 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe640112d10 con 0x7fe640104600 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe647d47640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe640113010 con 0x7fe640103ce0 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe640102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe640102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53866/0 (socket says 172.21.15.39:53866) 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 -- 172.21.15.39:0/942789560 learned_addr learned my addr 172.21.15.39:0/942789560 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:37.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe645ae3640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 0x7fe640101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6452e2640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 0x7fe640101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 -- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 msgr2=0x7fe640101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 0x7fe640101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 -- 172.21.15.39:0/942789560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 msgr2=0x7fe640101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 0x7fe640101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6462e4640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401a7800 con 0x7fe64010d140 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe645ae3640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe640103ce0 0x7fe640101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.718+0000 7fe6452e2640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe640104600 0x7fe640101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:37.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe6462e4640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe640102410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe638009a20 tx=0x7fe638004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63803f030 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe638003aa0 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6401a7a90 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638035070 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.719+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6401a8040 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.720+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6400638e0 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.721+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe6380035f0 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe632ffd640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe62c0b53f0 0x7fe62c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe645ae3640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe62c0b53f0 0x7fe62c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fe638106d20 con 0x7fe64010d140 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe632ffd640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] conn(0x7fe62c0beb30 0x7fe62c0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe63802bec0 con 0x7fe62c0beb30 2024-09-10T21:53:37.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.722+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fe638107200 con 0x7fe64010d140 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.723+0000 7fe645ae3640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe62c0b53f0 0x7fe62c0b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe63c007eb0 tx=0x7fe63c0073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.723+0000 7fe6452e2640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] conn(0x7fe62c0beb30 0x7fe62c0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.723+0000 7fe6452e2640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] conn(0x7fe62c0beb30 0x7fe62c0c0f50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.724+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== osd.2 v2:172.21.15.173:6800/2216129379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe63802bec0 con 0x7fe62c0beb30 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 --> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe640063ce0 con 0x7fe62c0beb30 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe632ffd640 1 -- 172.21.15.39:0/942789560 <== osd.2 v2:172.21.15.173:6800/2216129379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe640063ce0 con 0x7fe62c0beb30 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] conn(0x7fe62c0beb30 msgr2=0x7fe62c0c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] conn(0x7fe62c0beb30 0x7fe62c0c0f50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe62c0b53f0 msgr2=0x7fe62c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe62c0b53f0 0x7fe62c0b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe63c007eb0 tx=0x7fe63c0073c0 comp rx=0 tx=0).stop 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 msgr2=0x7fe640102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:37.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe647d47640 1 --2- 172.21.15.39:0/942789560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64010d140 0x7fe640102410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe638009a20 tx=0x7fe638004270 comp rx=0 tx=0).stop 2024-09-10T21:53:37.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.738+0000 7fe6462e4640 1 -- 172.21.15.39:0/942789560 reap_dead start 2024-09-10T21:53:37.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.739+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 shutdown_connections 2024-09-10T21:53:37.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.739+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 >> 172.21.15.39:0/942789560 conn(0x7fe6400fd720 msgr2=0x7fe6400fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:37.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.739+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 shutdown_connections 2024-09-10T21:53:37.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:37.739+0000 7fe647d47640 1 -- 172.21.15.39:0/942789560 wait complete. 2024-09-10T21:53:38.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 -- 172.21.15.39:0/2201319466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af4108020 msgr2=0x7f3af410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 --2- 172.21.15.39:0/2201319466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af4108020 0x7f3af410e820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009ca0 tx=0x7f3aec02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 -- 172.21.15.39:0/2201319466 shutdown_connections 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 --2- 172.21.15.39:0/2201319466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af4108020 0x7f3af410e820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 --2- 172.21.15.39:0/2201319466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af41076a0 0x7f3af4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 --2- 172.21.15.39:0/2201319466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4101c90 0x7f3af4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 -- 172.21.15.39:0/2201319466 >> 172.21.15.39:0/2201319466 conn(0x7f3af40fd700 msgr2=0x7f3af40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 -- 172.21.15.39:0/2201319466 shutdown_connections 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.516+0000 7f3af9959640 1 -- 172.21.15.39:0/2201319466 wait complete. 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 Processor -- start 2024-09-10T21:53:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 -- start start 2024-09-10T21:53:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af4101c90 0x7f3af419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 0x7f3af419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4108020 0x7f3af419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4111ce0 con 0x7f3af41076a0 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4111b60 con 0x7f3af4108020 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af9959640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4111e60 con 0x7f3af4101c90 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af27fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 0x7f3af419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af27fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 0x7f3af419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53878/0 (socket says 172.21.15.39:53878) 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.517+0000 7f3af27fc640 1 -- 172.21.15.39:0/1226090778 learned_addr learned my addr 172.21.15.39:0/1226090778 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af37fe640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4108020 0x7f3af419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af2ffd640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af4101c90 0x7f3af419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 -- 172.21.15.39:0/1226090778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af4101c90 msgr2=0x7f3af419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af4101c90 0x7f3af419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 -- 172.21.15.39:0/1226090778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4108020 msgr2=0x7f3af419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4108020 0x7f3af419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af41a54d0 con 0x7f3af41076a0 2024-09-10T21:53:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af2ffd640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3af4101c90 0x7f3af419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.518+0000 7f3af27fc640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 0x7f3af419a630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800b4a0 tx=0x7f3ae800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.521+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8014070 con 0x7f3af41076a0 2024-09-10T21:53:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.522+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae8010ac0 con 0x7f3af41076a0 2024-09-10T21:53:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.522+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af41a57c0 con 0x7f3af41076a0 2024-09-10T21:53:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.522+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8017c30 con 0x7f3af41076a0 2024-09-10T21:53:38.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.522+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41a5dd0 con 0x7f3af41076a0 2024-09-10T21:53:38.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.523+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3af40638e0 con 0x7f3af41076a0 2024-09-10T21:53:38.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.524+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3ae8010610 con 0x7f3af41076a0 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af8957640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3adc0b53f0 0x7f3adc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af2ffd640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3adc0b53f0 0x7f3adc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f3ae80e54c0 con 0x7f3af41076a0 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af8957640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] conn(0x7f3adc0beb30 0x7f3adc0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3adc0c1600 con 0x7f3adc0beb30 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f3ae80e59a0 con 0x7f3af41076a0 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af37fe640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] conn(0x7f3adc0beb30 0x7f3adc0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:38.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.525+0000 7f3af2ffd640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3adc0b53f0 0x7f3adc0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40058c0 tx=0x7f3ae4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:38.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.526+0000 7f3af37fe640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] conn(0x7f3adc0beb30 0x7f3adc0c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:38.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.526+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== osd.3 v2:172.21.15.39:6810/924157830 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3adc0c1600 con 0x7f3adc0beb30 2024-09-10T21:53:38.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.540+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 --> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3af4063ce0 con 0x7f3adc0beb30 2024-09-10T21:53:38.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.540+0000 7f3af8957640 1 -- 172.21.15.39:0/1226090778 <== osd.3 v2:172.21.15.39:6810/924157830 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3af4063ce0 con 0x7f3adc0beb30 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] conn(0x7f3adc0beb30 msgr2=0x7f3adc0c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] conn(0x7f3adc0beb30 0x7f3adc0c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3adc0b53f0 msgr2=0x7f3adc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3adc0b53f0 0x7f3adc0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40058c0 tx=0x7f3ae4005850 comp rx=0 tx=0).stop 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 msgr2=0x7f3af419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 --2- 172.21.15.39:0/1226090778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3af41076a0 0x7f3af419a630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800b4a0 tx=0x7f3ae800b960 comp rx=0 tx=0).stop 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af37fe640 1 -- 172.21.15.39:0/1226090778 reap_dead start 2024-09-10T21:53:38.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 shutdown_connections 2024-09-10T21:53:38.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 >> 172.21.15.39:0/1226090778 conn(0x7f3af40fd700 msgr2=0x7f3af40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:38.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 shutdown_connections 2024-09-10T21:53:38.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:38.541+0000 7f3af9959640 1 -- 172.21.15.39:0/1226090778 wait complete. 2024-09-10T21:53:38.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:38 smithi039 ceph-mon[30872]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:53:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:38 smithi070 ceph-mon[34909]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:53:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:38 smithi173 ceph-mon[35294]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 -- 172.21.15.39:0/1056400523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c108030 msgr2=0x7ff89c10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/1056400523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c108030 0x7ff89c10e830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff894009ca0 tx=0x7ff89402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 -- 172.21.15.39:0/1056400523 shutdown_connections 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/1056400523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c108030 0x7ff89c10e830 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/1056400523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff89c1076b0 0x7ff89c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/1056400523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 0x7ff89c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.055+0000 7ff8a3a97640 1 -- 172.21.15.39:0/1056400523 >> 172.21.15.39:0/1056400523 conn(0x7ff89c0fd6d0 msgr2=0x7ff89c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:39.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- 172.21.15.39:0/1056400523 shutdown_connections 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- 172.21.15.39:0/1056400523 wait complete. 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 Processor -- start 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- start start 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 0x7ff89c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 0x7ff89c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff89c108030 0x7ff89c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c111cb0 con 0x7ff89c1076b0 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c111b30 con 0x7ff89c101ca0 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.056+0000 7ff8a3a97640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c111e30 con 0x7ff89c108030 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 0x7ff89c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 0x7ff89c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53900/0 (socket says 172.21.15.39:53900) 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 -- 172.21.15.39:0/3850032933 learned_addr learned my addr 172.21.15.39:0/3850032933 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1833640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 0x7ff89c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 -- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff89c108030 msgr2=0x7ff89c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a2034640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff89c108030 0x7ff89c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff89c108030 0x7ff89c19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 -- 172.21.15.39:0/3850032933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 msgr2=0x7ff89c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 0x7ff89c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c1a53c0 con 0x7ff89c1076b0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1833640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff89c101ca0 0x7ff89c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a1032640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 0x7ff89c19a520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d770 tx=0x7ff88c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c017070 con 0x7ff89c1076b0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff88c0054d0 con 0x7ff89c1076b0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c1a56b0 con 0x7ff89c1076b0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c004c30 con 0x7ff89c1076b0 2024-09-10T21:53:39.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.057+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c1a5bf0 con 0x7ff89c1076b0 2024-09-10T21:53:39.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.058+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff89c0638e0 con 0x7ff89c1076b0 2024-09-10T21:53:39.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.060+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff88c004dd0 con 0x7ff89c1076b0 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.060+0000 7ff892ffd640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff8880b53f0 0x7ff8880b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff8a1833640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff8880b53f0 0x7ff8880b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7ff88c0e5aa0 con 0x7ff89c1076b0 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff892ffd640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] conn(0x7ff8880beb30 0x7ff8880c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff88c021e50 con 0x7ff8880beb30 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7ff88c0e5f80 con 0x7ff89c1076b0 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff8a1833640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff8880b53f0 0x7ff8880b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff89800baa0 tx=0x7ff898005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.061+0000 7ff8a2034640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] conn(0x7ff8880beb30 0x7ff8880c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.062+0000 7ff8a2034640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] conn(0x7ff8880beb30 0x7ff8880c0f50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.062+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== osd.8 v2:172.21.15.173:6816/1670675498 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff88c021e50 con 0x7ff8880beb30 2024-09-10T21:53:39.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.076+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 --> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff89c063ce0 con 0x7ff8880beb30 2024-09-10T21:53:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff892ffd640 1 -- 172.21.15.39:0/3850032933 <== osd.8 v2:172.21.15.173:6816/1670675498 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff89c063ce0 con 0x7ff8880beb30 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] conn(0x7ff8880beb30 msgr2=0x7ff8880c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] conn(0x7ff8880beb30 0x7ff8880c0f50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff8880b53f0 msgr2=0x7ff8880b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff8880b53f0 0x7ff8880b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff89800baa0 tx=0x7ff898005d90 comp rx=0 tx=0).stop 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 msgr2=0x7ff89c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 --2- 172.21.15.39:0/3850032933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff89c1076b0 0x7ff89c19a520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d770 tx=0x7ff88c00dc30 comp rx=0 tx=0).stop 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a2034640 1 -- 172.21.15.39:0/3850032933 reap_dead start 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 shutdown_connections 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 >> 172.21.15.39:0/3850032933 conn(0x7ff89c0fd6d0 msgr2=0x7ff89c0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 shutdown_connections 2024-09-10T21:53:39.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.077+0000 7ff8a3a97640 1 -- 172.21.15.39:0/3850032933 wait complete. 2024-09-10T21:53:39.237 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 -- 172.21.15.39:0/734123600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e41087b0 msgr2=0x7fc9e4108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/734123600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e41087b0 0x7fc9e4108bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009900 tx=0x7fc9d402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 -- 172.21.15.39:0/734123600 shutdown_connections 2024-09-10T21:53:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/734123600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e4109130 0x7fc9e410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/734123600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e41087b0 0x7fc9e4108bf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/734123600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e4102da0 0x7fc9e4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.241+0000 7fc9eba0a640 1 -- 172.21.15.39:0/734123600 >> 172.21.15.39:0/734123600 conn(0x7fc9e40fe850 msgr2=0x7fc9e4100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.242+0000 7fc9eba0a640 1 -- 172.21.15.39:0/734123600 shutdown_connections 2024-09-10T21:53:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.242+0000 7fc9eba0a640 1 -- 172.21.15.39:0/734123600 wait complete. 2024-09-10T21:53:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.242+0000 7fc9eba0a640 1 Processor -- start 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 -- start start 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 0x7fc9e41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e41087b0 0x7fc9e41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e4109130 0x7fc9e419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4112df0 con 0x7fc9e4102da0 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4112c70 con 0x7fc9e41087b0 2024-09-10T21:53:39.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9eba0a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4112f70 con 0x7fc9e4109130 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9e97a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 0x7fc9e41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9e97a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 0x7fc9e41992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53914/0 (socket says 172.21.15.39:53914) 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9e97a6640 1 -- 172.21.15.39:0/4216377951 learned_addr learned my addr 172.21.15.39:0/4216377951 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9e8fa5640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e41087b0 0x7fc9e41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.243+0000 7fc9e9fa7640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e4109130 0x7fc9e419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 -- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e4109130 msgr2=0x7fc9e419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9e4109130 0x7fc9e419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 -- 172.21.15.39:0/4216377951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e41087b0 msgr2=0x7fc9e41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e41087b0 0x7fc9e41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e419f350 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e8fa5640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9e41087b0 0x7fc9e41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9e97a6640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 0x7fc9e41992a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c600 tx=0x7fc9e000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.244+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0012250 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.245+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e0011c00 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.245+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e001a960 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.245+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e419f640 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.245+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e4075380 con 0x7fc9e4102da0 2024-09-10T21:53:39.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.247+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9c8001060 con 0x7fc9e4102da0 2024-09-10T21:53:39.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.249+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc9e00123f0 con 0x7fc9e4102da0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9da7fc640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9d00b53f0 0x7fc9d00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fc9e00ea550 con 0x7fc9e4102da0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9da7fc640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] conn(0x7fc9d00beb30 0x7fc9d00c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9e002be50 con 0x7fc9d00beb30 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc9e00eaa30 con 0x7fc9e4102da0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.250+0000 7fc9e8fa5640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9d00b53f0 0x7fc9d00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.251+0000 7fc9e9fa7640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] conn(0x7fc9d00beb30 0x7fc9d00c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.251+0000 7fc9e8fa5640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9d00b53f0 0x7fc9d00b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4031440 tx=0x7fc9d4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.251+0000 7fc9e9fa7640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] conn(0x7fc9d00beb30 0x7fc9d00c0f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:39.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.252+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== osd.5 v2:172.21.15.173:6808/1964049526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9e002be50 con 0x7fc9d00beb30 2024-09-10T21:53:39.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.267+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 --> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9c8002e00 con 0x7fc9d00beb30 2024-09-10T21:53:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.268+0000 7fc9da7fc640 1 -- 172.21.15.39:0/4216377951 <== osd.5 v2:172.21.15.173:6808/1964049526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc9c8002e00 con 0x7fc9d00beb30 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] conn(0x7fc9d00beb30 msgr2=0x7fc9d00c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] conn(0x7fc9d00beb30 0x7fc9d00c0f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9d00b53f0 msgr2=0x7fc9d00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9d00b53f0 0x7fc9d00b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4031440 tx=0x7fc9d4005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 msgr2=0x7fc9e41992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 --2- 172.21.15.39:0/4216377951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9e4102da0 0x7fc9e41992a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c600 tx=0x7fc9e000cac0 comp rx=0 tx=0).stop 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9e9fa7640 1 -- 172.21.15.39:0/4216377951 reap_dead start 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 shutdown_connections 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 >> 172.21.15.39:0/4216377951 conn(0x7fc9e40fe850 msgr2=0x7fc9e4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 shutdown_connections 2024-09-10T21:53:39.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:39.269+0000 7fc9eba0a640 1 -- 172.21.15.39:0/4216377951 wait complete. 2024-09-10T21:53:39.726 INFO:teuthology.orchestra.run.smithi039.stdout:73014444098 2024-09-10T21:53:39.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.374+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/552513407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5810a920 msgr2=0x7fbe5810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.374+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/552513407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5810a920 0x7fbe5810cd10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009ca0 tx=0x7fbe4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/552513407 shutdown_connections 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/552513407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe5810d250 0x7fbe5810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/552513407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5810a920 0x7fbe5810cd10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/552513407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe58101810 0x7fbe58101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/552513407 >> 172.21.15.39:0/552513407 conn(0x7fbe58076f50 msgr2=0x7fbe58077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/552513407 shutdown_connections 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/552513407 wait complete. 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 Processor -- start 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.375+0000 7fbe5d5ef640 1 -- start start 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 0x7fbe5819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe5810a920 0x7fbe5819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe5810d250 0x7fbe581a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112d90 con 0x7fbe58101810 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112c10 con 0x7fbe5810a920 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe5d5ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112f10 con 0x7fbe5810d250 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 0x7fbe5819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 0x7fbe5819b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50384/0 (socket says 172.21.15.39:50384) 2024-09-10T21:53:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 -- 172.21.15.39:0/2757309006 learned_addr learned my addr 172.21.15.39:0/2757309006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe567fc640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe5810a920 0x7fbe5819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe577fe640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe5810d250 0x7fbe581a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 -- 172.21.15.39:0/2757309006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe5810d250 msgr2=0x7fbe581a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe5810d250 0x7fbe581a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 -- 172.21.15.39:0/2757309006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe5810a920 msgr2=0x7fbe5819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe5810a920 0x7fbe5819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe581a14d0 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe56ffd640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 0x7fbe5819b420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c920 tx=0x7fbe4800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.376+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48007c70 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.377+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe581a17c0 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.377+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe48007e10 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.377+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48018820 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.377+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe581a7e80 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.377+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe58109700 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.379+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbe4800f450 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe3ffff640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbe400b5370 0x7fbe400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe567fc640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbe400b5370 0x7fbe400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fbe480e6070 con 0x7fbe58101810 2024-09-10T21:53:40.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe3ffff640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] conn(0x7fbe400beaa0 0x7fbe400c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe48023e50 con 0x7fbe400beaa0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fbe480e6550 con 0x7fbe58101810 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe577fe640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] conn(0x7fbe400beaa0 0x7fbe400c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.380+0000 7fbe567fc640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbe400b5370 0x7fbe400b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe5810a850 tx=0x7fbe4c009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.381+0000 7fbe577fe640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] conn(0x7fbe400beaa0 0x7fbe400c0ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.381+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== osd.0 v2:172.21.15.39:6802/3224124863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe48023e50 con 0x7fbe400beaa0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.395+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 --> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe5806ae10 con 0x7fbe400beaa0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.395+0000 7fbe3ffff640 1 -- 172.21.15.39:0/2757309006 <== osd.0 v2:172.21.15.39:6802/3224124863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe5806ae10 con 0x7fbe400beaa0 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.395+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] conn(0x7fbe400beaa0 msgr2=0x7fbe400c0ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.395+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] conn(0x7fbe400beaa0 0x7fbe400c0ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbe400b5370 msgr2=0x7fbe400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbe400b5370 0x7fbe400b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe5810a850 tx=0x7fbe4c009900 comp rx=0 tx=0).stop 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 msgr2=0x7fbe5819b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:40.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 --2- 172.21.15.39:0/2757309006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe58101810 0x7fbe5819b420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c920 tx=0x7fbe4800cde0 comp rx=0 tx=0).stop 2024-09-10T21:53:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe577fe640 1 -- 172.21.15.39:0/2757309006 reap_dead start 2024-09-10T21:53:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 shutdown_connections 2024-09-10T21:53:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 >> 172.21.15.39:0/2757309006 conn(0x7fbe58076f50 msgr2=0x7fbe58108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 shutdown_connections 2024-09-10T21:53:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:40.396+0000 7fbe5d5ef640 1 -- 172.21.15.39:0/2757309006 wait complete. 2024-09-10T21:53:40.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:40 smithi039 ceph-mon[30872]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T21:53:40.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:40 smithi070 ceph-mon[34909]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T21:53:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:40 smithi173 ceph-mon[35294]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-10T21:53:41.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 -- 172.21.15.39:0/4078646259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 msgr2=0x7fefac10ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 --2- 172.21.15.39:0/4078646259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac10ef60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009900 tx=0x7fefa802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:41.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 -- 172.21.15.39:0/4078646259 shutdown_connections 2024-09-10T21:53:41.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 --2- 172.21.15.39:0/4078646259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefac10f4a0 0x7fefac111890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 --2- 172.21.15.39:0/4078646259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac10ef60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 --2- 172.21.15.39:0/4078646259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac1018f0 0x7fefac101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 -- 172.21.15.39:0/4078646259 >> 172.21.15.39:0/4078646259 conn(0x7fefac0fd700 msgr2=0x7fefac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 -- 172.21.15.39:0/4078646259 shutdown_connections 2024-09-10T21:53:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.079+0000 7fefb3f68640 1 -- 172.21.15.39:0/4078646259 wait complete. 2024-09-10T21:53:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 Processor -- start 2024-09-10T21:53:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 -- start start 2024-09-10T21:53:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac1018f0 0x7fefac19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefac10f4a0 0x7fefac1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fefac114fa0 con 0x7fefac102210 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefac114e20 con 0x7fefac1018f0 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb3f68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fefac115120 con 0x7fefac10f4a0 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb1503640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb1503640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac19ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50412/0 (socket says 172.21.15.39:50412) 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb1503640 1 -- 172.21.15.39:0/1350425025 learned_addr learned my addr 172.21.15.39:0/1350425025 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.080+0000 7fefb1d04640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac1018f0 0x7fefac19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb2505640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefac10f4a0 0x7fefac1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 -- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefac10f4a0 msgr2=0x7fefac1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefac10f4a0 0x7fefac1a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 -- 172.21.15.39:0/1350425025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac1018f0 msgr2=0x7fefac19b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac1018f0 0x7fefac19b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac1a1580 con 0x7fefac102210 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb1503640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac19ba10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005940 tx=0x7fefa8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa803f030 con 0x7fefac102210 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefa8003aa0 con 0x7fefac102210 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac1a1810 con 0x7fefac102210 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8035070 con 0x7fefac102210 2024-09-10T21:53:41.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.081+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac1a7f30 con 0x7fefac102210 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.082+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefac110c60 con 0x7fefac102210 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.084+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fefa803bcc0 con 0x7fefac102210 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.084+0000 7fef9effd640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fef980b5370 0x7fef980b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.084+0000 7fefb1d04640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fef980b5370 0x7fef980b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fefa8106c70 con 0x7fefac102210 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fef9effd640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] conn(0x7fef980beab0 0x7fef980c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef980c1580 con 0x7fef980beab0 2024-09-10T21:53:41.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fefa8107150 con 0x7fefac102210 2024-09-10T21:53:41.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fefb1d04640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fef980b5370 0x7fef980b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005d00 tx=0x7fefa000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fefb2505640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] conn(0x7fef980beab0 0x7fef980c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.085+0000 7fefb2505640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] conn(0x7fef980beab0 0x7fef980c0ed0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.086+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== osd.11 v2:172.21.15.173:6824/921760262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef980c1580 con 0x7fef980beab0 2024-09-10T21:53:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.100+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 --> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fefac06bb10 con 0x7fef980beab0 2024-09-10T21:53:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.100+0000 7fef9effd640 1 -- 172.21.15.39:0/1350425025 <== osd.11 v2:172.21.15.173:6824/921760262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fefac06bb10 con 0x7fef980beab0 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] conn(0x7fef980beab0 msgr2=0x7fef980c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] conn(0x7fef980beab0 0x7fef980c0ed0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fef980b5370 msgr2=0x7fef980b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fef980b5370 0x7fef980b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005d00 tx=0x7fefa000b410 comp rx=0 tx=0).stop 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 msgr2=0x7fefac19ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 --2- 172.21.15.39:0/1350425025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefac102210 0x7fefac19ba10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005940 tx=0x7fefa8004270 comp rx=0 tx=0).stop 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb2505640 1 -- 172.21.15.39:0/1350425025 reap_dead start 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 shutdown_connections 2024-09-10T21:53:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 >> 172.21.15.39:0/1350425025 conn(0x7fefac0fd700 msgr2=0x7fefac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 shutdown_connections 2024-09-10T21:53:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.101+0000 7fefb3f68640 1 -- 172.21.15.39:0/1350425025 wait complete. 2024-09-10T21:53:41.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 -- 172.21.15.39:0/1236646487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d04103ca0 msgr2=0x7f1d04104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 --2- 172.21.15.39:0/1236646487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d04103ca0 0x7f1d04104080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009ca0 tx=0x7f1cf402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 -- 172.21.15.39:0/1236646487 shutdown_connections 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 --2- 172.21.15.39:0/1236646487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d0410d100 0x7f1d0410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 --2- 172.21.15.39:0/1236646487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d041045c0 0x7f1d0410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 --2- 172.21.15.39:0/1236646487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d04103ca0 0x7f1d04104080 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 -- 172.21.15.39:0/1236646487 >> 172.21.15.39:0/1236646487 conn(0x7f1d040fd700 msgr2=0x7f1d040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 -- 172.21.15.39:0/1236646487 shutdown_connections 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.622+0000 7f1d09f50640 1 -- 172.21.15.39:0/1236646487 wait complete. 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 Processor -- start 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 -- start start 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d04103ca0 0x7f1d04199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 0x7f1d04199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d0410d100 0x7f1d0419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04112d70 con 0x7f1d041045c0 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04112bf0 con 0x7f1d0410d100 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.623+0000 7f1d09f50640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04112ef0 con 0x7f1d04103ca0 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 0x7f1d04199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 0x7f1d04199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50438/0 (socket says 172.21.15.39:50438) 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 -- 172.21.15.39:0/919384529 learned_addr learned my addr 172.21.15.39:0/919384529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d037fe640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d04103ca0 0x7f1d04199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d03fff640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d0410d100 0x7f1d0419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 -- 172.21.15.39:0/919384529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d04103ca0 msgr2=0x7f1d04199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d04103ca0 0x7f1d04199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 -- 172.21.15.39:0/919384529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d0410d100 msgr2=0x7f1d0419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d0410d100 0x7f1d0419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0419f2b0 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d037fe640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d04103ca0 0x7f1d04199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d03fff640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d0410d100 0x7f1d0419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d02ffd640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 0x7f1d04199740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00c970 tx=0x7f1cec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec007bb0 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0419f5a0 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cec007d50 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00f720 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.624+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d041a5e30 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.625+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d040ff660 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.627+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f1cec020030 con 0x7f1d041045c0 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d00ff9640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1cf00b5370 0x7f1cf00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d037fe640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1cf00b5370 0x7f1cf00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f1cec0e61e0 con 0x7f1d041045c0 2024-09-10T21:53:41.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d00ff9640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] conn(0x7f1cf00beab0 0x7f1cf00c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cec01ee70 con 0x7f1cf00beab0 2024-09-10T21:53:41.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1cec0e66c0 con 0x7f1d041045c0 2024-09-10T21:53:41.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d03fff640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] conn(0x7f1cf00beab0 0x7f1cf00c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.628+0000 7f1d037fe640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1cf00b5370 0x7f1cf00b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4000f80 tx=0x7f1cf4009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.629+0000 7f1d03fff640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] conn(0x7f1cf00beab0 0x7f1cf00c0ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.629+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== osd.6 v2:172.21.15.39:6818/52541614 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1cec01ee70 con 0x7f1cf00beab0 2024-09-10T21:53:41.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.643+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 --> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d0406b1b0 con 0x7f1cf00beab0 2024-09-10T21:53:41.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d00ff9640 1 -- 172.21.15.39:0/919384529 <== osd.6 v2:172.21.15.39:6818/52541614 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1d0406b1b0 con 0x7f1cf00beab0 2024-09-10T21:53:41.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] conn(0x7f1cf00beab0 msgr2=0x7f1cf00c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] conn(0x7f1cf00beab0 0x7f1cf00c0ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1cf00b5370 msgr2=0x7f1cf00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1cf00b5370 0x7f1cf00b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4000f80 tx=0x7f1cf4009800 comp rx=0 tx=0).stop 2024-09-10T21:53:41.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 msgr2=0x7f1d04199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 --2- 172.21.15.39:0/919384529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d041045c0 0x7f1d04199740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00c970 tx=0x7f1cec00ce30 comp rx=0 tx=0).stop 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d03fff640 1 -- 172.21.15.39:0/919384529 reap_dead start 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 shutdown_connections 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 >> 172.21.15.39:0/919384529 conn(0x7f1d040fd700 msgr2=0x7f1d0410f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 shutdown_connections 2024-09-10T21:53:41.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.644+0000 7f1d09f50640 1 -- 172.21.15.39:0/919384529 wait complete. 2024-09-10T21:53:41.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 -- 172.21.15.39:0/440343995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf34102de0 msgr2=0x7fdf341031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/440343995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf34102de0 0x7fdf341031c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009900 tx=0x7fdf2802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 -- 172.21.15.39:0/440343995 shutdown_connections 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/440343995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 0x7fdf3410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/440343995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf341087f0 0x7fdf34108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/440343995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf34102de0 0x7fdf341031c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 -- 172.21.15.39:0/440343995 >> 172.21.15.39:0/440343995 conn(0x7fdf340fe830 msgr2=0x7fdf34100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.828+0000 7fdf3b25f640 1 -- 172.21.15.39:0/440343995 shutdown_connections 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.829+0000 7fdf3b25f640 1 -- 172.21.15.39:0/440343995 wait complete. 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.829+0000 7fdf3b25f640 1 Processor -- start 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 -- start start 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf34102de0 0x7fdf3419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 0x7fdf3419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 0x7fdf341a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34112df0 con 0x7fdf341087f0 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34112c70 con 0x7fdf34109170 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf3b25f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34112f70 con 0x7fdf34102de0 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 0x7fdf3419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 0x7fdf3419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50450/0 (socket says 172.21.15.39:50450) 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 -- 172.21.15.39:0/1374708637 learned_addr learned my addr 172.21.15.39:0/1374708637 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf38ffb640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf34102de0 0x7fdf3419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf397fc640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 0x7fdf341a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 -- 172.21.15.39:0/1374708637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf34102de0 msgr2=0x7fdf3419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf34102de0 0x7fdf3419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 -- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 msgr2=0x7fdf341a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 0x7fdf341a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf33fff640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf341a14e0 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.830+0000 7fdf397fc640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf34109170 0x7fdf341a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf33fff640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 0x7fdf3419b970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c920 tx=0x7fdf2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20007c70 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf341a17d0 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf20007e10 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20018820 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.831+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf341a7e90 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.832+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf340638a0 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.834+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fdf2000f450 con 0x7fdf341087f0 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.834+0000 7fdf31ffb640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdf240b5370 0x7fdf240b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.834+0000 7fdf38ffb640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdf240b5370 0x7fdf240b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.834+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7fdf200e6120 con 0x7fdf341087f0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf31ffb640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] conn(0x7fdf240beab0 0x7fdf240c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf20023e50 con 0x7fdf240beab0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdf200e6600 con 0x7fdf341087f0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf38ffb640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdf240b5370 0x7fdf240b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf28031440 tx=0x7fdf28005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf397fc640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] conn(0x7fdf240beab0 0x7fdf240c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.835+0000 7fdf397fc640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] conn(0x7fdf240beab0 0x7fdf240c0ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.836+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== osd.10 v2:172.21.15.70:6824/1015386076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf20023e50 con 0x7fdf240beab0 2024-09-10T21:53:41.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.850+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 --> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf34063ca0 con 0x7fdf240beab0 2024-09-10T21:53:41.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf31ffb640 1 -- 172.21.15.39:0/1374708637 <== osd.10 v2:172.21.15.70:6824/1015386076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf34063ca0 con 0x7fdf240beab0 2024-09-10T21:53:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] conn(0x7fdf240beab0 msgr2=0x7fdf240c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] conn(0x7fdf240beab0 0x7fdf240c0ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdf240b5370 msgr2=0x7fdf240b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fdf240b5370 0x7fdf240b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf28031440 tx=0x7fdf28005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 msgr2=0x7fdf3419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf3b25f640 1 --2- 172.21.15.39:0/1374708637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf341087f0 0x7fdf3419b970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c920 tx=0x7fdf2000cde0 comp rx=0 tx=0).stop 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.851+0000 7fdf397fc640 1 -- 172.21.15.39:0/1374708637 reap_dead start 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.852+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 shutdown_connections 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.852+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 >> 172.21.15.39:0/1374708637 conn(0x7fdf340fe830 msgr2=0x7fdf34104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.852+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 shutdown_connections 2024-09-10T21:53:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:41.852+0000 7fdf3b25f640 1 -- 172.21.15.39:0/1374708637 wait complete. 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 -- 172.21.15.39:0/341942935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4864104590 msgr2=0x7f486410cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 --2- 172.21.15.39:0/341942935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4864104590 0x7f486410cb70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4854009900 tx=0x7f485402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 -- 172.21.15.39:0/341942935 shutdown_connections 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 --2- 172.21.15.39:0/341942935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f486410d140 0x7f486410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 --2- 172.21.15.39:0/341942935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4864104590 0x7f486410cb70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 --2- 172.21.15.39:0/341942935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864103b90 0x7f4864103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 -- 172.21.15.39:0/341942935 >> 172.21.15.39:0/341942935 conn(0x7f48640fd700 msgr2=0x7f48640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 -- 172.21.15.39:0/341942935 shutdown_connections 2024-09-10T21:53:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.055+0000 7f486b400640 1 -- 172.21.15.39:0/341942935 wait complete. 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 Processor -- start 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 -- start start 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4864103b90 0x7f48641992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864104590 0x7f48641997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 0x7f486419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4864112d60 con 0x7f486410d140 2024-09-10T21:53:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4864112be0 con 0x7f4864104590 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.056+0000 7f486b400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4864112ee0 con 0x7f4864103b90 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 0x7f486419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 0x7f486419eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50460/0 (socket says 172.21.15.39:50460) 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 -- 172.21.15.39:0/1659022182 learned_addr learned my addr 172.21.15.39:0/1659022182 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486919c640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4864103b90 0x7f48641992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486899b640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864104590 0x7f48641997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 -- 172.21.15.39:0/1659022182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4864103b90 msgr2=0x7f48641992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4864103b90 0x7f48641992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 -- 172.21.15.39:0/1659022182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864104590 msgr2=0x7f48641997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864104590 0x7f48641997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486419f360 con 0x7f486410d140 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486899b640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4864104590 0x7f48641997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486999d640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 0x7f486419eb90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485c00ccb0 tx=0x7f485c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:42.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c00f450 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486419f650 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f485c00faa0 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c018b00 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.057+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48641a5d10 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.058+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48640638e0 con 0x7f486410d140 2024-09-10T21:53:42.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.060+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f485c00f5f0 con 0x7f486410d140 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f485a7fc640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f48500b5370 0x7f48500b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f486919c640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f48500b5370 0x7f48500b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7979+0+0 (secure 0 0 0) 0x7f485c0e6650 con 0x7f486410d140 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f485a7fc640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] conn(0x7f48500beab0 0x7f48500c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f485c012ec0 con 0x7f48500beab0 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.061+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f485c0e6a00 con 0x7f486410d140 2024-09-10T21:53:42.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.062+0000 7f486899b640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] conn(0x7f48500beab0 0x7f48500c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:42.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.062+0000 7f486919c640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f48500b5370 0x7f48500b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f486000bbe0 tx=0x7f486000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:42.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.062+0000 7f486899b640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] conn(0x7f48500beab0 0x7f48500c0ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:42.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.063+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== osd.9 v2:172.21.15.39:6826/4072421182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f485c012ec0 con 0x7f48500beab0 2024-09-10T21:53:42.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.076+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 --> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4864063d60 con 0x7f48500beab0 2024-09-10T21:53:42.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f485a7fc640 1 -- 172.21.15.39:0/1659022182 <== osd.9 v2:172.21.15.39:6826/4072421182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4864063d60 con 0x7f48500beab0 2024-09-10T21:53:42.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] conn(0x7f48500beab0 msgr2=0x7f48500c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] conn(0x7f48500beab0 0x7f48500c0ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:42.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f48500b5370 msgr2=0x7f48500b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f48500b5370 0x7f48500b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f486000bbe0 tx=0x7f486000b390 comp rx=0 tx=0).stop 2024-09-10T21:53:42.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 msgr2=0x7f486419eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 --2- 172.21.15.39:0/1659022182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f486410d140 0x7f486419eb90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485c00ccb0 tx=0x7f485c00a620 comp rx=0 tx=0).stop 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486999d640 1 -- 172.21.15.39:0/1659022182 reap_dead start 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 shutdown_connections 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 >> 172.21.15.39:0/1659022182 conn(0x7f48640fd700 msgr2=0x7f48640fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 shutdown_connections 2024-09-10T21:53:42.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:42.077+0000 7f486b400640 1 -- 172.21.15.39:0/1659022182 wait complete. 2024-09-10T21:53:42.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:42 smithi039 ceph-mon[30872]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-10T21:53:42.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:42 smithi070 ceph-mon[34909]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-10T21:53:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:42 smithi173 ceph-mon[35294]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-10T21:53:43.071 INFO:teuthology.orchestra.run.smithi039.stdout:210453397539 2024-09-10T21:53:43.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T21:53:43.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.713+0000 7f7f752a2640 1 -- 172.21.15.39:0/2460646500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f7010d120 msgr2=0x7f7f7010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.713+0000 7f7f752a2640 1 --2- 172.21.15.39:0/2460646500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f7010d120 0x7f7f7010f550 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009ca0 tx=0x7f7f6802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.713+0000 7f7f752a2640 1 -- 172.21.15.39:0/2460646500 shutdown_connections 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 --2- 172.21.15.39:0/2460646500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f7010d120 0x7f7f7010f550 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 --2- 172.21.15.39:0/2460646500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f70104570 0x7f7f7010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 --2- 172.21.15.39:0/2460646500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f70103b70 0x7f7f70103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 -- 172.21.15.39:0/2460646500 >> 172.21.15.39:0/2460646500 conn(0x7f7f700fd700 msgr2=0x7f7f700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 -- 172.21.15.39:0/2460646500 shutdown_connections 2024-09-10T21:53:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 -- 172.21.15.39:0/2460646500 wait complete. 2024-09-10T21:53:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.714+0000 7f7f752a2640 1 Processor -- start 2024-09-10T21:53:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 -- start start 2024-09-10T21:53:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 0x7f7f70199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f70104570 0x7f7f701998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f7010d120 0x7f7f7019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70112dc0 con 0x7f7f70103b70 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70112c40 con 0x7f7f70104570 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f752a2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70112f40 con 0x7f7f7010d120 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 0x7f7f70199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 0x7f7f70199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50476/0 (socket says 172.21.15.39:50476) 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 -- 172.21.15.39:0/228709159 learned_addr learned my addr 172.21.15.39:0/228709159 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6e7fc640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f70104570 0x7f7f701998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6f7fe640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f7010d120 0x7f7f7019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 -- 172.21.15.39:0/228709159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f7010d120 msgr2=0x7f7f7019ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f7010d120 0x7f7f7019ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 -- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f70104570 msgr2=0x7f7f701998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f70104570 0x7f7f701998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.715+0000 7f7f6effd640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7019f440 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f6effd640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 0x7f7f70199390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000d770 tx=0x7f7f6000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60017070 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7019f730 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f60009820 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60004bc0 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.716+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f701a5df0 con 0x7f7f70103b70 2024-09-10T21:53:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.717+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f70063820 con 0x7f7f70103b70 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.718+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7f60005220 con 0x7f7f70103b70 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f57fff640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7f580b53f0 0x7f7f580b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f6e7fc640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7f580b53f0 0x7f7f580b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8211+0+0 (secure 0 0 0) 0x7f7f600e5bb0 con 0x7f7f70103b70 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f57fff640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] conn(0x7f7f580bee90 0x7f7f580c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f60021e50 con 0x7f7f580bee90 2024-09-10T21:53:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f7f600e6000 con 0x7f7f70103b70 2024-09-10T21:53:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.719+0000 7f7f6e7fc640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7f580b53f0 0x7f7f580b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f700fffe0 tx=0x7f7f64009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.720+0000 7f7f6f7fe640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] conn(0x7f7f580bee90 0x7f7f580c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.720+0000 7f7f6f7fe640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] conn(0x7f7f580bee90 0x7f7f580c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.721+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== osd.7 v2:172.21.15.70:6816/2255770710 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f60021e50 con 0x7f7f580bee90 2024-09-10T21:53:43.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.734+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 --> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f70063ca0 con 0x7f7f580bee90 2024-09-10T21:53:43.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f57fff640 1 -- 172.21.15.39:0/228709159 <== osd.7 v2:172.21.15.70:6816/2255770710 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7f70063ca0 con 0x7f7f580bee90 2024-09-10T21:53:43.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] conn(0x7f7f580bee90 msgr2=0x7f7f580c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] conn(0x7f7f580bee90 0x7f7f580c1330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7f580b53f0 msgr2=0x7f7f580b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7f580b53f0 0x7f7f580b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f700fffe0 tx=0x7f7f64009110 comp rx=0 tx=0).stop 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 msgr2=0x7f7f70199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f752a2640 1 --2- 172.21.15.39:0/228709159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f70103b70 0x7f7f70199390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000d770 tx=0x7f7f6000db70 comp rx=0 tx=0).stop 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.735+0000 7f7f6f7fe640 1 -- 172.21.15.39:0/228709159 reap_dead start 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.736+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 shutdown_connections 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.736+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 >> 172.21.15.39:0/228709159 conn(0x7f7f700fd700 msgr2=0x7f7f700fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.736+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 shutdown_connections 2024-09-10T21:53:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.736+0000 7f7f752a2640 1 -- 172.21.15.39:0/228709159 wait complete. 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-10T21:53:43.814 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:43 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:53:43.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-10T21:53:43.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:43 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 -- 172.21.15.39:0/1902737327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4108060 msgr2=0x7f91d410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 --2- 172.21.15.39:0/1902737327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4108060 0x7f91d410e860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009ca0 tx=0x7f91cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 -- 172.21.15.39:0/1902737327 shutdown_connections 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 --2- 172.21.15.39:0/1902737327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4108060 0x7f91d410e860 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 --2- 172.21.15.39:0/1902737327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91d41076e0 0x7f91d4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 --2- 172.21.15.39:0/1902737327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d4101cd0 0x7f91d41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 -- 172.21.15.39:0/1902737327 >> 172.21.15.39:0/1902737327 conn(0x7f91d40fd700 msgr2=0x7f91d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 -- 172.21.15.39:0/1902737327 shutdown_connections 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.895+0000 7f91db1b5640 1 -- 172.21.15.39:0/1902737327 wait complete. 2024-09-10T21:53:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 Processor -- start 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 -- start start 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 0x7f91d4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91d41076e0 0x7f91d41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d4108060 0x7f91d419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4112e00 con 0x7f91d4101cd0 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4112c80 con 0x7f91d4108060 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91db1b5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4112f80 con 0x7f91d41076e0 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 0x7f91d4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 0x7f91d4199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50494/0 (socket says 172.21.15.39:50494) 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 -- 172.21.15.39:0/3240854877 learned_addr learned my addr 172.21.15.39:0/3240854877 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d9752640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d4108060 0x7f91d419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d3fff640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91d41076e0 0x7f91d41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 -- 172.21.15.39:0/3240854877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91d41076e0 msgr2=0x7f91d41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91d41076e0 0x7f91d41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 -- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d4108060 msgr2=0x7f91d419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d4108060 0x7f91d419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.896+0000 7f91d8f51640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d419f320 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91d8f51640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 0x7f91d4199270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91c800d950 tx=0x7f91c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8017070 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91c8009c30 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d419f610 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c800f620 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.897+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d41a5ea0 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.898+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91d40fe9c0 con 0x7f91d4101cd0 2024-09-10T21:53:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.899+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f91c8010460 con 0x7f91d4101cd0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.900+0000 7f91d1ffb640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f91c40b53f0 0x7f91c40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.900+0000 7f91d3fff640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f91c40b53f0 0x7f91c40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.900+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8211+0+0 (secure 0 0 0) 0x7f91c80e5d80 con 0x7f91d4101cd0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d1ffb640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] conn(0x7f91c40bee90 0x7f91c40c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91c8012e50 con 0x7f91c40bee90 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f91c80e61d0 con 0x7f91d4101cd0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d3fff640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f91c40b53f0 0x7f91c40b78b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005d80 tx=0x7f91c0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d9752640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] conn(0x7f91c40bee90 0x7f91c40c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.901+0000 7f91d9752640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] conn(0x7f91c40bee90 0x7f91c40c1330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.902+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== osd.4 v2:172.21.15.70:6808/345717748 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91c8012e50 con 0x7f91c40bee90 2024-09-10T21:53:43.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.916+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 --> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91d4102f80 con 0x7f91c40bee90 2024-09-10T21:53:43.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91d1ffb640 1 -- 172.21.15.39:0/3240854877 <== osd.4 v2:172.21.15.70:6808/345717748 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f91d4102f80 con 0x7f91c40bee90 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] conn(0x7f91c40bee90 msgr2=0x7f91c40c1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] conn(0x7f91c40bee90 0x7f91c40c1330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f91c40b53f0 msgr2=0x7f91c40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f91c40b53f0 0x7f91c40b78b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005d80 tx=0x7f91c0005c90 comp rx=0 tx=0).stop 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 msgr2=0x7f91d4199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 --2- 172.21.15.39:0/3240854877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91d4101cd0 0x7f91d4199270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91c800d950 tx=0x7f91c800de10 comp rx=0 tx=0).stop 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91d9752640 1 -- 172.21.15.39:0/3240854877 reap_dead start 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 shutdown_connections 2024-09-10T21:53:43.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 >> 172.21.15.39:0/3240854877 conn(0x7f91d40fd700 msgr2=0x7f91d40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:43.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 shutdown_connections 2024-09-10T21:53:43.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:43.917+0000 7f91db1b5640 1 -- 172.21.15.39:0/3240854877 wait complete. 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T21:53:43.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T21:53:43.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-10T21:53:43.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:43 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T21:53:44.671 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T21:53:44.672 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T21:53:44.672 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T21:53:44.672 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:53:44.672 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:44 smithi039 ceph-mon[30872]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:53:44.698 INFO:teuthology.orchestra.run.smithi039.stdout:167503724590 2024-09-10T21:53:44.698 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T21:53:44.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T21:53:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T21:53:44.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:53:44.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:44 smithi070 ceph-mon[34909]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T21:53:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T21:53:44.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:53:44.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:44 smithi173 ceph-mon[35294]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:53:45.150 INFO:teuthology.orchestra.run.smithi039.stdout:236223201311 2024-09-10T21:53:45.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T21:53:45.647 INFO:teuthology.orchestra.run.smithi039.stdout:34359738445 2024-09-10T21:53:45.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T21:53:45.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:45 smithi070 ceph-mon[34909]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:53:45.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:45 smithi039 ceph-mon[30872]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:53:45.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:45 smithi173 ceph-mon[35294]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:53:46.320 INFO:teuthology.orchestra.run.smithi039.stdout:124554051640 2024-09-10T21:53:46.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T21:53:46.812 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:46 smithi039 ceph-mon[30872]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-10T21:53:46.813 INFO:teuthology.orchestra.run.smithi039.stdout:146028888114 2024-09-10T21:53:46.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T21:53:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:46 smithi070 ceph-mon[34909]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-10T21:53:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:46 smithi173 ceph-mon[35294]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-10T21:53:47.376 INFO:teuthology.orchestra.run.smithi039.stdout:279172874262 2024-09-10T21:53:47.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T21:53:47.777 INFO:teuthology.orchestra.run.smithi039.stdout:98784247869 2024-09-10T21:53:47.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T21:53:48.165 INFO:teuthology.orchestra.run.smithi039.stdout:184683593769 2024-09-10T21:53:48.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T21:53:48.661 INFO:teuthology.orchestra.run.smithi039.stdout:257698037786 2024-09-10T21:53:48.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T21:53:48.730 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:48.731 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:48.733 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:48.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:48 smithi039 ceph-mon[30872]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T21:53:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:48 smithi070 ceph-mon[34909]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T21:53:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:48 smithi173 ceph-mon[35294]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 -- 172.21.15.39:0/2911203655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c1087d0 msgr2=0x7f313c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 --2- 172.21.15.39:0/2911203655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c1087d0 0x7f313c108c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f312c009900 tx=0x7f312c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 -- 172.21.15.39:0/2911203655 shutdown_connections 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 --2- 172.21.15.39:0/2911203655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c109150 0x7f313c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 --2- 172.21.15.39:0/2911203655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c1087d0 0x7f313c108c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 --2- 172.21.15.39:0/2911203655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c102dc0 0x7f313c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 -- 172.21.15.39:0/2911203655 >> 172.21.15.39:0/2911203655 conn(0x7f313c0fe830 msgr2=0x7f313c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 -- 172.21.15.39:0/2911203655 shutdown_connections 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.372+0000 7f31437eb640 1 -- 172.21.15.39:0/2911203655 wait complete. 2024-09-10T21:53:49.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 Processor -- start 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 -- start start 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 0x7f313c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c1087d0 0x7f313c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f313c112e10 con 0x7f313c109150 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f313c112c90 con 0x7f313c1087d0 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f31437eb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f313c112f90 con 0x7f313c102dc0 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50514/0 (socket says 172.21.15.39:50514) 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 -- 172.21.15.39:0/4205031036 learned_addr learned my addr 172.21.15.39:0/4205031036 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3140d86640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c1087d0 0x7f313c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141587640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 0x7f313c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 -- 172.21.15.39:0/4205031036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 msgr2=0x7f313c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 0x7f313c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 -- 172.21.15.39:0/4205031036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c1087d0 msgr2=0x7f313c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c1087d0 0x7f313c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141d88640 1 -- 172.21.15.39:0/4205031036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c19f390 con 0x7f313c109150 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.373+0000 7f3141587640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 0x7f313c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f3141d88640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f313400cad0 tx=0x7f313400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400ae20 con 0x7f313c109150 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3134005020 con 0x7f313c109150 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c19f680 con 0x7f313c109150 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400f6b0 con 0x7f313c109150 2024-09-10T21:53:49.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.374+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c1a5dc0 con 0x7f313c109150 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.375+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c1031a0 con 0x7f313c109150 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.376+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f31340054f0 con 0x7f313c109150 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.377+0000 7f31327fc640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 0x7f31280b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.377+0000 7f3141587640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 0x7f31280b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.377+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31340e5e50 con 0x7f313c109150 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.377+0000 7f3141587640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 0x7f31280b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3138006fd0 tx=0x7f3138008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.381+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3134014030 con 0x7f313c109150 2024-09-10T21:53:49.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.571+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f313c02e5c0 con 0x7f313c109150 2024-09-10T21:53:49.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.574+0000 7f31327fc640 1 -- 172.21.15.39:0/4205031036 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31340acbc0 con 0x7f313c109150 2024-09-10T21:53:49.576 INFO:teuthology.orchestra.run.smithi039.stdout:51539607624 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 msgr2=0x7f31280b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 0x7f31280b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3138006fd0 tx=0x7f3138008040 comp rx=0 tx=0).stop 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 msgr2=0x7f313c19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f313400cad0 tx=0x7f313400cf90 comp rx=0 tx=0).stop 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 shutdown_connections 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31280b5370 0x7f31280b7830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f313c109150 0x7f313c19ebc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f313c1087d0 0x7f313c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 --2- 172.21.15.39:0/4205031036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f313c102dc0 0x7f313c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 >> 172.21.15.39:0/4205031036 conn(0x7f313c0fe830 msgr2=0x7f313c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:49.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 shutdown_connections 2024-09-10T21:53:49.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.576+0000 7f31437eb640 1 -- 172.21.15.39:0/4205031036 wait complete. 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 -- 172.21.15.39:0/132972316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3674102dc0 msgr2=0x7f36741031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 --2- 172.21.15.39:0/132972316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3674102dc0 0x7f36741031a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3664009900 tx=0x7f366402a410 comp rx=0 tx=0).stop 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 -- 172.21.15.39:0/132972316 shutdown_connections 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 --2- 172.21.15.39:0/132972316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674109150 0x7f367410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 --2- 172.21.15.39:0/132972316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36741087d0 0x7f3674108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 --2- 172.21.15.39:0/132972316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3674102dc0 0x7f36741031a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 -- 172.21.15.39:0/132972316 >> 172.21.15.39:0/132972316 conn(0x7f36740fe870 msgr2=0x7f3674100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 -- 172.21.15.39:0/132972316 shutdown_connections 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 -- 172.21.15.39:0/132972316 wait complete. 2024-09-10T21:53:49.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.565+0000 7f3679655640 1 Processor -- start 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 -- start start 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674102dc0 0x7f36740754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3674109150 0x7f3674075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3674112e10 con 0x7f36741087d0 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3674112c90 con 0x7f3674102dc0 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3679655640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3674112f90 con 0x7f3674109150 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50528/0 (socket says 172.21.15.39:50528) 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 -- 172.21.15.39:0/1876367859 learned_addr learned my addr 172.21.15.39:0/1876367859 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f3672ffd640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674102dc0 0x7f36740754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36737fe640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3674109150 0x7f3674075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 -- 172.21.15.39:0/1876367859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3674109150 msgr2=0x7f3674075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3674109150 0x7f3674075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 -- 172.21.15.39:0/1876367859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674102dc0 msgr2=0x7f36740754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674102dc0 0x7f36740754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 -- 172.21.15.39:0/1876367859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36741a7700 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f36727fc640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f366800e9f0 tx=0x7f366800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.566+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366800cd80 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.567+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36680054d0 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.567+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36741a79f0 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.567+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668010690 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.567+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36741a7ee0 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.568+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36741031a0 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.569+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3668004e90 con 0x7f36741087d0 2024-09-10T21:53:49.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.570+0000 7f365bfff640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 0x7f365c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:49.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.570+0000 7f3672ffd640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 0x7f365c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:49.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.570+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f36680e6210 con 0x7f36741087d0 2024-09-10T21:53:49.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.570+0000 7f3672ffd640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 0x7f365c0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3664031440 tx=0x7f3664005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:49.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.574+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36680acf80 con 0x7f36741087d0 2024-09-10T21:53:49.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.764+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f367402e5c0 con 0x7f36741087d0 2024-09-10T21:53:49.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.765+0000 7f365bfff640 1 -- 172.21.15.39:0/1876367859 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36680ac880 con 0x7f36741087d0 2024-09-10T21:53:49.767 INFO:teuthology.orchestra.run.smithi039.stdout:146028888116 2024-09-10T21:53:49.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 msgr2=0x7f365c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 0x7f365c0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3664031440 tx=0x7f3664005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:49.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 msgr2=0x7f36740759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:49.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f366800e9f0 tx=0x7f366800edf0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 shutdown_connections 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f365c0b5370 0x7f365c0b7830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3674109150 0x7f3674075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36741087d0 0x7f36740759e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 --2- 172.21.15.39:0/1876367859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3674102dc0 0x7f36740754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 >> 172.21.15.39:0/1876367859 conn(0x7f36740fe870 msgr2=0x7f3674100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 shutdown_connections 2024-09-10T21:53:49.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:49.767+0000 7f3679655640 1 -- 172.21.15.39:0/1876367859 wait complete. 2024-09-10T21:53:50.468 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.468 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.470 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.471 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.471 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.473 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.478 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888116 for osd.5 2024-09-10T21:53:50.478 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:50.761 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:50 smithi039 ceph-mon[30872]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 11 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:50.761 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:50 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4205031036' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:53:50.762 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:50 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1876367859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:53:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:50.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:50 smithi070 ceph-mon[34909]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 11 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:50.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:50 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4205031036' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:53:50.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:50 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1876367859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:53:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:50 smithi173 ceph-mon[35294]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 11 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:50 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4205031036' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:53:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:50 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1876367859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 -- 172.21.15.39:0/3173745608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410d250 msgr2=0x7fc95410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/3173745608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410d250 0x7fc95410f640 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009ca0 tx=0x7fc94c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 -- 172.21.15.39:0/3173745608 shutdown_connections 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/3173745608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410d250 0x7fc95410f640 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/3173745608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410a920 0x7fc95410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/3173745608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 -- 172.21.15.39:0/3173745608 >> 172.21.15.39:0/3173745608 conn(0x7fc954076f50 msgr2=0x7fc954077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.346+0000 7fc95bfb7640 1 -- 172.21.15.39:0/3173745608 shutdown_connections 2024-09-10T21:53:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 -- 172.21.15.39:0/3173745608 wait complete. 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 Processor -- start 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 -- start start 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410d250 0x7fc95419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc954112d90 con 0x7fc95410a920 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc954112c10 con 0x7fc954101810 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc95bfb7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc954112f10 con 0x7fc95410d250 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc959552640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc959552640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51468/0 (socket says 172.21.15.39:51468) 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.347+0000 7fc959552640 1 -- 172.21.15.39:0/1402455113 learned_addr learned my addr 172.21.15.39:0/1402455113 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959d53640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc95a554640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410d250 0x7fc95419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 -- 172.21.15.39:0/1402455113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410d250 msgr2=0x7fc95419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410d250 0x7fc95419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 -- 172.21.15.39:0/1402455113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 msgr2=0x7fc954199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 -- 172.21.15.39:0/1402455113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95419f2b0 con 0x7fc95410a920 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959d53640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc959552640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc94400d770 tx=0x7fc94400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944017070 con 0x7fc95410a920 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95419f5a0 con 0x7fc95410a920 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9440054d0 con 0x7fc95410a920 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944004c30 con 0x7fc95410a920 2024-09-10T21:53:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.348+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9541a5c60 con 0x7fc95410a920 2024-09-10T21:53:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.349+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc954101bf0 con 0x7fc95410a920 2024-09-10T21:53:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.351+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc944004dd0 con 0x7fc95410a920 2024-09-10T21:53:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.351+0000 7fc94affd640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 0x7fc9400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.352+0000 7fc959d53640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 0x7fc9400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.352+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc9440e5c80 con 0x7fc95410a920 2024-09-10T21:53:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.352+0000 7fc959d53640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 0x7fc9400b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc95000abe0 tx=0x7fc95000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.354+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9440ac9f0 con 0x7fc95410a920 2024-09-10T21:53:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.541+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc9541a5fa0 con 0x7fc95410a920 2024-09-10T21:53:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.542+0000 7fc94affd640 1 -- 172.21.15.39:0/1402455113 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9440ac2f0 con 0x7fc95410a920 2024-09-10T21:53:51.544 INFO:teuthology.orchestra.run.smithi039.stdout:167503724591 2024-09-10T21:53:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 msgr2=0x7fc9400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 0x7fc9400b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc95000abe0 tx=0x7fc95000a5c0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 msgr2=0x7fc954199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc94400d770 tx=0x7fc94400dc30 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 shutdown_connections 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc9400b5370 0x7fc9400b7830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95410d250 0x7fc95419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95410a920 0x7fc954199740 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 --2- 172.21.15.39:0/1402455113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc954101810 0x7fc954199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 >> 172.21.15.39:0/1402455113 conn(0x7fc954076f50 msgr2=0x7fc9541005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 shutdown_connections 2024-09-10T21:53:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.545+0000 7fc95bfb7640 1 -- 172.21.15.39:0/1402455113 wait complete. 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 -- 172.21.15.39:0/2744908847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568103ca0 msgr2=0x7f9568104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2744908847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568103ca0 0x7f9568104080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f955c009900 tx=0x7f955c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 -- 172.21.15.39:0/2744908847 shutdown_connections 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2744908847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f956810d100 0x7f956810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2744908847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95681045c0 0x7f956810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2744908847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568103ca0 0x7f9568104080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 -- 172.21.15.39:0/2744908847 >> 172.21.15.39:0/2744908847 conn(0x7f95680fd700 msgr2=0x7f95680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 -- 172.21.15.39:0/2744908847 shutdown_connections 2024-09-10T21:53:51.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 -- 172.21.15.39:0/2744908847 wait complete. 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.549+0000 7f956ee4a640 1 Processor -- start 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 -- start start 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9568103ca0 0x7f9568199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f956810d100 0x7f956819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9568112d70 con 0x7f95681045c0 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9568112bf0 con 0x7f956810d100 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956ee4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9568112ef0 con 0x7f9568103ca0 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51492/0 (socket says 172.21.15.39:51492) 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 -- 172.21.15.39:0/2648585497 learned_addr learned my addr 172.21.15.39:0/2648585497 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956cbe6640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9568103ca0 0x7f9568199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f956d3e7640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f956810d100 0x7f956819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 -- 172.21.15.39:0/2648585497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9568103ca0 msgr2=0x7f9568199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9568103ca0 0x7f9568199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 -- 172.21.15.39:0/2648585497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f956810d100 msgr2=0x7f956819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f956810d100 0x7f956819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 -- 172.21.15.39:0/2648585497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956819f310 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.550+0000 7f9567fff640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f955400d740 tx=0x7f955400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.551+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554017020 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.551+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956819f600 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.551+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f955400de50 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.551+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955400f620 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.551+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95681a5e90 con 0x7f95681045c0 2024-09-10T21:53:51.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.552+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9568104080 con 0x7f95681045c0 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.554+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9554010460 con 0x7f95681045c0 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.554+0000 7f9565ffb640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 0x7f95580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.554+0000 7f956cbe6640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 0x7f95580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.554+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f95540e5c40 con 0x7f95681045c0 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.555+0000 7f956cbe6640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 0x7f95580b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f955c031440 tx=0x7f955c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:51.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.558+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9554021070 con 0x7f95681045c0 2024-09-10T21:53:51.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:51 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1402455113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:53:51.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.746+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f956819a390 con 0x7f95681045c0 2024-09-10T21:53:51.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.746+0000 7f9565ffb640 1 -- 172.21.15.39:0/2648585497 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f95540aca40 con 0x7f95681045c0 2024-09-10T21:53:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:34359738447 2024-09-10T21:53:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 msgr2=0x7f95580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 0x7f95580b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f955c031440 tx=0x7f955c005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 msgr2=0x7f95681997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f955400d740 tx=0x7f955400dc00 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 shutdown_connections 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f95580b5370 0x7f95580b7830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f956810d100 0x7f956819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681045c0 0x7f95681997a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 --2- 172.21.15.39:0/2648585497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9568103ca0 0x7f9568199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 >> 172.21.15.39:0/2648585497 conn(0x7f95680fd700 msgr2=0x7f95680fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 shutdown_connections 2024-09-10T21:53:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:51.749+0000 7f956ee4a640 1 -- 172.21.15.39:0/2648585497 wait complete. 2024-09-10T21:53:51.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:51 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1402455113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:53:51.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:51 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1402455113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:53:52.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 -- 172.21.15.39:0/720976535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3901087d0 msgr2=0x7fc390108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:52.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 --2- 172.21.15.39:0/720976535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3901087d0 0x7fc390108c10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc380009900 tx=0x7fc38002a410 comp rx=0 tx=0).stop 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 -- 172.21.15.39:0/720976535 shutdown_connections 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 --2- 172.21.15.39:0/720976535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc390109150 0x7fc39010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 --2- 172.21.15.39:0/720976535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3901087d0 0x7fc390108c10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 --2- 172.21.15.39:0/720976535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390102dc0 0x7fc3901031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 -- 172.21.15.39:0/720976535 >> 172.21.15.39:0/720976535 conn(0x7fc3900fe830 msgr2=0x7fc390100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.067+0000 7fc397dbc640 1 -- 172.21.15.39:0/720976535 shutdown_connections 2024-09-10T21:53:52.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 -- 172.21.15.39:0/720976535 wait complete. 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 Processor -- start 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 -- start start 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3901087d0 0x7fc3900754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390109150 0x7fc390075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112e50 con 0x7fc390102dc0 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112cd0 con 0x7fc390109150 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.068+0000 7fc397dbc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112fd0 con 0x7fc3901087d0 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:52.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51508/0 (socket says 172.21.15.39:51508) 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 -- 172.21.15.39:0/527651858 learned_addr learned my addr 172.21.15.39:0/527651858 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395357640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3901087d0 0x7fc3900754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc396359640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390109150 0x7fc390075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 -- 172.21.15.39:0/527651858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3901087d0 msgr2=0x7fc3900754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3901087d0 0x7fc3900754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 -- 172.21.15.39:0/527651858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390109150 msgr2=0x7fc390075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390109150 0x7fc390075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 -- 172.21.15.39:0/527651858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3901abd80 con 0x7fc390102dc0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc395b58640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b4a0 tx=0x7fc38c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c014070 con 0x7fc390102dc0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c010ac0 con 0x7fc390102dc0 2024-09-10T21:53:52.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3901abf50 con 0x7fc390102dc0 2024-09-10T21:53:52.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c017c30 con 0x7fc390102dc0 2024-09-10T21:53:52.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.069+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901ac4d0 con 0x7fc390102dc0 2024-09-10T21:53:52.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.071+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390103220 con 0x7fc390102dc0 2024-09-10T21:53:52.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.073+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc38c010610 con 0x7fc390102dc0 2024-09-10T21:53:52.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.074+0000 7fc386ffd640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 0x7fc37c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:52.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.074+0000 7fc395357640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 0x7fc37c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:52.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.075+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc38c0e5600 con 0x7fc390102dc0 2024-09-10T21:53:52.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.075+0000 7fc395357640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 0x7fc37c0b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc380000c00 tx=0x7fc380031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:52.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.077+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc38c0ac370 con 0x7fc390102dc0 2024-09-10T21:53:52.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.265+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc39002e5c0 con 0x7fc390102dc0 2024-09-10T21:53:52.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.265+0000 7fc386ffd640 1 -- 172.21.15.39:0/527651858 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc38c0abc70 con 0x7fc390102dc0 2024-09-10T21:53:52.267 INFO:teuthology.orchestra.run.smithi039.stdout:236223201313 2024-09-10T21:53:52.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 msgr2=0x7fc37c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:52.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 0x7fc37c0b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc380000c00 tx=0x7fc380031400 comp rx=0 tx=0).stop 2024-09-10T21:53:52.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 msgr2=0x7fc390076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:52.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b4a0 tx=0x7fc38c00b960 comp rx=0 tx=0).stop 2024-09-10T21:53:52.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 shutdown_connections 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc37c0b53f0 0x7fc37c0b78b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc390109150 0x7fc390075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3901087d0 0x7fc3900754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 --2- 172.21.15.39:0/527651858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc390102dc0 0x7fc390076f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 >> 172.21.15.39:0/527651858 conn(0x7fc3900fe830 msgr2=0x7fc390100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 shutdown_connections 2024-09-10T21:53:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:52.267+0000 7fc397dbc640 1 -- 172.21.15.39:0/527651858 wait complete. 2024-09-10T21:53:52.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:52 smithi070 ceph-mon[34909]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2648585497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:53:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/527651858' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:53:52.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:52 smithi039 ceph-mon[30872]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:52.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2648585497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:53:52.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/527651858' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:53:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:53:52.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2024-09-10T21:53:52.969 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:52 smithi173 ceph-mon[35294]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2648585497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:53:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/527651858' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:53:53.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 -- 172.21.15.39:0/3000883464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb81076c0 msgr2=0x7f3cb8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/3000883464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb81076c0 0x7f3cb8107b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009900 tx=0x7f3cac02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 -- 172.21.15.39:0/3000883464 shutdown_connections 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/3000883464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb8108040 0x7f3cb810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/3000883464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb81076c0 0x7f3cb8107b00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/3000883464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8101cb0 0x7f3cb8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 -- 172.21.15.39:0/3000883464 >> 172.21.15.39:0/3000883464 conn(0x7f3cb80fd700 msgr2=0x7f3cb80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 -- 172.21.15.39:0/3000883464 shutdown_connections 2024-09-10T21:53:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.203+0000 7f3cbd06b640 1 -- 172.21.15.39:0/3000883464 wait complete. 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 Processor -- start 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 -- start start 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb81076c0 0x7f3cb819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8108040 0x7f3cb819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8111cc0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8111b40 con 0x7f3cb8108040 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cbd06b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8111e40 con 0x7f3cb81076c0 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cb6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cb6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51530/0 (socket says 172.21.15.39:51530) 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cb6d9d640 1 -- 172.21.15.39:0/1279432630 learned_addr learned my addr 172.21.15.39:0/1279432630 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.204+0000 7f3cb659c640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb81076c0 0x7f3cb819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb759e640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8108040 0x7f3cb819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 -- 172.21.15.39:0/1279432630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb81076c0 msgr2=0x7f3cb819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb81076c0 0x7f3cb819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 -- 172.21.15.39:0/1279432630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8108040 msgr2=0x7f3cb819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8108040 0x7f3cb819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 -- 172.21.15.39:0/1279432630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb81a54d0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cb6d9d640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d950 tx=0x7f3ca800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8017030 con 0x7f3cb8101cb0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb81a57c0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca8004020 con 0x7f3cb8101cb0 2024-09-10T21:53:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80047a0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.205+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81a5cd0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.206+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8102090 con 0x7f3cb8101cb0 2024-09-10T21:53:53.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.208+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3ca8009a30 con 0x7f3cb8101cb0 2024-09-10T21:53:53.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.209+0000 7f3c9ffff640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 0x7f3ca00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.209+0000 7f3cb659c640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 0x7f3ca00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.209+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3ca80e5eb0 con 0x7f3cb8101cb0 2024-09-10T21:53:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.210+0000 7f3cb659c640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 0x7f3ca00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3cac031440 tx=0x7f3cac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.212+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3ca80acc20 con 0x7f3cb8101cb0 2024-09-10T21:53:53.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.403+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3cb806b900 con 0x7f3cb8101cb0 2024-09-10T21:53:53.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.403+0000 7f3c9ffff640 1 -- 172.21.15.39:0/1279432630 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ca80ac520 con 0x7f3cb8101cb0 2024-09-10T21:53:53.405 INFO:teuthology.orchestra.run.smithi039.stdout:98784247871 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 msgr2=0x7f3ca00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 0x7f3ca00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3cac031440 tx=0x7f3cac005b50 comp rx=0 tx=0).stop 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 msgr2=0x7f3cb819a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d950 tx=0x7f3ca800de10 comp rx=0 tx=0).stop 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 shutdown_connections 2024-09-10T21:53:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3ca00b5370 0x7f3ca00b7830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb8108040 0x7f3cb819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb81076c0 0x7f3cb819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 --2- 172.21.15.39:0/1279432630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cb8101cb0 0x7f3cb819a0f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.405+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 >> 172.21.15.39:0/1279432630 conn(0x7f3cb80fd700 msgr2=0x7f3cb80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.406+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 shutdown_connections 2024-09-10T21:53:53.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:53.406+0000 7f3cbd06b640 1 -- 172.21.15.39:0/1279432630 wait complete. 2024-09-10T21:53:53.614 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724590 got 167503724591 for osd.6 2024-09-10T21:53:53.614 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:53.905 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:53 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1279432630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:53:53.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:53 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1279432630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:53:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:53 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1279432630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 -- 172.21.15.39:0/3301632215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f010f420 msgr2=0x7fe7f0111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/3301632215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f010f420 0x7fe7f0111810 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009ca0 tx=0x7fe7e802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 -- 172.21.15.39:0/3301632215 shutdown_connections 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/3301632215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f010f420 0x7fe7f0111810 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/3301632215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0102190 0x7fe7f010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/3301632215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7f0101870 0x7fe7f0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 -- 172.21.15.39:0/3301632215 >> 172.21.15.39:0/3301632215 conn(0x7fe7f00fd700 msgr2=0x7fe7f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:54.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 -- 172.21.15.39:0/3301632215 shutdown_connections 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.626+0000 7fe7f7edb640 1 -- 172.21.15.39:0/3301632215 wait complete. 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 Processor -- start 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 -- start start 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 0x7fe7f019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7f010f420 0x7fe7f01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f0114f60 con 0x7fe7f0102190 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f0114de0 con 0x7fe7f0101870 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f7edb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f01150e0 con 0x7fe7f010f420 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f5476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f5476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51542/0 (socket says 172.21.15.39:51542) 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f5476640 1 -- 172.21.15.39:0/1062770473 learned_addr learned my addr 172.21.15.39:0/1062770473 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:54.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.627+0000 7fe7f5c77640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 0x7fe7f019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 -- 172.21.15.39:0/1062770473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7f010f420 msgr2=0x7fe7f01a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7f010f420 0x7fe7f01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 -- 172.21.15.39:0/1062770473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 msgr2=0x7fe7f019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 0x7fe7f019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 -- 172.21.15.39:0/1062770473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f01a14e0 con 0x7fe7f0102190 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5c77640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 0x7fe7f019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f5476640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c890 tx=0x7fe7e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004220 con 0x7fe7f0102190 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7e00043c0 con 0x7fe7f0102190 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f01a17d0 con 0x7fe7f0102190 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004a00 con 0x7fe7f0102190 2024-09-10T21:53:54.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.628+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f01a7e90 con 0x7fe7f0102190 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.629+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f0101c50 con 0x7fe7f0102190 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.630+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe7e00079b0 con 0x7fe7f0102190 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.631+0000 7fe7e6ffd640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 0x7fe7dc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.632+0000 7fe7f5c77640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 0x7fe7dc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.632+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe7e00e5f30 con 0x7fe7f0102190 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.632+0000 7fe7f5c77640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 0x7fe7dc0b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0058c0 tx=0x7fe7ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:54.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.635+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe7e0014030 con 0x7fe7f0102190 2024-09-10T21:53:54.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.825+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe7f019c560 con 0x7fe7f0102190 2024-09-10T21:53:54.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:54 smithi039 ceph-mon[30872]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 58 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:54.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.826+0000 7fe7e6ffd640 1 -- 172.21.15.39:0/1062770473 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7e00accc0 con 0x7fe7f0102190 2024-09-10T21:53:54.828 INFO:teuthology.orchestra.run.smithi039.stdout:124554051642 2024-09-10T21:53:54.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.828+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 msgr2=0x7fe7dc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:54.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.828+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 0x7fe7dc0b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0058c0 tx=0x7fe7ec005850 comp rx=0 tx=0).stop 2024-09-10T21:53:54.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.828+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 msgr2=0x7fe7f019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.828+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c890 tx=0x7fe7e000cd50 comp rx=0 tx=0).stop 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 shutdown_connections 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe7dc0b53f0 0x7fe7dc0b78b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7f010f420 0x7fe7f01a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7f0102190 0x7fe7f019b970 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 --2- 172.21.15.39:0/1062770473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7f0101870 0x7fe7f019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 >> 172.21.15.39:0/1062770473 conn(0x7fe7f00fd700 msgr2=0x7fe7f00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 shutdown_connections 2024-09-10T21:53:54.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:54.829+0000 7fe7f7edb640 1 -- 172.21.15.39:0/1062770473 wait complete. 2024-09-10T21:53:54.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:54 smithi070 ceph-mon[34909]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 58 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:54 smithi173 ceph-mon[35294]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 58 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T21:53:55.455 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051640 got 124554051642 for osd.4 2024-09-10T21:53:55.456 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- 172.21.15.39:0/3968022384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc1076b0 msgr2=0x7f71cc107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 --2- 172.21.15.39:0/3968022384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc1076b0 0x7f71cc107af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009900 tx=0x7f71c002a410 comp rx=0 tx=0).stop 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- 172.21.15.39:0/3968022384 shutdown_connections 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 --2- 172.21.15.39:0/3968022384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc108030 0x7f71cc10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 --2- 172.21.15.39:0/3968022384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc1076b0 0x7f71cc107af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 --2- 172.21.15.39:0/3968022384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- 172.21.15.39:0/3968022384 >> 172.21.15.39:0/3968022384 conn(0x7f71cc0fd730 msgr2=0x7f71cc0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- 172.21.15.39:0/3968022384 shutdown_connections 2024-09-10T21:53:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- 172.21.15.39:0/3968022384 wait complete. 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 Processor -- start 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.637+0000 7f71d2783640 1 -- start start 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc1076b0 0x7f71cc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc111cb0 con 0x7f71cc108030 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc111b30 con 0x7f71cc101ca0 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d2783640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc111e30 con 0x7f71cc1076b0 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:55.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51552/0 (socket says 172.21.15.39:51552) 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 -- 172.21.15.39:0/1120602372 learned_addr learned my addr 172.21.15.39:0/1120602372 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71cb7fe640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc1076b0 0x7f71cc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 -- 172.21.15.39:0/1120602372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc1076b0 msgr2=0x7f71cc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc1076b0 0x7f71cc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 -- 172.21.15.39:0/1120602372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 msgr2=0x7f71cc19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71d0d20640 1 -- 172.21.15.39:0/1120602372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc1a54a0 con 0x7f71cc108030 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.638+0000 7f71cbfff640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71d0d20640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71c400eaa0 tx=0x7f71c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400cdb0 con 0x7f71cc108030 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c4005020 con 0x7f71cc108030 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc1a5790 con 0x7f71cc108030 2024-09-10T21:53:55.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c40116d0 con 0x7f71cc108030 2024-09-10T21:53:55.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.639+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc1a5cf0 con 0x7f71cc108030 2024-09-10T21:53:55.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.640+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc102080 con 0x7f71cc108030 2024-09-10T21:53:55.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.642+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f71c400f040 con 0x7f71cc108030 2024-09-10T21:53:55.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.643+0000 7f71c97fa640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 0x7f71b40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:55.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.643+0000 7f71cbfff640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 0x7f71b40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:55.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.643+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f71c40e5f30 con 0x7f71cc108030 2024-09-10T21:53:55.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.643+0000 7f71cbfff640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 0x7f71b40b78b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00bfd0 tx=0x7f71bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:55.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.646+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f71c4016030 con 0x7f71cc108030 2024-09-10T21:53:55.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.831+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f71cc06b6e0 con 0x7f71cc108030 2024-09-10T21:53:55.832 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:55 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1062770473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:53:55.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.831+0000 7f71c97fa640 1 -- 172.21.15.39:0/1120602372 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71c40acd20 con 0x7f71cc108030 2024-09-10T21:53:55.832 INFO:teuthology.orchestra.run.smithi039.stdout:210453397542 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 msgr2=0x7f71b40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 0x7f71b40b78b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00bfd0 tx=0x7f71bc00b390 comp rx=0 tx=0).stop 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 msgr2=0x7f71cc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71c400eaa0 tx=0x7f71c400ef60 comp rx=0 tx=0).stop 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 shutdown_connections 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b53f0 0x7f71b40b78b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71cc108030 0x7f71cc19ab60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc1076b0 0x7f71cc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 --2- 172.21.15.39:0/1120602372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71cc101ca0 0x7f71cc19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 >> 172.21.15.39:0/1120602372 conn(0x7f71cc0fd730 msgr2=0x7f71cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 shutdown_connections 2024-09-10T21:53:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:55.833+0000 7f71d2783640 1 -- 172.21.15.39:0/1120602372 wait complete. 2024-09-10T21:53:55.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:55 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1062770473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:53:55.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:55 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1062770473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:53:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 -- 172.21.15.39:0/3668704258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07010f3d0 msgr2=0x7fe0701117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 --2- 172.21.15.39:0/3668704258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07010f3d0 0x7fe0701117c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe068009ca0 tx=0x7fe06802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 -- 172.21.15.39:0/3668704258 shutdown_connections 2024-09-10T21:53:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 --2- 172.21.15.39:0/3668704258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07010f3d0 0x7fe0701117c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 --2- 172.21.15.39:0/3668704258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 0x7fe07010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 --2- 172.21.15.39:0/3668704258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0700754c0 0x7fe0700758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 -- 172.21.15.39:0/3668704258 >> 172.21.15.39:0/3668704258 conn(0x7fe0700fe830 msgr2=0x7fe070100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 -- 172.21.15.39:0/3668704258 shutdown_connections 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.389+0000 7fe07615a640 1 -- 172.21.15.39:0/3668704258 wait complete. 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.390+0000 7fe07615a640 1 Processor -- start 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.390+0000 7fe07615a640 1 -- start start 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.390+0000 7fe07615a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 0x7fe07019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe07010f3d0 0x7fe0701a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe070114f70 con 0x7fe0700754c0 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe070114df0 con 0x7fe070075de0 2024-09-10T21:53:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701150f0 con 0x7fe07010f3d0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51574/0 (socket says 172.21.15.39:51574) 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 -- 172.21.15.39:0/4041476219 learned_addr learned my addr 172.21.15.39:0/4041476219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06effd640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 0x7fe07019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06ffff640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe07010f3d0 0x7fe0701a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 -- 172.21.15.39:0/4041476219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe07010f3d0 msgr2=0x7fe0701a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe07010f3d0 0x7fe0701a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 -- 172.21.15.39:0/4041476219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 msgr2=0x7fe07019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 0x7fe07019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 -- 172.21.15.39:0/4041476219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a14f0 con 0x7fe0700754c0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06f7fe640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d950 tx=0x7fe06000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017030 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a17e0 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe060004020 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0600047a0 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.391+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701a8070 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.392+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0700758a0 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.394+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe060009a30 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.395+0000 7fe06cff9640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 0x7fe0580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.395+0000 7fe06effd640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 0x7fe0580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.395+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe0600e5de0 con 0x7fe0700754c0 2024-09-10T21:53:56.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.395+0000 7fe06effd640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 0x7fe0580b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe070101070 tx=0x7fe06400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:56.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.398+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe0600acb50 con 0x7fe0700754c0 2024-09-10T21:53:56.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.585+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe0701a83b0 con 0x7fe0700754c0 2024-09-10T21:53:56.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.590+0000 7fe06cff9640 1 -- 172.21.15.39:0/4041476219 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe0600ac450 con 0x7fe0700754c0 2024-09-10T21:53:56.590 INFO:teuthology.orchestra.run.smithi039.stdout:257698037788 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 -- 172.21.15.39:0/3500281636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c101c90 msgr2=0x7fd73c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 --2- 172.21.15.39:0/3500281636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c101c90 0x7fd73c102070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009900 tx=0x7fd72c02a410 comp rx=0 tx=0).stop 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 -- 172.21.15.39:0/3500281636 shutdown_connections 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 --2- 172.21.15.39:0/3500281636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c108020 0x7fd73c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 --2- 172.21.15.39:0/3500281636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 0x7fd73c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 --2- 172.21.15.39:0/3500281636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c101c90 0x7fd73c102070 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 -- 172.21.15.39:0/3500281636 >> 172.21.15.39:0/3500281636 conn(0x7fd73c0fd700 msgr2=0x7fd73c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 -- 172.21.15.39:0/3500281636 shutdown_connections 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.580+0000 7fd7410d0640 1 -- 172.21.15.39:0/3500281636 wait complete. 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 Processor -- start 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 -- start start 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 0x7fd73c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 0x7fd73c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c111ce0 con 0x7fd73c108020 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c111b60 con 0x7fd73c1076a0 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd7410d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c111e60 con 0x7fd73c101c90 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51588/0 (socket says 172.21.15.39:51588) 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 -- 172.21.15.39:0/2263234650 learned_addr learned my addr 172.21.15.39:0/2263234650 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73ad9d640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 0x7fd73c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd733fff640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 0x7fd73c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 -- 172.21.15.39:0/2263234650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 msgr2=0x7fd73c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 0x7fd73c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 -- 172.21.15.39:0/2263234650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 msgr2=0x7fd73c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 0x7fd73c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73b59e640 1 -- 172.21.15.39:0/2263234650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c19f350 con 0x7fd73c108020 2024-09-10T21:53:56.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.581+0000 7fd73ad9d640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 0x7fd73c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd73b59e640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd73400eb10 tx=0x7fd73400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734004b20 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd734004cc0 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73c19f640 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734010670 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.582+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73c1a5d00 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.583+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73c102070 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.584+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd734005020 con 0x7fd73c108020 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.585+0000 7fd738d99640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 0x7fd7280b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.585+0000 7fd73ad9d640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 0x7fd7280b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:56.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.585+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd7340e6330 con 0x7fd73c108020 2024-09-10T21:53:56.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.586+0000 7fd73ad9d640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 0x7fd7280b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd72c031440 tx=0x7fd72c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:56.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.590+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7340ad0a0 con 0x7fd73c108020 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 msgr2=0x7fe0580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 0x7fe0580b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe070101070 tx=0x7fe06400b390 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 msgr2=0x7fe07019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d950 tx=0x7fe06000de10 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 shutdown_connections 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0580b5370 0x7fe0580b7830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe07010f3d0 0x7fe0701a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe070075de0 0x7fe07019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 --2- 172.21.15.39:0/4041476219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0700754c0 0x7fe07019b440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 >> 172.21.15.39:0/4041476219 conn(0x7fe0700fe830 msgr2=0x7fe0701115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:56.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.592+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 shutdown_connections 2024-09-10T21:53:56.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.593+0000 7fe07615a640 1 -- 172.21.15.39:0/4041476219 wait complete. 2024-09-10T21:53:56.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:56 smithi039 ceph-mon[30872]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 53 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T21:53:56.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:56 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1120602372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:53:56.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:56 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:53:56.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.790+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd73c1a60a0 con 0x7fd73c108020 2024-09-10T21:53:56.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.791+0000 7fd738d99640 1 -- 172.21.15.39:0/2263234650 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd7340ac9a0 con 0x7fd73c108020 2024-09-10T21:53:56.791 INFO:teuthology.orchestra.run.smithi039.stdout:279172874265 2024-09-10T21:53:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 msgr2=0x7fd7280b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 0x7fd7280b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd72c031440 tx=0x7fd72c005a20 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 msgr2=0x7fd73c19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd73400eb10 tx=0x7fd73400c2d0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 shutdown_connections 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7280b5370 0x7fd7280b7830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd73c108020 0x7fd73c19eb80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73c1076a0 0x7fd73c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 --2- 172.21.15.39:0/2263234650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd73c101c90 0x7fd73c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 >> 172.21.15.39:0/2263234650 conn(0x7fd73c0fd700 msgr2=0x7fd73c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 shutdown_connections 2024-09-10T21:53:56.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:56.793+0000 7fd7410d0640 1 -- 172.21.15.39:0/2263234650 wait complete. 2024-09-10T21:53:56.872 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:56 smithi173 ceph-mon[35294]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 53 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T21:53:56.872 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:56 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1120602372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:53:56.872 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:56 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:53:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:56 smithi070 ceph-mon[34909]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 53 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T21:53:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:56 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1120602372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:53:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:56 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:53:57.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874262 got 279172874265 for osd.11 2024-09-10T21:53:57.428 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:57.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.624+0000 7f5a1ff51640 1 -- 172.21.15.39:0/1080100425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 msgr2=0x7f5a18108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:57.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.624+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/1080100425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a18108be0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a0802a410 comp rx=0 tx=0).stop 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 -- 172.21.15.39:0/1080100425 shutdown_connections 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/1080100425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a1810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/1080100425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a18108be0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/1080100425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a18103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 -- 172.21.15.39:0/1080100425 >> 172.21.15.39:0/1080100425 conn(0x7f5a180fe820 msgr2=0x7f5a18100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 -- 172.21.15.39:0/1080100425 shutdown_connections 2024-09-10T21:53:57.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 -- 172.21.15.39:0/1080100425 wait complete. 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 Processor -- start 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.625+0000 7f5a1ff51640 1 -- start start 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a18075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18112e30 con 0x7f5a181087a0 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18112cb0 con 0x7f5a18102d90 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1ff51640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18112fb0 con 0x7f5a18109120 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1dced640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1dced640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42152/0 (socket says 172.21.15.39:42152) 2024-09-10T21:53:57.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51602/0 (socket says 172.21.15.39:51602) 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1dced640 1 -- 172.21.15.39:0/615263690 learned_addr learned my addr 172.21.15.39:0/615263690 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1e4ee640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a18075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 -- 172.21.15.39:0/615263690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 msgr2=0x7f5a18075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a18075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 -- 172.21.15.39:0/615263690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 msgr2=0x7f5a180754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 -- 172.21.15.39:0/615263690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a181a7660 con 0x7f5a181087a0 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1e4ee640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a18075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1dced640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.626+0000 7f5a1d4ec640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802aa00 tx=0x7f5a08003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.627+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0803f070 con 0x7f5a181087a0 2024-09-10T21:53:57.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.627+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a08031b50 con 0x7f5a181087a0 2024-09-10T21:53:57.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.627+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a181a78f0 con 0x7f5a181087a0 2024-09-10T21:53:57.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.627+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a181a7df0 con 0x7f5a181087a0 2024-09-10T21:53:57.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.627+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08035030 con 0x7f5a181087a0 2024-09-10T21:53:57.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.628+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc0052c0 con 0x7f5a181087a0 2024-09-10T21:53:57.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.629+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5a0803b460 con 0x7f5a181087a0 2024-09-10T21:53:57.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.630+0000 7f5a0effd640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 0x7f5a040b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:57.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.630+0000 7f5a1dced640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 0x7f5a040b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:57.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.630+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f5a08106a80 con 0x7f5a181087a0 2024-09-10T21:53:57.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.631+0000 7f5a1dced640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 0x7f5a040b78b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a14011550 tx=0x7f5a14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:57.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.633+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5a080cd7f0 con 0x7f5a181087a0 2024-09-10T21:53:57.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:57 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4041476219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:53:57.674 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:57 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2263234650' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:53:57.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.836+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f59fc005880 con 0x7f5a181087a0 2024-09-10T21:53:57.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.837+0000 7f5a0effd640 1 -- 172.21.15.39:0/615263690 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5a080cd0f0 con 0x7f5a181087a0 2024-09-10T21:53:57.838 INFO:teuthology.orchestra.run.smithi039.stdout:184683593772 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 msgr2=0x7f5a040b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 0x7f5a040b78b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a14011550 tx=0x7f5a14005f90 comp rx=0 tx=0).stop 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 msgr2=0x7f5a180759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802aa00 tx=0x7f5a08003b90 comp rx=0 tx=0).stop 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 shutdown_connections 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5a040b53f0 0x7f5a040b78b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a18109120 0x7f5a18075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a181087a0 0x7f5a180759e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 --2- 172.21.15.39:0/615263690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a18102d90 0x7f5a180754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 >> 172.21.15.39:0/615263690 conn(0x7f5a180fe820 msgr2=0x7f5a18100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 shutdown_connections 2024-09-10T21:53:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:57.839+0000 7f5a1ff51640 1 -- 172.21.15.39:0/615263690 wait complete. 2024-09-10T21:53:57.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:57 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4041476219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:53:57.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:57 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2263234650' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:53:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:57 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4041476219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:53:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:57 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2263234650' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:53:58.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397539 got 210453397542 for osd.8 2024-09-10T21:53:58.544 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:53:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:58 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/615263690' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.917 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:58 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/615263690' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:53:58.948 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201311 got 236223201313 for osd.9 2024-09-10T21:53:58.948 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:53:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:58 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/615263690' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.155+0000 7f413ce60640 1 -- 172.21.15.39:0/607891631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138103ce0 msgr2=0x7f41381040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.155+0000 7f413ce60640 1 --2- 172.21.15.39:0/607891631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138103ce0 0x7f41381040c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4128009ca0 tx=0x7f412802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 -- 172.21.15.39:0/607891631 shutdown_connections 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 --2- 172.21.15.39:0/607891631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f413810d140 0x7f413810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 --2- 172.21.15.39:0/607891631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138104600 0x7f413810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 --2- 172.21.15.39:0/607891631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138103ce0 0x7f41381040c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 -- 172.21.15.39:0/607891631 >> 172.21.15.39:0/607891631 conn(0x7f41380fd700 msgr2=0x7f41380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 -- 172.21.15.39:0/607891631 shutdown_connections 2024-09-10T21:53:59.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 -- 172.21.15.39:0/607891631 wait complete. 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 Processor -- start 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.156+0000 7f413ce60640 1 -- start start 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138103ce0 0x7f413810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4138104600 0x7f413810c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4138112df0 con 0x7f413810d140 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4138112c70 con 0x7f4138103ce0 2024-09-10T21:53:59.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413ce60640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4138112f70 con 0x7f4138104600 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51620/0 (socket says 172.21.15.39:51620) 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 -- 172.21.15.39:0/2507804170 learned_addr learned my addr 172.21.15.39:0/2507804170 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4135d9b640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4138104600 0x7f413810c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f413659c640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138103ce0 0x7f413810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 -- 172.21.15.39:0/2507804170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4138104600 msgr2=0x7f413810c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4138104600 0x7f413810c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 -- 172.21.15.39:0/2507804170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138103ce0 msgr2=0x7f413810bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138103ce0 0x7f413810bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 -- 172.21.15.39:0/2507804170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41381a59f0 con 0x7f413810d140 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f4136d9d640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4130009fd0 tx=0x7f413000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:59.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.157+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130011830 con 0x7f413810d140 2024-09-10T21:53:59.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.158+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41381a5ce0 con 0x7f413810d140 2024-09-10T21:53:59.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.158+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4130016070 con 0x7f413810d140 2024-09-10T21:53:59.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.158+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130010de0 con 0x7f413810d140 2024-09-10T21:53:59.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.158+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41381ac420 con 0x7f413810d140 2024-09-10T21:53:59.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.159+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41381040c0 con 0x7f413810d140 2024-09-10T21:53:59.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.160+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f41300119d0 con 0x7f413810d140 2024-09-10T21:53:59.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.161+0000 7f412f7fe640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 0x7f41240b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:53:59.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.161+0000 7f413659c640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 0x7f41240b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:53:59.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.161+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f41300e5a80 con 0x7f413810d140 2024-09-10T21:53:59.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.162+0000 7f413659c640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 0x7f41240b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f412802f500 tx=0x7f412802f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:53:59.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.164+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f41300ac7f0 con 0x7f413810d140 2024-09-10T21:53:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.352+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f41381ac6e0 con 0x7f413810d140 2024-09-10T21:53:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.353+0000 7f412f7fe640 1 -- 172.21.15.39:0/2507804170 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41300ac0f0 con 0x7f413810d140 2024-09-10T21:53:59.354 INFO:teuthology.orchestra.run.smithi039.stdout:73014444102 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 msgr2=0x7f41240b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 0x7f41240b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f412802f500 tx=0x7f412802f310 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 msgr2=0x7f41381a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4130009fd0 tx=0x7f413000b8e0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 shutdown_connections 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41240b5370 0x7f41240b7830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f413810d140 0x7f41381a5220 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4138104600 0x7f413810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 --2- 172.21.15.39:0/2507804170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4138103ce0 0x7f413810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 >> 172.21.15.39:0/2507804170 conn(0x7f41380fd700 msgr2=0x7f413810f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 shutdown_connections 2024-09-10T21:53:59.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:53:59.355+0000 7f413ce60640 1 -- 172.21.15.39:0/2507804170 wait complete. 2024-09-10T21:53:59.636 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037786 got 257698037788 for osd.10 2024-09-10T21:53:59.636 DEBUG:teuthology.parallel:result is None 2024-09-10T21:53:59.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:53:59 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2507804170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:53:59.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:53:59 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2507804170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:53:59.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:53:59 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2507804170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:54:00.012 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607621 got 51539607624 for osd.1 2024-09-10T21:54:00.012 DEBUG:teuthology.parallel:result is None 2024-09-10T21:54:00.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593769 got 184683593772 for osd.7 2024-09-10T21:54:00.377 DEBUG:teuthology.parallel:result is None 2024-09-10T21:54:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:00 smithi070 ceph-mon[34909]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T21:54:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:00 smithi039 ceph-mon[30872]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T21:54:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:00 smithi173 ceph-mon[35294]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-09-10T21:54:01.044 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247869 got 98784247871 for osd.3 2024-09-10T21:54:01.044 DEBUG:teuthology.parallel:result is None 2024-09-10T21:54:01.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444102 for osd.2 2024-09-10T21:54:01.210 DEBUG:teuthology.parallel:result is None 2024-09-10T21:54:01.210 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T21:54:01.210 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:54:01.960 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:02.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 -- 172.21.15.39:0/3371702411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b81087d0 msgr2=0x7f30b8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3371702411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b81087d0 0x7f30b8108c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009900 tx=0x7f30a402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 -- 172.21.15.39:0/3371702411 shutdown_connections 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3371702411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 0x7f30b810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3371702411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b81087d0 0x7f30b8108c10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3371702411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8102dc0 0x7f30b81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.486+0000 7f30bf25a640 1 -- 172.21.15.39:0/3371702411 >> 172.21.15.39:0/3371702411 conn(0x7f30b80fe830 msgr2=0x7f30b8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 -- 172.21.15.39:0/3371702411 shutdown_connections 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 -- 172.21.15.39:0/3371702411 wait complete. 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 Processor -- start 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 -- start start 2024-09-10T21:54:02.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.487+0000 7f30bf25a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 0x7f30b80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bf25a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 0x7f30b8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bf25a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8112e10 con 0x7f30b8102dc0 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bf25a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8112c90 con 0x7f30b8109150 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bf25a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8112f90 con 0x7f30b81087d0 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43150/0 (socket says 172.21.15.39:43150) 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 -- 172.21.15.39:0/3906027702 learned_addr learned my addr 172.21.15.39:0/3906027702 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30b7fff640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 0x7f30b80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bd7f7640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 0x7f30b8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 -- 172.21.15.39:0/3906027702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 msgr2=0x7f30b80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 0x7f30b80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 -- 172.21.15.39:0/3906027702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 msgr2=0x7f30b8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 0x7f30b8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 -- 172.21.15.39:0/3906027702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b81a76a0 con 0x7f30b8102dc0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30b7fff640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 0x7f30b80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bcff6640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00c970 tx=0x7f30ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac007bb0 con 0x7f30b8102dc0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30ac007d50 con 0x7f30b8102dc0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b81a7990 con 0x7f30b8102dc0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.488+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00f450 con 0x7f30b8102dc0 2024-09-10T21:54:02.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.489+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b81a7ea0 con 0x7f30b8102dc0 2024-09-10T21:54:02.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.490+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b81031a0 con 0x7f30b8102dc0 2024-09-10T21:54:02.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.491+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f30ac004f20 con 0x7f30b8102dc0 2024-09-10T21:54:02.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.492+0000 7f30b5ffb640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 0x7f30a80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:02.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.492+0000 7f30b7fff640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 0x7f30a80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:02.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.492+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f30ac0e5b30 con 0x7f30b8102dc0 2024-09-10T21:54:02.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.492+0000 7f30b7fff640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 0x7f30a80b78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30a4031440 tx=0x7f30a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:02.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.496+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f30ac014030 con 0x7f30b8102dc0 2024-09-10T21:54:02.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:02 smithi039 ceph-mon[30872]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:02.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.715+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30b8063590 con 0x7f30a80b53f0 2024-09-10T21:54:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.719+0000 7f30b5ffb640 1 -- 172.21.15.39:0/3906027702 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258751 (secure 0 0 0) 0x7f30b8063590 con 0x7f30a80b53f0 2024-09-10T21:54:02.723 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:54:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 msgr2=0x7f30a80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 0x7f30a80b78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30a4031440 tx=0x7f30a4005a20 comp rx=0 tx=0).stop 2024-09-10T21:54:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 msgr2=0x7f30b80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00c970 tx=0x7f30ac00ce30 comp rx=0 tx=0).stop 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 shutdown_connections 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f30a80b53f0 0x7f30a80b78b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30b8109150 0x7f30b8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b81087d0 0x7f30b80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 --2- 172.21.15.39:0/3906027702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b8102dc0 0x7f30b80754a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 >> 172.21.15.39:0/3906027702 conn(0x7f30b80fe830 msgr2=0x7f30b8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 shutdown_connections 2024-09-10T21:54:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:02.723+0000 7f30bf25a640 1 -- 172.21.15.39:0/3906027702 wait complete. 2024-09-10T21:54:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:02 smithi070 ceph-mon[34909]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:02 smithi173 ceph-mon[35294]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:03.380 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-10T21:54:01.467799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659723,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":582,"num_read_kb":393,"num_write":368,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952422,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369140,"kb_used_data":11496,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572684,"statfs":{"total":1151940427776,"available":1151562428416,"internally_reserved":0,"allocated":11771904,"data_stored":6615153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003083"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541986+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:44.541986+0000","last_peered":"2024-09-10T21:53:44.541986+0000","last_clean":"2024-09-10T21:53:44.541986+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:44.541986+0000","last_undegraded":"2024-09-10T21:53:44.541986+0000","last_fullsized":"2024-09-10T21:53:44.541986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555466+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:44.555466+0000","last_peered":"2024-09-10T21:53:44.555466+0000","last_clean":"2024-09-10T21:53:44.555466+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:44.555466+0000","last_undegraded":"2024-09-10T21:53:44.555466+0000","last_fullsized":"2024-09-10T21:53:44.555466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555413+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:44.555413+0000","last_peered":"2024-09-10T21:53:44.555413+0000","last_clean":"2024-09-10T21:53:44.555413+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:44.555413+0000","last_undegraded":"2024-09-10T21:53:44.555413+0000","last_fullsized":"2024-09-10T21:53:44.555413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556909+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:44.556909+0000","last_peered":"2024-09-10T21:53:44.556909+0000","last_clean":"2024-09-10T21:53:44.556909+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:44.556909+0000","last_undegraded":"2024-09-10T21:53:44.556909+0000","last_fullsized":"2024-09-10T21:53:44.556909+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542402+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:53:44.542402+0000","last_peered":"2024-09-10T21:53:44.542402+0000","last_clean":"2024-09-10T21:53:44.542402+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:53:44.542402+0000","last_undegraded":"2024-09-10T21:53:44.542402+0000","last_fullsized":"2024-09-10T21:53:44.542402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557178+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:53:44.557178+0000","last_peered":"2024-09-10T21:53:44.557178+0000","last_clean":"2024-09-10T21:53:44.557178+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:53:44.557178+0000","last_undegraded":"2024-09-10T21:53:44.557178+0000","last_fullsized":"2024-09-10T21:53:44.557178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539582+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:53:44.539582+0000","last_peered":"2024-09-10T21:53:44.539582+0000","last_clean":"2024-09-10T21:53:44.539582+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:53:44.539582+0000","last_undegraded":"2024-09-10T21:53:44.539582+0000","last_fullsized":"2024-09-10T21:53:44.539582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558841+0000","last_change":"2024-09-10T21:53:44.558293+0000","last_active":"2024-09-10T21:53:44.558841+0000","last_peered":"2024-09-10T21:53:44.558841+0000","last_clean":"2024-09-10T21:53:44.558841+0000","last_became_active":"2024-09-10T21:53:44.557902+0000","last_became_peered":"2024-09-10T21:53:44.557902+0000","last_unstale":"2024-09-10T21:53:44.558841+0000","last_undegraded":"2024-09-10T21:53:44.558841+0000","last_fullsized":"2024-09-10T21:53:44.558841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:01.123834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544297+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:53:44.544297+0000","last_peered":"2024-09-10T21:53:44.544297+0000","last_clean":"2024-09-10T21:53:44.544297+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:53:44.544297+0000","last_undegraded":"2024-09-10T21:53:44.544297+0000","last_fullsized":"2024-09-10T21:53:44.544297+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556570+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:53:44.556570+0000","last_peered":"2024-09-10T21:53:44.556570+0000","last_clean":"2024-09-10T21:53:44.556570+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:53:44.556570+0000","last_undegraded":"2024-09-10T21:53:44.556570+0000","last_fullsized":"2024-09-10T21:53:44.556570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539940+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:53:44.539940+0000","last_peered":"2024-09-10T21:53:44.539940+0000","last_clean":"2024-09-10T21:53:44.539940+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:53:44.539940+0000","last_undegraded":"2024-09-10T21:53:44.539940+0000","last_fullsized":"2024-09-10T21:53:44.539940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539339+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:53:44.539339+0000","last_peered":"2024-09-10T21:53:44.539339+0000","last_clean":"2024-09-10T21:53:44.539339+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:53:44.539339+0000","last_undegraded":"2024-09-10T21:53:44.539339+0000","last_fullsized":"2024-09-10T21:53:44.539339+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555268+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:44.555268+0000","last_peered":"2024-09-10T21:53:44.555268+0000","last_clean":"2024-09-10T21:53:44.555268+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:44.555268+0000","last_undegraded":"2024-09-10T21:53:44.555268+0000","last_fullsized":"2024-09-10T21:53:44.555268+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555328+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:44.555328+0000","last_peered":"2024-09-10T21:53:44.555328+0000","last_clean":"2024-09-10T21:53:44.555328+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:44.555328+0000","last_undegraded":"2024-09-10T21:53:44.555328+0000","last_fullsized":"2024-09-10T21:53:44.555328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543657+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:53:44.543657+0000","last_peered":"2024-09-10T21:53:44.543657+0000","last_clean":"2024-09-10T21:53:44.543657+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:53:44.543657+0000","last_undegraded":"2024-09-10T21:53:44.543657+0000","last_fullsized":"2024-09-10T21:53:44.543657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542105+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:44.542105+0000","last_peered":"2024-09-10T21:53:44.542105+0000","last_clean":"2024-09-10T21:53:44.542105+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:44.542105+0000","last_undegraded":"2024-09-10T21:53:44.542105+0000","last_fullsized":"2024-09-10T21:53:44.542105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543340+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:44.543340+0000","last_peered":"2024-09-10T21:53:44.543340+0000","last_clean":"2024-09-10T21:53:44.543340+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:44.543340+0000","last_undegraded":"2024-09-10T21:53:44.543340+0000","last_fullsized":"2024-09-10T21:53:44.543340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540012+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:44.540012+0000","last_peered":"2024-09-10T21:53:44.540012+0000","last_clean":"2024-09-10T21:53:44.540012+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:44.540012+0000","last_undegraded":"2024-09-10T21:53:44.540012+0000","last_fullsized":"2024-09-10T21:53:44.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541613+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:44.541613+0000","last_peered":"2024-09-10T21:53:44.541613+0000","last_clean":"2024-09-10T21:53:44.541613+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:44.541613+0000","last_undegraded":"2024-09-10T21:53:44.541613+0000","last_fullsized":"2024-09-10T21:53:44.541613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539346+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:53:44.539346+0000","last_peered":"2024-09-10T21:53:44.539346+0000","last_clean":"2024-09-10T21:53:44.539346+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:53:44.539346+0000","last_undegraded":"2024-09-10T21:53:44.539346+0000","last_fullsized":"2024-09-10T21:53:44.539346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543843+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:53:44.543843+0000","last_peered":"2024-09-10T21:53:44.543843+0000","last_clean":"2024-09-10T21:53:44.543843+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:53:44.543843+0000","last_undegraded":"2024-09-10T21:53:44.543843+0000","last_fullsized":"2024-09-10T21:53:44.543843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544372+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:53:44.544372+0000","last_peered":"2024-09-10T21:53:44.544372+0000","last_clean":"2024-09-10T21:53:44.544372+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:53:44.544372+0000","last_undegraded":"2024-09-10T21:53:44.544372+0000","last_fullsized":"2024-09-10T21:53:44.544372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544991+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:44.544991+0000","last_peered":"2024-09-10T21:53:44.544991+0000","last_clean":"2024-09-10T21:53:44.544991+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:44.544991+0000","last_undegraded":"2024-09-10T21:53:44.544991+0000","last_fullsized":"2024-09-10T21:53:44.544991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544185+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:53:44.544185+0000","last_peered":"2024-09-10T21:53:44.544185+0000","last_clean":"2024-09-10T21:53:44.544185+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:53:44.544185+0000","last_undegraded":"2024-09-10T21:53:44.544185+0000","last_fullsized":"2024-09-10T21:53:44.544185+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540227+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:44.540227+0000","last_peered":"2024-09-10T21:53:44.540227+0000","last_clean":"2024-09-10T21:53:44.540227+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:44.540227+0000","last_undegraded":"2024-09-10T21:53:44.540227+0000","last_fullsized":"2024-09-10T21:53:44.540227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541969+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:44.541969+0000","last_peered":"2024-09-10T21:53:44.541969+0000","last_clean":"2024-09-10T21:53:44.541969+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:44.541969+0000","last_undegraded":"2024-09-10T21:53:44.541969+0000","last_fullsized":"2024-09-10T21:53:44.541969+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539362+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:53:44.539362+0000","last_peered":"2024-09-10T21:53:44.539362+0000","last_clean":"2024-09-10T21:53:44.539362+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:53:44.539362+0000","last_undegraded":"2024-09-10T21:53:44.539362+0000","last_fullsized":"2024-09-10T21:53:44.539362+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555443+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:44.555443+0000","last_peered":"2024-09-10T21:53:44.555443+0000","last_clean":"2024-09-10T21:53:44.555443+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:44.555443+0000","last_undegraded":"2024-09-10T21:53:44.555443+0000","last_fullsized":"2024-09-10T21:53:44.555443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539653+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:44.539653+0000","last_peered":"2024-09-10T21:53:44.539653+0000","last_clean":"2024-09-10T21:53:44.539653+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:44.539653+0000","last_undegraded":"2024-09-10T21:53:44.539653+0000","last_fullsized":"2024-09-10T21:53:44.539653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.547111+0000","last_change":"2024-09-10T21:53:44.547016+0000","last_active":"2024-09-10T21:53:44.547111+0000","last_peered":"2024-09-10T21:53:44.547111+0000","last_clean":"2024-09-10T21:53:44.547111+0000","last_became_active":"2024-09-10T21:53:44.546627+0000","last_became_peered":"2024-09-10T21:53:44.546627+0000","last_unstale":"2024-09-10T21:53:44.547111+0000","last_undegraded":"2024-09-10T21:53:44.547111+0000","last_fullsized":"2024-09-10T21:53:44.547111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:36.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541388+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:44.541388+0000","last_peered":"2024-09-10T21:53:44.541388+0000","last_clean":"2024-09-10T21:53:44.541388+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:44.541388+0000","last_undegraded":"2024-09-10T21:53:44.541388+0000","last_fullsized":"2024-09-10T21:53:44.541388+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542211+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:53:44.542211+0000","last_peered":"2024-09-10T21:53:44.542211+0000","last_clean":"2024-09-10T21:53:44.542211+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:53:44.542211+0000","last_undegraded":"2024-09-10T21:53:44.542211+0000","last_fullsized":"2024-09-10T21:53:44.542211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":79,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.318746+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:53:56.318746+0000","last_peered":"2024-09-10T21:53:56.318746+0000","last_clean":"2024-09-10T21:53:56.318746+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:53:56.318746+0000","last_undegraded":"2024-09-10T21:53:56.318746+0000","last_fullsized":"2024-09-10T21:53:56.318746+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.546050+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:44.546050+0000","last_peered":"2024-09-10T21:53:44.546050+0000","last_clean":"2024-09-10T21:53:44.546050+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:44.546050+0000","last_undegraded":"2024-09-10T21:53:44.546050+0000","last_fullsized":"2024-09-10T21:53:44.546050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557192+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:44.557192+0000","last_peered":"2024-09-10T21:53:44.557192+0000","last_clean":"2024-09-10T21:53:44.557192+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:44.557192+0000","last_undegraded":"2024-09-10T21:53:44.557192+0000","last_fullsized":"2024-09-10T21:53:44.557192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539062+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:44.539062+0000","last_peered":"2024-09-10T21:53:44.539062+0000","last_clean":"2024-09-10T21:53:44.539062+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:44.539062+0000","last_undegraded":"2024-09-10T21:53:44.539062+0000","last_fullsized":"2024-09-10T21:53:44.539062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544098+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:53:44.544098+0000","last_peered":"2024-09-10T21:53:44.544098+0000","last_clean":"2024-09-10T21:53:44.544098+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:53:44.544098+0000","last_undegraded":"2024-09-10T21:53:44.544098+0000","last_fullsized":"2024-09-10T21:53:44.544098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545291+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:44.545291+0000","last_peered":"2024-09-10T21:53:44.545291+0000","last_clean":"2024-09-10T21:53:44.545291+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:44.545291+0000","last_undegraded":"2024-09-10T21:53:44.545291+0000","last_fullsized":"2024-09-10T21:53:44.545291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543281+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:44.543281+0000","last_peered":"2024-09-10T21:53:44.543281+0000","last_clean":"2024-09-10T21:53:44.543281+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:44.543281+0000","last_undegraded":"2024-09-10T21:53:44.543281+0000","last_fullsized":"2024-09-10T21:53:44.543281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":119,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.317923+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:53:56.317923+0000","last_peered":"2024-09-10T21:53:56.317923+0000","last_clean":"2024-09-10T21:53:56.317923+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:53:56.317923+0000","last_undegraded":"2024-09-10T21:53:56.317923+0000","last_fullsized":"2024-09-10T21:53:56.317923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544060+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:53:44.544060+0000","last_peered":"2024-09-10T21:53:44.544060+0000","last_clean":"2024-09-10T21:53:44.544060+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:53:44.544060+0000","last_undegraded":"2024-09-10T21:53:44.544060+0000","last_fullsized":"2024-09-10T21:53:44.544060+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539991+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:44.539991+0000","last_peered":"2024-09-10T21:53:44.539991+0000","last_clean":"2024-09-10T21:53:44.539991+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:44.539991+0000","last_undegraded":"2024-09-10T21:53:44.539991+0000","last_fullsized":"2024-09-10T21:53:44.539991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555630+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:44.555630+0000","last_peered":"2024-09-10T21:53:44.555630+0000","last_clean":"2024-09-10T21:53:44.555630+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:44.555630+0000","last_undegraded":"2024-09-10T21:53:44.555630+0000","last_fullsized":"2024-09-10T21:53:44.555630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545577+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:44.545577+0000","last_peered":"2024-09-10T21:53:44.545577+0000","last_clean":"2024-09-10T21:53:44.545577+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:44.545577+0000","last_undegraded":"2024-09-10T21:53:44.545577+0000","last_fullsized":"2024-09-10T21:53:44.545577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543963+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:53:44.543963+0000","last_peered":"2024-09-10T21:53:44.543963+0000","last_clean":"2024-09-10T21:53:44.543963+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:53:44.543963+0000","last_undegraded":"2024-09-10T21:53:44.543963+0000","last_fullsized":"2024-09-10T21:53:44.543963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'32","reported_seq":156,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.317918+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:53:56.317918+0000","last_peered":"2024-09-10T21:53:56.317918+0000","last_clean":"2024-09-10T21:53:56.317918+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:53:56.317918+0000","last_undegraded":"2024-09-10T21:53:56.317918+0000","last_fullsized":"2024-09-10T21:53:56.317918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62308,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":111,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543447+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:53:44.543447+0000","last_peered":"2024-09-10T21:53:44.543447+0000","last_clean":"2024-09-10T21:53:44.543447+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:53:44.543447+0000","last_undegraded":"2024-09-10T21:53:44.543447+0000","last_fullsized":"2024-09-10T21:53:44.543447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539851+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:44.539851+0000","last_peered":"2024-09-10T21:53:44.539851+0000","last_clean":"2024-09-10T21:53:44.539851+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:44.539851+0000","last_undegraded":"2024-09-10T21:53:44.539851+0000","last_fullsized":"2024-09-10T21:53:44.539851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539112+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:53:44.539112+0000","last_peered":"2024-09-10T21:53:44.539112+0000","last_clean":"2024-09-10T21:53:44.539112+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:53:44.539112+0000","last_undegraded":"2024-09-10T21:53:44.539112+0000","last_fullsized":"2024-09-10T21:53:44.539112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544851+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:44.544851+0000","last_peered":"2024-09-10T21:53:44.544851+0000","last_clean":"2024-09-10T21:53:44.544851+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:44.544851+0000","last_undegraded":"2024-09-10T21:53:44.544851+0000","last_fullsized":"2024-09-10T21:53:44.544851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539869+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:53:44.539869+0000","last_peered":"2024-09-10T21:53:44.539869+0000","last_clean":"2024-09-10T21:53:44.539869+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:53:44.539869+0000","last_undegraded":"2024-09-10T21:53:44.539869+0000","last_fullsized":"2024-09-10T21:53:44.539869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":77,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.318522+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:53:56.318522+0000","last_peered":"2024-09-10T21:53:56.318522+0000","last_clean":"2024-09-10T21:53:56.318522+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:53:56.318522+0000","last_undegraded":"2024-09-10T21:53:56.318522+0000","last_fullsized":"2024-09-10T21:53:56.318522+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539496+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:53:44.539496+0000","last_peered":"2024-09-10T21:53:44.539496+0000","last_clean":"2024-09-10T21:53:44.539496+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:53:44.539496+0000","last_undegraded":"2024-09-10T21:53:44.539496+0000","last_fullsized":"2024-09-10T21:53:44.539496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542191+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:44.542191+0000","last_peered":"2024-09-10T21:53:44.542191+0000","last_clean":"2024-09-10T21:53:44.542191+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:44.542191+0000","last_undegraded":"2024-09-10T21:53:44.542191+0000","last_fullsized":"2024-09-10T21:53:44.542191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545688+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:44.545688+0000","last_peered":"2024-09-10T21:53:44.545688+0000","last_clean":"2024-09-10T21:53:44.545688+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:44.545688+0000","last_undegraded":"2024-09-10T21:53:44.545688+0000","last_fullsized":"2024-09-10T21:53:44.545688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542756+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:44.542756+0000","last_peered":"2024-09-10T21:53:44.542756+0000","last_clean":"2024-09-10T21:53:44.542756+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:44.542756+0000","last_undegraded":"2024-09-10T21:53:44.542756+0000","last_fullsized":"2024-09-10T21:53:44.542756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558295+0000","last_change":"2024-09-10T21:53:44.558208+0000","last_active":"2024-09-10T21:53:44.558295+0000","last_peered":"2024-09-10T21:53:44.558295+0000","last_clean":"2024-09-10T21:53:44.558295+0000","last_became_active":"2024-09-10T21:53:44.557786+0000","last_became_peered":"2024-09-10T21:53:44.557786+0000","last_unstale":"2024-09-10T21:53:44.558295+0000","last_undegraded":"2024-09-10T21:53:44.558295+0000","last_fullsized":"2024-09-10T21:53:44.558295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:35.278172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539468+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:44.539468+0000","last_peered":"2024-09-10T21:53:44.539468+0000","last_clean":"2024-09-10T21:53:44.539468+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:44.539468+0000","last_undegraded":"2024-09-10T21:53:44.539468+0000","last_fullsized":"2024-09-10T21:53:44.539468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540097+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:53:44.540097+0000","last_peered":"2024-09-10T21:53:44.540097+0000","last_clean":"2024-09-10T21:53:44.540097+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:53:44.540097+0000","last_undegraded":"2024-09-10T21:53:44.540097+0000","last_fullsized":"2024-09-10T21:53:44.540097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545708+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:44.545708+0000","last_peered":"2024-09-10T21:53:44.545708+0000","last_clean":"2024-09-10T21:53:44.545708+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:44.545708+0000","last_undegraded":"2024-09-10T21:53:44.545708+0000","last_fullsized":"2024-09-10T21:53:44.545708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539919+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:53:44.539919+0000","last_peered":"2024-09-10T21:53:44.539919+0000","last_clean":"2024-09-10T21:53:44.539919+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:53:44.539919+0000","last_undegraded":"2024-09-10T21:53:44.539919+0000","last_fullsized":"2024-09-10T21:53:44.539919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":77,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.318404+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:53:56.318404+0000","last_peered":"2024-09-10T21:53:56.318404+0000","last_clean":"2024-09-10T21:53:56.318404+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:53:56.318404+0000","last_undegraded":"2024-09-10T21:53:56.318404+0000","last_fullsized":"2024-09-10T21:53:56.318404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540092+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:53:44.540092+0000","last_peered":"2024-09-10T21:53:44.540092+0000","last_clean":"2024-09-10T21:53:44.540092+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:53:44.540092+0000","last_undegraded":"2024-09-10T21:53:44.540092+0000","last_fullsized":"2024-09-10T21:53:44.540092+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":96,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539686+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:44.539686+0000","last_peered":"2024-09-10T21:53:44.539686+0000","last_clean":"2024-09-10T21:53:44.539686+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:44.539686+0000","last_undegraded":"2024-09-10T21:53:44.539686+0000","last_fullsized":"2024-09-10T21:53:44.539686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544681+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:53:44.544681+0000","last_peered":"2024-09-10T21:53:44.544681+0000","last_clean":"2024-09-10T21:53:44.544681+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:53:44.544681+0000","last_undegraded":"2024-09-10T21:53:44.544681+0000","last_fullsized":"2024-09-10T21:53:44.544681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539673+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:44.539673+0000","last_peered":"2024-09-10T21:53:44.539673+0000","last_clean":"2024-09-10T21:53:44.539673+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:44.539673+0000","last_undegraded":"2024-09-10T21:53:44.539673+0000","last_fullsized":"2024-09-10T21:53:44.539673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544602+0000","last_change":"2024-09-10T21:53:44.544497+0000","last_active":"2024-09-10T21:53:44.544602+0000","last_peered":"2024-09-10T21:53:44.544602+0000","last_clean":"2024-09-10T21:53:44.544602+0000","last_became_active":"2024-09-10T21:53:44.544086+0000","last_became_peered":"2024-09-10T21:53:44.544086+0000","last_unstale":"2024-09-10T21:53:44.544602+0000","last_undegraded":"2024-09-10T21:53:44.544602+0000","last_fullsized":"2024-09-10T21:53:44.544602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:42.547771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":78,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:58.320365+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:53:58.320365+0000","last_peered":"2024-09-10T21:53:58.320365+0000","last_clean":"2024-09-10T21:53:58.320365+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:53:58.320365+0000","last_undegraded":"2024-09-10T21:53:58.320365+0000","last_fullsized":"2024-09-10T21:53:58.320365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545100+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:44.545100+0000","last_peered":"2024-09-10T21:53:44.545100+0000","last_clean":"2024-09-10T21:53:44.545100+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:44.545100+0000","last_undegraded":"2024-09-10T21:53:44.545100+0000","last_fullsized":"2024-09-10T21:53:44.545100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":75,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:55.327217+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:53:55.327217+0000","last_peered":"2024-09-10T21:53:55.327217+0000","last_clean":"2024-09-10T21:53:55.327217+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:53:55.327217+0000","last_undegraded":"2024-09-10T21:53:55.327217+0000","last_fullsized":"2024-09-10T21:53:55.327217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556274+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:53:44.556274+0000","last_peered":"2024-09-10T21:53:44.556274+0000","last_clean":"2024-09-10T21:53:44.556274+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:53:44.556274+0000","last_undegraded":"2024-09-10T21:53:44.556274+0000","last_fullsized":"2024-09-10T21:53:44.556274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543424+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:44.543424+0000","last_peered":"2024-09-10T21:53:44.543424+0000","last_clean":"2024-09-10T21:53:44.543424+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:44.543424+0000","last_undegraded":"2024-09-10T21:53:44.543424+0000","last_fullsized":"2024-09-10T21:53:44.543424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556348+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:53:44.556348+0000","last_peered":"2024-09-10T21:53:44.556348+0000","last_clean":"2024-09-10T21:53:44.556348+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:53:44.556348+0000","last_undegraded":"2024-09-10T21:53:44.556348+0000","last_fullsized":"2024-09-10T21:53:44.556348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543551+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:44.543551+0000","last_peered":"2024-09-10T21:53:44.543551+0000","last_clean":"2024-09-10T21:53:44.543551+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:44.543551+0000","last_undegraded":"2024-09-10T21:53:44.543551+0000","last_fullsized":"2024-09-10T21:53:44.543551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539482+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:53:44.539482+0000","last_peered":"2024-09-10T21:53:44.539482+0000","last_clean":"2024-09-10T21:53:44.539482+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:53:44.539482+0000","last_undegraded":"2024-09-10T21:53:44.539482+0000","last_fullsized":"2024-09-10T21:53:44.539482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'14","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543451+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:44.543451+0000","last_peered":"2024-09-10T21:53:44.543451+0000","last_clean":"2024-09-10T21:53:44.543451+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:44.543451+0000","last_undegraded":"2024-09-10T21:53:44.543451+0000","last_fullsized":"2024-09-10T21:53:44.543451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544286+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:53:44.544286+0000","last_peered":"2024-09-10T21:53:44.544286+0000","last_clean":"2024-09-10T21:53:44.544286+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:53:44.544286+0000","last_undegraded":"2024-09-10T21:53:44.544286+0000","last_fullsized":"2024-09-10T21:53:44.544286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556856+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:44.556856+0000","last_peered":"2024-09-10T21:53:44.556856+0000","last_clean":"2024-09-10T21:53:44.556856+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:44.556856+0000","last_undegraded":"2024-09-10T21:53:44.556856+0000","last_fullsized":"2024-09-10T21:53:44.556856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555472+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:44.555472+0000","last_peered":"2024-09-10T21:53:44.555472+0000","last_clean":"2024-09-10T21:53:44.555472+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:44.555472+0000","last_undegraded":"2024-09-10T21:53:44.555472+0000","last_fullsized":"2024-09-10T21:53:44.555472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543821+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:44.543821+0000","last_peered":"2024-09-10T21:53:44.543821+0000","last_clean":"2024-09-10T21:53:44.543821+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:44.543821+0000","last_undegraded":"2024-09-10T21:53:44.543821+0000","last_fullsized":"2024-09-10T21:53:44.543821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543998+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:53:44.543998+0000","last_peered":"2024-09-10T21:53:44.543998+0000","last_clean":"2024-09-10T21:53:44.543998+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:53:44.543998+0000","last_undegraded":"2024-09-10T21:53:44.543998+0000","last_fullsized":"2024-09-10T21:53:44.543998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544539+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:44.544539+0000","last_peered":"2024-09-10T21:53:44.544539+0000","last_clean":"2024-09-10T21:53:44.544539+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:44.544539+0000","last_undegraded":"2024-09-10T21:53:44.544539+0000","last_fullsized":"2024-09-10T21:53:44.544539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541458+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:44.541458+0000","last_peered":"2024-09-10T21:53:44.541458+0000","last_clean":"2024-09-10T21:53:44.541458+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:44.541458+0000","last_undegraded":"2024-09-10T21:53:44.541458+0000","last_fullsized":"2024-09-10T21:53:44.541458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.551887+0000","last_change":"2024-09-10T21:53:44.551320+0000","last_active":"2024-09-10T21:53:44.551887+0000","last_peered":"2024-09-10T21:53:44.551887+0000","last_clean":"2024-09-10T21:53:44.551887+0000","last_became_active":"2024-09-10T21:53:44.546446+0000","last_became_peered":"2024-09-10T21:53:44.546446+0000","last_unstale":"2024-09-10T21:53:44.551887+0000","last_undegraded":"2024-09-10T21:53:44.551887+0000","last_fullsized":"2024-09-10T21:53:44.551887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:19.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544450+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:53:44.544450+0000","last_peered":"2024-09-10T21:53:44.544450+0000","last_clean":"2024-09-10T21:53:44.544450+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:53:44.544450+0000","last_undegraded":"2024-09-10T21:53:44.544450+0000","last_fullsized":"2024-09-10T21:53:44.544450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542660+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:44.542660+0000","last_peered":"2024-09-10T21:53:44.542660+0000","last_clean":"2024-09-10T21:53:44.542660+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:44.542660+0000","last_undegraded":"2024-09-10T21:53:44.542660+0000","last_fullsized":"2024-09-10T21:53:44.542660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539664+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:53:44.539664+0000","last_peered":"2024-09-10T21:53:44.539664+0000","last_clean":"2024-09-10T21:53:44.539664+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:53:44.539664+0000","last_undegraded":"2024-09-10T21:53:44.539664+0000","last_fullsized":"2024-09-10T21:53:44.539664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.548275+0000","last_change":"2024-09-10T21:53:44.548188+0000","last_active":"2024-09-10T21:53:44.548275+0000","last_peered":"2024-09-10T21:53:44.548275+0000","last_clean":"2024-09-10T21:53:44.548275+0000","last_became_active":"2024-09-10T21:53:44.547897+0000","last_became_peered":"2024-09-10T21:53:44.547897+0000","last_unstale":"2024-09-10T21:53:44.548275+0000","last_undegraded":"2024-09-10T21:53:44.548275+0000","last_fullsized":"2024-09-10T21:53:44.548275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:21.351072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557183+0000","last_change":"2024-09-10T21:53:44.556670+0000","last_active":"2024-09-10T21:53:44.557183+0000","last_peered":"2024-09-10T21:53:44.557183+0000","last_clean":"2024-09-10T21:53:44.557183+0000","last_became_active":"2024-09-10T21:53:44.546758+0000","last_became_peered":"2024-09-10T21:53:44.546758+0000","last_unstale":"2024-09-10T21:53:44.557183+0000","last_undegraded":"2024-09-10T21:53:44.557183+0000","last_fullsized":"2024-09-10T21:53:44.557183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:02.292116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543838+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:53:44.543838+0000","last_peered":"2024-09-10T21:53:44.543838+0000","last_clean":"2024-09-10T21:53:44.543838+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:53:44.543838+0000","last_undegraded":"2024-09-10T21:53:44.543838+0000","last_fullsized":"2024-09-10T21:53:44.543838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.568857+0000","last_change":"2024-09-10T21:53:44.568775+0000","last_active":"2024-09-10T21:53:44.568857+0000","last_peered":"2024-09-10T21:53:44.568857+0000","last_clean":"2024-09-10T21:53:44.568857+0000","last_became_active":"2024-09-10T21:53:44.558126+0000","last_became_peered":"2024-09-10T21:53:44.558126+0000","last_unstale":"2024-09-10T21:53:44.568857+0000","last_undegraded":"2024-09-10T21:53:44.568857+0000","last_fullsized":"2024-09-10T21:53:44.568857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:00.789948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555627+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:44.555627+0000","last_peered":"2024-09-10T21:53:44.555627+0000","last_clean":"2024-09-10T21:53:44.555627+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:44.555627+0000","last_undegraded":"2024-09-10T21:53:44.555627+0000","last_fullsized":"2024-09-10T21:53:44.555627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544324+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:44.544324+0000","last_peered":"2024-09-10T21:53:44.544324+0000","last_clean":"2024-09-10T21:53:44.544324+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:44.544324+0000","last_undegraded":"2024-09-10T21:53:44.544324+0000","last_fullsized":"2024-09-10T21:53:44.544324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544169+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:53:44.544169+0000","last_peered":"2024-09-10T21:53:44.544169+0000","last_clean":"2024-09-10T21:53:44.544169+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:53:44.544169+0000","last_undegraded":"2024-09-10T21:53:44.544169+0000","last_fullsized":"2024-09-10T21:53:44.544169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":84,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:56.327877+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:53:56.327877+0000","last_peered":"2024-09-10T21:53:56.327877+0000","last_clean":"2024-09-10T21:53:56.327877+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:53:56.327877+0000","last_undegraded":"2024-09-10T21:53:56.327877+0000","last_fullsized":"2024-09-10T21:53:56.327877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69121,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":506,"num_read_kb":329,"num_write":243,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":207363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874266,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":798720,"data_stored":388106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037789,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1499136,"data_stored":1040861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201315,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":387454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":387250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593772,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1413120,"data_stored":980350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724594,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":802816,"data_stored":387171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888118,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":980028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051643,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":387032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":386996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":451003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40360,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704792,"statfs":{"total":95995035648,"available":95953707008,"internally_reserved":0,"allocated":868352,"data_stored":450392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":823296,"data_stored":388510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:54:03.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:54:03.651 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:54:03.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:03 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1326741650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 msgr2=0x7f3c44108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1326741650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44108c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009900 tx=0x7f3c3402a3f0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1326741650 shutdown_connections 2024-09-10T21:54:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1326741650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 0x7f3c4410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1326741650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44108c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1326741650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 0x7f3c441031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1326741650 >> 172.21.15.39:0/1326741650 conn(0x7f3c440fe830 msgr2=0x7f3c44100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1326741650 shutdown_connections 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.005+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1326741650 wait complete. 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 Processor -- start 2024-09-10T21:54:04.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 -- start start 2024-09-10T21:54:04.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 0x7f3c441991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 0x7f3c4419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44112df0 con 0x7f3c441087d0 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44112c70 con 0x7f3c44109150 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4b4b0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44112f70 con 0x7f3c44102dc0 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43164/0 (socket says 172.21.15.39:43164) 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 -- 172.21.15.39:0/1212530792 learned_addr learned my addr 172.21.15.39:0/1212530792 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c4924c640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 0x7f3c441991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c49a4d640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 0x7f3c4419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 -- 172.21.15.39:0/1212530792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 msgr2=0x7f3c441991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:04.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 0x7f3c441991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 -- 172.21.15.39:0/1212530792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 msgr2=0x7f3c4419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.006+0000 7f3c48a4b640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 0x7f3c4419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c48a4b640 1 -- 172.21.15.39:0/1212530792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4419f290 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c48a4b640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005ab0 tx=0x7f3c34003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403f070 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4419f520 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c34031d60 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34035030 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.007+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c441a5c40 con 0x7f3c441087d0 2024-09-10T21:54:04.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.008+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c441031a0 con 0x7f3c441087d0 2024-09-10T21:54:04.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.010+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3c3403b4f0 con 0x7f3c441087d0 2024-09-10T21:54:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.011+0000 7f3c3a7fc640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 0x7f3c300b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.011+0000 7f3c4924c640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 0x7f3c300b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.011+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3c34107000 con 0x7f3c441087d0 2024-09-10T21:54:04.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.012+0000 7f3c4924c640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 0x7f3c300b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000abe0 tx=0x7f3c4000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:04.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.015+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c340cdd70 con 0x7f3c441087d0 2024-09-10T21:54:04.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.200+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c44105db0 con 0x7f3c300b5370 2024-09-10T21:54:04.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.204+0000 7f3c3a7fc640 1 -- 172.21.15.39:0/1212530792 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258753 (secure 0 0 0) 0x7f3c44105db0 con 0x7f3c300b5370 2024-09-10T21:54:04.207 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:04.207 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 msgr2=0x7f3c300b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 0x7f3c300b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000abe0 tx=0x7f3c4000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 msgr2=0x7f3c44199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005ab0 tx=0x7f3c34003d50 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 shutdown_connections 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3c300b5370 0x7f3c300b7830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c44109150 0x7f3c4419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c441087d0 0x7f3c44199720 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 --2- 172.21.15.39:0/1212530792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102dc0 0x7f3c441991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:04.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 >> 172.21.15.39:0/1212530792 conn(0x7f3c440fe830 msgr2=0x7f3c44100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 shutdown_connections 2024-09-10T21:54:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:04.207+0000 7f3c4b4b0640 1 -- 172.21.15.39:0/1212530792 wait complete. 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:54:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:03 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:04.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:54:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:54:04.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:03 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:54:04.844 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-10T21:54:03.468252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659723,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":627,"num_read_kb":413,"num_write":368,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952422,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369140,"kb_used_data":11496,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572684,"statfs":{"total":1151940427776,"available":1151562428416,"internally_reserved":0,"allocated":11771904,"data_stored":6615153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541986+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:44.541986+0000","last_peered":"2024-09-10T21:53:44.541986+0000","last_clean":"2024-09-10T21:53:44.541986+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:44.541986+0000","last_undegraded":"2024-09-10T21:53:44.541986+0000","last_fullsized":"2024-09-10T21:53:44.541986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555466+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:44.555466+0000","last_peered":"2024-09-10T21:53:44.555466+0000","last_clean":"2024-09-10T21:53:44.555466+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:44.555466+0000","last_undegraded":"2024-09-10T21:53:44.555466+0000","last_fullsized":"2024-09-10T21:53:44.555466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555413+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:44.555413+0000","last_peered":"2024-09-10T21:53:44.555413+0000","last_clean":"2024-09-10T21:53:44.555413+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:44.555413+0000","last_undegraded":"2024-09-10T21:53:44.555413+0000","last_fullsized":"2024-09-10T21:53:44.555413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556909+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:44.556909+0000","last_peered":"2024-09-10T21:53:44.556909+0000","last_clean":"2024-09-10T21:53:44.556909+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:44.556909+0000","last_undegraded":"2024-09-10T21:53:44.556909+0000","last_fullsized":"2024-09-10T21:53:44.556909+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542402+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:53:44.542402+0000","last_peered":"2024-09-10T21:53:44.542402+0000","last_clean":"2024-09-10T21:53:44.542402+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:53:44.542402+0000","last_undegraded":"2024-09-10T21:53:44.542402+0000","last_fullsized":"2024-09-10T21:53:44.542402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557178+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:53:44.557178+0000","last_peered":"2024-09-10T21:53:44.557178+0000","last_clean":"2024-09-10T21:53:44.557178+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:53:44.557178+0000","last_undegraded":"2024-09-10T21:53:44.557178+0000","last_fullsized":"2024-09-10T21:53:44.557178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539582+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:53:44.539582+0000","last_peered":"2024-09-10T21:53:44.539582+0000","last_clean":"2024-09-10T21:53:44.539582+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:53:44.539582+0000","last_undegraded":"2024-09-10T21:53:44.539582+0000","last_fullsized":"2024-09-10T21:53:44.539582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558841+0000","last_change":"2024-09-10T21:53:44.558293+0000","last_active":"2024-09-10T21:53:44.558841+0000","last_peered":"2024-09-10T21:53:44.558841+0000","last_clean":"2024-09-10T21:53:44.558841+0000","last_became_active":"2024-09-10T21:53:44.557902+0000","last_became_peered":"2024-09-10T21:53:44.557902+0000","last_unstale":"2024-09-10T21:53:44.558841+0000","last_undegraded":"2024-09-10T21:53:44.558841+0000","last_fullsized":"2024-09-10T21:53:44.558841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:01.123834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544297+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:53:44.544297+0000","last_peered":"2024-09-10T21:53:44.544297+0000","last_clean":"2024-09-10T21:53:44.544297+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:53:44.544297+0000","last_undegraded":"2024-09-10T21:53:44.544297+0000","last_fullsized":"2024-09-10T21:53:44.544297+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556570+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:53:44.556570+0000","last_peered":"2024-09-10T21:53:44.556570+0000","last_clean":"2024-09-10T21:53:44.556570+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:53:44.556570+0000","last_undegraded":"2024-09-10T21:53:44.556570+0000","last_fullsized":"2024-09-10T21:53:44.556570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539940+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:53:44.539940+0000","last_peered":"2024-09-10T21:53:44.539940+0000","last_clean":"2024-09-10T21:53:44.539940+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:53:44.539940+0000","last_undegraded":"2024-09-10T21:53:44.539940+0000","last_fullsized":"2024-09-10T21:53:44.539940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539339+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:53:44.539339+0000","last_peered":"2024-09-10T21:53:44.539339+0000","last_clean":"2024-09-10T21:53:44.539339+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:53:44.539339+0000","last_undegraded":"2024-09-10T21:53:44.539339+0000","last_fullsized":"2024-09-10T21:53:44.539339+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555268+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:44.555268+0000","last_peered":"2024-09-10T21:53:44.555268+0000","last_clean":"2024-09-10T21:53:44.555268+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:44.555268+0000","last_undegraded":"2024-09-10T21:53:44.555268+0000","last_fullsized":"2024-09-10T21:53:44.555268+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555328+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:44.555328+0000","last_peered":"2024-09-10T21:53:44.555328+0000","last_clean":"2024-09-10T21:53:44.555328+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:44.555328+0000","last_undegraded":"2024-09-10T21:53:44.555328+0000","last_fullsized":"2024-09-10T21:53:44.555328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543657+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:53:44.543657+0000","last_peered":"2024-09-10T21:53:44.543657+0000","last_clean":"2024-09-10T21:53:44.543657+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:53:44.543657+0000","last_undegraded":"2024-09-10T21:53:44.543657+0000","last_fullsized":"2024-09-10T21:53:44.543657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542105+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:44.542105+0000","last_peered":"2024-09-10T21:53:44.542105+0000","last_clean":"2024-09-10T21:53:44.542105+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:44.542105+0000","last_undegraded":"2024-09-10T21:53:44.542105+0000","last_fullsized":"2024-09-10T21:53:44.542105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543340+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:44.543340+0000","last_peered":"2024-09-10T21:53:44.543340+0000","last_clean":"2024-09-10T21:53:44.543340+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:44.543340+0000","last_undegraded":"2024-09-10T21:53:44.543340+0000","last_fullsized":"2024-09-10T21:53:44.543340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540012+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:44.540012+0000","last_peered":"2024-09-10T21:53:44.540012+0000","last_clean":"2024-09-10T21:53:44.540012+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:44.540012+0000","last_undegraded":"2024-09-10T21:53:44.540012+0000","last_fullsized":"2024-09-10T21:53:44.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541613+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:44.541613+0000","last_peered":"2024-09-10T21:53:44.541613+0000","last_clean":"2024-09-10T21:53:44.541613+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:44.541613+0000","last_undegraded":"2024-09-10T21:53:44.541613+0000","last_fullsized":"2024-09-10T21:53:44.541613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539346+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:53:44.539346+0000","last_peered":"2024-09-10T21:53:44.539346+0000","last_clean":"2024-09-10T21:53:44.539346+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:53:44.539346+0000","last_undegraded":"2024-09-10T21:53:44.539346+0000","last_fullsized":"2024-09-10T21:53:44.539346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543843+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:53:44.543843+0000","last_peered":"2024-09-10T21:53:44.543843+0000","last_clean":"2024-09-10T21:53:44.543843+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:53:44.543843+0000","last_undegraded":"2024-09-10T21:53:44.543843+0000","last_fullsized":"2024-09-10T21:53:44.543843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544372+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:53:44.544372+0000","last_peered":"2024-09-10T21:53:44.544372+0000","last_clean":"2024-09-10T21:53:44.544372+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:53:44.544372+0000","last_undegraded":"2024-09-10T21:53:44.544372+0000","last_fullsized":"2024-09-10T21:53:44.544372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544991+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:44.544991+0000","last_peered":"2024-09-10T21:53:44.544991+0000","last_clean":"2024-09-10T21:53:44.544991+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:44.544991+0000","last_undegraded":"2024-09-10T21:53:44.544991+0000","last_fullsized":"2024-09-10T21:53:44.544991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544185+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:53:44.544185+0000","last_peered":"2024-09-10T21:53:44.544185+0000","last_clean":"2024-09-10T21:53:44.544185+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:53:44.544185+0000","last_undegraded":"2024-09-10T21:53:44.544185+0000","last_fullsized":"2024-09-10T21:53:44.544185+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540227+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:44.540227+0000","last_peered":"2024-09-10T21:53:44.540227+0000","last_clean":"2024-09-10T21:53:44.540227+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:44.540227+0000","last_undegraded":"2024-09-10T21:53:44.540227+0000","last_fullsized":"2024-09-10T21:53:44.540227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541969+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:44.541969+0000","last_peered":"2024-09-10T21:53:44.541969+0000","last_clean":"2024-09-10T21:53:44.541969+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:44.541969+0000","last_undegraded":"2024-09-10T21:53:44.541969+0000","last_fullsized":"2024-09-10T21:53:44.541969+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539362+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:53:44.539362+0000","last_peered":"2024-09-10T21:53:44.539362+0000","last_clean":"2024-09-10T21:53:44.539362+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:53:44.539362+0000","last_undegraded":"2024-09-10T21:53:44.539362+0000","last_fullsized":"2024-09-10T21:53:44.539362+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555443+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:44.555443+0000","last_peered":"2024-09-10T21:53:44.555443+0000","last_clean":"2024-09-10T21:53:44.555443+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:44.555443+0000","last_undegraded":"2024-09-10T21:53:44.555443+0000","last_fullsized":"2024-09-10T21:53:44.555443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539653+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:44.539653+0000","last_peered":"2024-09-10T21:53:44.539653+0000","last_clean":"2024-09-10T21:53:44.539653+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:44.539653+0000","last_undegraded":"2024-09-10T21:53:44.539653+0000","last_fullsized":"2024-09-10T21:53:44.539653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.547111+0000","last_change":"2024-09-10T21:53:44.547016+0000","last_active":"2024-09-10T21:53:44.547111+0000","last_peered":"2024-09-10T21:53:44.547111+0000","last_clean":"2024-09-10T21:53:44.547111+0000","last_became_active":"2024-09-10T21:53:44.546627+0000","last_became_peered":"2024-09-10T21:53:44.546627+0000","last_unstale":"2024-09-10T21:53:44.547111+0000","last_undegraded":"2024-09-10T21:53:44.547111+0000","last_fullsized":"2024-09-10T21:53:44.547111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:36.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541388+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:44.541388+0000","last_peered":"2024-09-10T21:53:44.541388+0000","last_clean":"2024-09-10T21:53:44.541388+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:44.541388+0000","last_undegraded":"2024-09-10T21:53:44.541388+0000","last_fullsized":"2024-09-10T21:53:44.541388+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542211+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:53:44.542211+0000","last_peered":"2024-09-10T21:53:44.542211+0000","last_clean":"2024-09-10T21:53:44.542211+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:53:44.542211+0000","last_undegraded":"2024-09-10T21:53:44.542211+0000","last_fullsized":"2024-09-10T21:53:44.542211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":84,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.325165+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:54:01.325165+0000","last_peered":"2024-09-10T21:54:01.325165+0000","last_clean":"2024-09-10T21:54:01.325165+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:54:01.325165+0000","last_undegraded":"2024-09-10T21:54:01.325165+0000","last_fullsized":"2024-09-10T21:54:01.325165+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.546050+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:44.546050+0000","last_peered":"2024-09-10T21:53:44.546050+0000","last_clean":"2024-09-10T21:53:44.546050+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:44.546050+0000","last_undegraded":"2024-09-10T21:53:44.546050+0000","last_fullsized":"2024-09-10T21:53:44.546050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557192+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:44.557192+0000","last_peered":"2024-09-10T21:53:44.557192+0000","last_clean":"2024-09-10T21:53:44.557192+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:44.557192+0000","last_undegraded":"2024-09-10T21:53:44.557192+0000","last_fullsized":"2024-09-10T21:53:44.557192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539062+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:44.539062+0000","last_peered":"2024-09-10T21:53:44.539062+0000","last_clean":"2024-09-10T21:53:44.539062+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:44.539062+0000","last_undegraded":"2024-09-10T21:53:44.539062+0000","last_fullsized":"2024-09-10T21:53:44.539062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544098+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:53:44.544098+0000","last_peered":"2024-09-10T21:53:44.544098+0000","last_clean":"2024-09-10T21:53:44.544098+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:53:44.544098+0000","last_undegraded":"2024-09-10T21:53:44.544098+0000","last_fullsized":"2024-09-10T21:53:44.544098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545291+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:44.545291+0000","last_peered":"2024-09-10T21:53:44.545291+0000","last_clean":"2024-09-10T21:53:44.545291+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:44.545291+0000","last_undegraded":"2024-09-10T21:53:44.545291+0000","last_fullsized":"2024-09-10T21:53:44.545291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543281+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:44.543281+0000","last_peered":"2024-09-10T21:53:44.543281+0000","last_clean":"2024-09-10T21:53:44.543281+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:44.543281+0000","last_undegraded":"2024-09-10T21:53:44.543281+0000","last_fullsized":"2024-09-10T21:53:44.543281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":129,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.324398+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:54:01.324398+0000","last_peered":"2024-09-10T21:54:01.324398+0000","last_clean":"2024-09-10T21:54:01.324398+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:54:01.324398+0000","last_undegraded":"2024-09-10T21:54:01.324398+0000","last_fullsized":"2024-09-10T21:54:01.324398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544060+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:53:44.544060+0000","last_peered":"2024-09-10T21:53:44.544060+0000","last_clean":"2024-09-10T21:53:44.544060+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:53:44.544060+0000","last_undegraded":"2024-09-10T21:53:44.544060+0000","last_fullsized":"2024-09-10T21:53:44.544060+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539991+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:44.539991+0000","last_peered":"2024-09-10T21:53:44.539991+0000","last_clean":"2024-09-10T21:53:44.539991+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:44.539991+0000","last_undegraded":"2024-09-10T21:53:44.539991+0000","last_fullsized":"2024-09-10T21:53:44.539991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555630+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:44.555630+0000","last_peered":"2024-09-10T21:53:44.555630+0000","last_clean":"2024-09-10T21:53:44.555630+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:44.555630+0000","last_undegraded":"2024-09-10T21:53:44.555630+0000","last_fullsized":"2024-09-10T21:53:44.555630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545577+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:44.545577+0000","last_peered":"2024-09-10T21:53:44.545577+0000","last_clean":"2024-09-10T21:53:44.545577+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:44.545577+0000","last_undegraded":"2024-09-10T21:53:44.545577+0000","last_fullsized":"2024-09-10T21:53:44.545577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543963+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:53:44.543963+0000","last_peered":"2024-09-10T21:53:44.543963+0000","last_clean":"2024-09-10T21:53:44.543963+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:53:44.543963+0000","last_undegraded":"2024-09-10T21:53:44.543963+0000","last_fullsized":"2024-09-10T21:53:44.543963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'32","reported_seq":166,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.324276+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:54:01.324276+0000","last_peered":"2024-09-10T21:54:01.324276+0000","last_clean":"2024-09-10T21:54:01.324276+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:54:01.324276+0000","last_undegraded":"2024-09-10T21:54:01.324276+0000","last_fullsized":"2024-09-10T21:54:01.324276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62308,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":116,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543447+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:53:44.543447+0000","last_peered":"2024-09-10T21:53:44.543447+0000","last_clean":"2024-09-10T21:53:44.543447+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:53:44.543447+0000","last_undegraded":"2024-09-10T21:53:44.543447+0000","last_fullsized":"2024-09-10T21:53:44.543447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539851+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:44.539851+0000","last_peered":"2024-09-10T21:53:44.539851+0000","last_clean":"2024-09-10T21:53:44.539851+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:44.539851+0000","last_undegraded":"2024-09-10T21:53:44.539851+0000","last_fullsized":"2024-09-10T21:53:44.539851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539112+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:53:44.539112+0000","last_peered":"2024-09-10T21:53:44.539112+0000","last_clean":"2024-09-10T21:53:44.539112+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:53:44.539112+0000","last_undegraded":"2024-09-10T21:53:44.539112+0000","last_fullsized":"2024-09-10T21:53:44.539112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544851+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:44.544851+0000","last_peered":"2024-09-10T21:53:44.544851+0000","last_clean":"2024-09-10T21:53:44.544851+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:44.544851+0000","last_undegraded":"2024-09-10T21:53:44.544851+0000","last_fullsized":"2024-09-10T21:53:44.544851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539869+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:53:44.539869+0000","last_peered":"2024-09-10T21:53:44.539869+0000","last_clean":"2024-09-10T21:53:44.539869+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:53:44.539869+0000","last_undegraded":"2024-09-10T21:53:44.539869+0000","last_fullsized":"2024-09-10T21:53:44.539869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":82,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.324716+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:54:01.324716+0000","last_peered":"2024-09-10T21:54:01.324716+0000","last_clean":"2024-09-10T21:54:01.324716+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:54:01.324716+0000","last_undegraded":"2024-09-10T21:54:01.324716+0000","last_fullsized":"2024-09-10T21:54:01.324716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539496+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:53:44.539496+0000","last_peered":"2024-09-10T21:53:44.539496+0000","last_clean":"2024-09-10T21:53:44.539496+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:53:44.539496+0000","last_undegraded":"2024-09-10T21:53:44.539496+0000","last_fullsized":"2024-09-10T21:53:44.539496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542191+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:44.542191+0000","last_peered":"2024-09-10T21:53:44.542191+0000","last_clean":"2024-09-10T21:53:44.542191+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:44.542191+0000","last_undegraded":"2024-09-10T21:53:44.542191+0000","last_fullsized":"2024-09-10T21:53:44.542191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545688+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:44.545688+0000","last_peered":"2024-09-10T21:53:44.545688+0000","last_clean":"2024-09-10T21:53:44.545688+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:44.545688+0000","last_undegraded":"2024-09-10T21:53:44.545688+0000","last_fullsized":"2024-09-10T21:53:44.545688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542756+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:44.542756+0000","last_peered":"2024-09-10T21:53:44.542756+0000","last_clean":"2024-09-10T21:53:44.542756+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:44.542756+0000","last_undegraded":"2024-09-10T21:53:44.542756+0000","last_fullsized":"2024-09-10T21:53:44.542756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558295+0000","last_change":"2024-09-10T21:53:44.558208+0000","last_active":"2024-09-10T21:53:44.558295+0000","last_peered":"2024-09-10T21:53:44.558295+0000","last_clean":"2024-09-10T21:53:44.558295+0000","last_became_active":"2024-09-10T21:53:44.557786+0000","last_became_peered":"2024-09-10T21:53:44.557786+0000","last_unstale":"2024-09-10T21:53:44.558295+0000","last_undegraded":"2024-09-10T21:53:44.558295+0000","last_fullsized":"2024-09-10T21:53:44.558295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:35.278172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539468+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:44.539468+0000","last_peered":"2024-09-10T21:53:44.539468+0000","last_clean":"2024-09-10T21:53:44.539468+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:44.539468+0000","last_undegraded":"2024-09-10T21:53:44.539468+0000","last_fullsized":"2024-09-10T21:53:44.539468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540097+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:53:44.540097+0000","last_peered":"2024-09-10T21:53:44.540097+0000","last_clean":"2024-09-10T21:53:44.540097+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:53:44.540097+0000","last_undegraded":"2024-09-10T21:53:44.540097+0000","last_fullsized":"2024-09-10T21:53:44.540097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545708+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:44.545708+0000","last_peered":"2024-09-10T21:53:44.545708+0000","last_clean":"2024-09-10T21:53:44.545708+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:44.545708+0000","last_undegraded":"2024-09-10T21:53:44.545708+0000","last_fullsized":"2024-09-10T21:53:44.545708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539919+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:53:44.539919+0000","last_peered":"2024-09-10T21:53:44.539919+0000","last_clean":"2024-09-10T21:53:44.539919+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:53:44.539919+0000","last_undegraded":"2024-09-10T21:53:44.539919+0000","last_fullsized":"2024-09-10T21:53:44.539919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":82,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.325073+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:54:01.325073+0000","last_peered":"2024-09-10T21:54:01.325073+0000","last_clean":"2024-09-10T21:54:01.325073+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:54:01.325073+0000","last_undegraded":"2024-09-10T21:54:01.325073+0000","last_fullsized":"2024-09-10T21:54:01.325073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540092+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:53:44.540092+0000","last_peered":"2024-09-10T21:53:44.540092+0000","last_clean":"2024-09-10T21:53:44.540092+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:53:44.540092+0000","last_undegraded":"2024-09-10T21:53:44.540092+0000","last_fullsized":"2024-09-10T21:53:44.540092+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":96,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539686+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:44.539686+0000","last_peered":"2024-09-10T21:53:44.539686+0000","last_clean":"2024-09-10T21:53:44.539686+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:44.539686+0000","last_undegraded":"2024-09-10T21:53:44.539686+0000","last_fullsized":"2024-09-10T21:53:44.539686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544681+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:53:44.544681+0000","last_peered":"2024-09-10T21:53:44.544681+0000","last_clean":"2024-09-10T21:53:44.544681+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:53:44.544681+0000","last_undegraded":"2024-09-10T21:53:44.544681+0000","last_fullsized":"2024-09-10T21:53:44.544681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539673+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:44.539673+0000","last_peered":"2024-09-10T21:53:44.539673+0000","last_clean":"2024-09-10T21:53:44.539673+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:44.539673+0000","last_undegraded":"2024-09-10T21:53:44.539673+0000","last_fullsized":"2024-09-10T21:53:44.539673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544602+0000","last_change":"2024-09-10T21:53:44.544497+0000","last_active":"2024-09-10T21:53:44.544602+0000","last_peered":"2024-09-10T21:53:44.544602+0000","last_clean":"2024-09-10T21:53:44.544602+0000","last_became_active":"2024-09-10T21:53:44.544086+0000","last_became_peered":"2024-09-10T21:53:44.544086+0000","last_unstale":"2024-09-10T21:53:44.544602+0000","last_undegraded":"2024-09-10T21:53:44.544602+0000","last_fullsized":"2024-09-10T21:53:44.544602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:42.547771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":78,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:58.320365+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:53:58.320365+0000","last_peered":"2024-09-10T21:53:58.320365+0000","last_clean":"2024-09-10T21:53:58.320365+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:53:58.320365+0000","last_undegraded":"2024-09-10T21:53:58.320365+0000","last_fullsized":"2024-09-10T21:53:58.320365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545100+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:44.545100+0000","last_peered":"2024-09-10T21:53:44.545100+0000","last_clean":"2024-09-10T21:53:44.545100+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:44.545100+0000","last_undegraded":"2024-09-10T21:53:44.545100+0000","last_fullsized":"2024-09-10T21:53:44.545100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":80,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:00.333213+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:54:00.333213+0000","last_peered":"2024-09-10T21:54:00.333213+0000","last_clean":"2024-09-10T21:54:00.333213+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:54:00.333213+0000","last_undegraded":"2024-09-10T21:54:00.333213+0000","last_fullsized":"2024-09-10T21:54:00.333213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556274+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:53:44.556274+0000","last_peered":"2024-09-10T21:53:44.556274+0000","last_clean":"2024-09-10T21:53:44.556274+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:53:44.556274+0000","last_undegraded":"2024-09-10T21:53:44.556274+0000","last_fullsized":"2024-09-10T21:53:44.556274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543424+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:44.543424+0000","last_peered":"2024-09-10T21:53:44.543424+0000","last_clean":"2024-09-10T21:53:44.543424+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:44.543424+0000","last_undegraded":"2024-09-10T21:53:44.543424+0000","last_fullsized":"2024-09-10T21:53:44.543424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556348+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:53:44.556348+0000","last_peered":"2024-09-10T21:53:44.556348+0000","last_clean":"2024-09-10T21:53:44.556348+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:53:44.556348+0000","last_undegraded":"2024-09-10T21:53:44.556348+0000","last_fullsized":"2024-09-10T21:53:44.556348+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543551+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:44.543551+0000","last_peered":"2024-09-10T21:53:44.543551+0000","last_clean":"2024-09-10T21:53:44.543551+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:44.543551+0000","last_undegraded":"2024-09-10T21:53:44.543551+0000","last_fullsized":"2024-09-10T21:53:44.543551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539482+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:53:44.539482+0000","last_peered":"2024-09-10T21:53:44.539482+0000","last_clean":"2024-09-10T21:53:44.539482+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:53:44.539482+0000","last_undegraded":"2024-09-10T21:53:44.539482+0000","last_fullsized":"2024-09-10T21:53:44.539482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'14","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543451+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:44.543451+0000","last_peered":"2024-09-10T21:53:44.543451+0000","last_clean":"2024-09-10T21:53:44.543451+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:44.543451+0000","last_undegraded":"2024-09-10T21:53:44.543451+0000","last_fullsized":"2024-09-10T21:53:44.543451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544286+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:53:44.544286+0000","last_peered":"2024-09-10T21:53:44.544286+0000","last_clean":"2024-09-10T21:53:44.544286+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:53:44.544286+0000","last_undegraded":"2024-09-10T21:53:44.544286+0000","last_fullsized":"2024-09-10T21:53:44.544286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556856+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:44.556856+0000","last_peered":"2024-09-10T21:53:44.556856+0000","last_clean":"2024-09-10T21:53:44.556856+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:44.556856+0000","last_undegraded":"2024-09-10T21:53:44.556856+0000","last_fullsized":"2024-09-10T21:53:44.556856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555472+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:44.555472+0000","last_peered":"2024-09-10T21:53:44.555472+0000","last_clean":"2024-09-10T21:53:44.555472+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:44.555472+0000","last_undegraded":"2024-09-10T21:53:44.555472+0000","last_fullsized":"2024-09-10T21:53:44.555472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543821+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:44.543821+0000","last_peered":"2024-09-10T21:53:44.543821+0000","last_clean":"2024-09-10T21:53:44.543821+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:44.543821+0000","last_undegraded":"2024-09-10T21:53:44.543821+0000","last_fullsized":"2024-09-10T21:53:44.543821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543998+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:53:44.543998+0000","last_peered":"2024-09-10T21:53:44.543998+0000","last_clean":"2024-09-10T21:53:44.543998+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:53:44.543998+0000","last_undegraded":"2024-09-10T21:53:44.543998+0000","last_fullsized":"2024-09-10T21:53:44.543998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544539+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:44.544539+0000","last_peered":"2024-09-10T21:53:44.544539+0000","last_clean":"2024-09-10T21:53:44.544539+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:44.544539+0000","last_undegraded":"2024-09-10T21:53:44.544539+0000","last_fullsized":"2024-09-10T21:53:44.544539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541458+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:44.541458+0000","last_peered":"2024-09-10T21:53:44.541458+0000","last_clean":"2024-09-10T21:53:44.541458+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:44.541458+0000","last_undegraded":"2024-09-10T21:53:44.541458+0000","last_fullsized":"2024-09-10T21:53:44.541458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.551887+0000","last_change":"2024-09-10T21:53:44.551320+0000","last_active":"2024-09-10T21:53:44.551887+0000","last_peered":"2024-09-10T21:53:44.551887+0000","last_clean":"2024-09-10T21:53:44.551887+0000","last_became_active":"2024-09-10T21:53:44.546446+0000","last_became_peered":"2024-09-10T21:53:44.546446+0000","last_unstale":"2024-09-10T21:53:44.551887+0000","last_undegraded":"2024-09-10T21:53:44.551887+0000","last_fullsized":"2024-09-10T21:53:44.551887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:19.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544450+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:53:44.544450+0000","last_peered":"2024-09-10T21:53:44.544450+0000","last_clean":"2024-09-10T21:53:44.544450+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:53:44.544450+0000","last_undegraded":"2024-09-10T21:53:44.544450+0000","last_fullsized":"2024-09-10T21:53:44.544450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542660+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:44.542660+0000","last_peered":"2024-09-10T21:53:44.542660+0000","last_clean":"2024-09-10T21:53:44.542660+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:44.542660+0000","last_undegraded":"2024-09-10T21:53:44.542660+0000","last_fullsized":"2024-09-10T21:53:44.542660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539664+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:53:44.539664+0000","last_peered":"2024-09-10T21:53:44.539664+0000","last_clean":"2024-09-10T21:53:44.539664+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:53:44.539664+0000","last_undegraded":"2024-09-10T21:53:44.539664+0000","last_fullsized":"2024-09-10T21:53:44.539664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.548275+0000","last_change":"2024-09-10T21:53:44.548188+0000","last_active":"2024-09-10T21:53:44.548275+0000","last_peered":"2024-09-10T21:53:44.548275+0000","last_clean":"2024-09-10T21:53:44.548275+0000","last_became_active":"2024-09-10T21:53:44.547897+0000","last_became_peered":"2024-09-10T21:53:44.547897+0000","last_unstale":"2024-09-10T21:53:44.548275+0000","last_undegraded":"2024-09-10T21:53:44.548275+0000","last_fullsized":"2024-09-10T21:53:44.548275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:21.351072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557183+0000","last_change":"2024-09-10T21:53:44.556670+0000","last_active":"2024-09-10T21:53:44.557183+0000","last_peered":"2024-09-10T21:53:44.557183+0000","last_clean":"2024-09-10T21:53:44.557183+0000","last_became_active":"2024-09-10T21:53:44.546758+0000","last_became_peered":"2024-09-10T21:53:44.546758+0000","last_unstale":"2024-09-10T21:53:44.557183+0000","last_undegraded":"2024-09-10T21:53:44.557183+0000","last_fullsized":"2024-09-10T21:53:44.557183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:02.292116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543838+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:53:44.543838+0000","last_peered":"2024-09-10T21:53:44.543838+0000","last_clean":"2024-09-10T21:53:44.543838+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:53:44.543838+0000","last_undegraded":"2024-09-10T21:53:44.543838+0000","last_fullsized":"2024-09-10T21:53:44.543838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.568857+0000","last_change":"2024-09-10T21:53:44.568775+0000","last_active":"2024-09-10T21:53:44.568857+0000","last_peered":"2024-09-10T21:53:44.568857+0000","last_clean":"2024-09-10T21:53:44.568857+0000","last_became_active":"2024-09-10T21:53:44.558126+0000","last_became_peered":"2024-09-10T21:53:44.558126+0000","last_unstale":"2024-09-10T21:53:44.568857+0000","last_undegraded":"2024-09-10T21:53:44.568857+0000","last_fullsized":"2024-09-10T21:53:44.568857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:00.789948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555627+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:44.555627+0000","last_peered":"2024-09-10T21:53:44.555627+0000","last_clean":"2024-09-10T21:53:44.555627+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:44.555627+0000","last_undegraded":"2024-09-10T21:53:44.555627+0000","last_fullsized":"2024-09-10T21:53:44.555627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544324+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:44.544324+0000","last_peered":"2024-09-10T21:53:44.544324+0000","last_clean":"2024-09-10T21:53:44.544324+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:44.544324+0000","last_undegraded":"2024-09-10T21:53:44.544324+0000","last_fullsized":"2024-09-10T21:53:44.544324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544169+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:53:44.544169+0000","last_peered":"2024-09-10T21:53:44.544169+0000","last_clean":"2024-09-10T21:53:44.544169+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:53:44.544169+0000","last_undegraded":"2024-09-10T21:53:44.544169+0000","last_fullsized":"2024-09-10T21:53:44.544169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":89,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:01.333993+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:54:01.333993+0000","last_peered":"2024-09-10T21:54:01.333993+0000","last_clean":"2024-09-10T21:54:01.333993+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:54:01.333993+0000","last_undegraded":"2024-09-10T21:54:01.333993+0000","last_fullsized":"2024-09-10T21:54:01.333993+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69121,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":551,"num_read_kb":349,"num_write":243,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":207363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874266,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":798720,"data_stored":388106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037790,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1499136,"data_stored":1040861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201316,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":387454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":387250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593773,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1413120,"data_stored":980350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724594,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":802816,"data_stored":387171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":980028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":387032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":386996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":451003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40360,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704792,"statfs":{"total":95995035648,"available":95953707008,"internally_reserved":0,"allocated":868352,"data_stored":450392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":823296,"data_stored":388510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:54:04.849 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T21:54:04.849 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T21:54:04.849 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T21:54:04.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T21:54:05.114 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:05.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:04 smithi039 ceph-mon[30872]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:05.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:04 smithi173 ceph-mon[35294]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:05.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:04 smithi070 ceph-mon[34909]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:05.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 -- 172.21.15.39:0/996009981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 msgr2=0x7fcd4c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 --2- 172.21.15.39:0/996009981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c0758a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 -- 172.21.15.39:0/996009981 shutdown_connections 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 --2- 172.21.15.39:0/996009981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 --2- 172.21.15.39:0/996009981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c075de0 0x7fcd4c10ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 --2- 172.21.15.39:0/996009981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c0758a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 -- 172.21.15.39:0/996009981 >> 172.21.15.39:0/996009981 conn(0x7fcd4c0fe830 msgr2=0x7fcd4c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 -- 172.21.15.39:0/996009981 shutdown_connections 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.563+0000 7fcd5141b640 1 -- 172.21.15.39:0/996009981 wait complete. 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 Processor -- start 2024-09-10T21:54:05.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 -- start start 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c075de0 0x7fcd4c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c114fb0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c114e30 con 0x7fcd4c10f3d0 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.564+0000 7fcd5141b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c115130 con 0x7fcd4c075de0 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43190/0 (socket says 172.21.15.39:43190) 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 -- 172.21.15.39:0/2821228020 learned_addr learned my addr 172.21.15.39:0/2821228020 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4a7fc640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c075de0 0x7fcd4c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:05.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4b7fe640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 -- 172.21.15.39:0/2821228020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c075de0 msgr2=0x7fcd4c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c075de0 0x7fcd4c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 -- 172.21.15.39:0/2821228020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 msgr2=0x7fcd4c1a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 -- 172.21.15.39:0/2821228020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1a1550 con 0x7fcd4c0754c0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4b7fe640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd4affd640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005940 tx=0x7fcd3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c03f030 con 0x7fcd4c0754c0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1a17e0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd3c003cb0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c035070 con 0x7fcd4c0754c0 2024-09-10T21:54:05.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.565+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a7f00 con 0x7fcd4c0754c0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.566+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c0758a0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.568+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fcd3c003800 con 0x7fcd4c0754c0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.568+0000 7fcd33fff640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 0x7fcd340b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.569+0000 7fcd4a7fc640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 0x7fcd340b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.569+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fcd3c1068a0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.569+0000 7fcd4a7fc640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 0x7fcd340b7830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c101140 tx=0x7fcd4000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:05.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.573+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd3c0cd610 con 0x7fcd4c0754c0 2024-09-10T21:54:05.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.796+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd4c19c5d0 con 0x7fcd4c0754c0 2024-09-10T21:54:05.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.797+0000 7fcd33fff640 1 -- 172.21.15.39:0/2821228020 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcd3c0ccf10 con 0x7fcd4c0754c0 2024-09-10T21:54:05.797 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:05.798 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T21:54:05.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 msgr2=0x7fcd340b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 0x7fcd340b7830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c101140 tx=0x7fcd4000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 msgr2=0x7fcd4c19b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005940 tx=0x7fcd3c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 shutdown_connections 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcd340b5370 0x7fcd340b7830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd4c10f3d0 0x7fcd4c1a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd4c075de0 0x7fcd4c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 --2- 172.21.15.39:0/2821228020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd4c0754c0 0x7fcd4c19b4a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 >> 172.21.15.39:0/2821228020 conn(0x7fcd4c0fe830 msgr2=0x7fcd4c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 shutdown_connections 2024-09-10T21:54:05.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:05.799+0000 7fcd5141b640 1 -- 172.21.15.39:0/2821228020 wait complete. 2024-09-10T21:54:06.094 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:05 smithi039 ceph-mon[30872]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:06.094 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:05 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2821228020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:54:06.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:05 smithi070 ceph-mon[34909]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:06.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:05 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2821228020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:54:06.406 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T21:54:06.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:06.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:05 smithi173 ceph-mon[35294]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:06.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:05 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2821228020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:54:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:07.064 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:06 smithi039 ceph-mon[30872]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:07.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 -- 172.21.15.39:0/3742561465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac101cd0 msgr2=0x7f6cac1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:07.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/3742561465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac101cd0 0x7f6cac1020b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009900 tx=0x7f6c9c02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:07.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 -- 172.21.15.39:0/3742561465 shutdown_connections 2024-09-10T21:54:07.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/3742561465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 0x7f6cac10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/3742561465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac1076e0 0x7f6cac107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/3742561465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac101cd0 0x7f6cac1020b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 -- 172.21.15.39:0/3742561465 >> 172.21.15.39:0/3742561465 conn(0x7f6cac0fd700 msgr2=0x7f6cac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 -- 172.21.15.39:0/3742561465 shutdown_connections 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.063+0000 7f6cb0d27640 1 -- 172.21.15.39:0/3742561465 wait complete. 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 Processor -- start 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 -- start start 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac101cd0 0x7f6cac19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 0x7f6cac1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac111d20 con 0x7f6cac1076e0 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac111ba0 con 0x7f6cac101cd0 2024-09-10T21:54:07.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6cb0d27640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac111ea0 con 0x7f6cac108060 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6ca9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6ca9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43220/0 (socket says 172.21.15.39:43220) 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6ca9d9b640 1 -- 172.21.15.39:0/182170889 learned_addr learned my addr 172.21.15.39:0/182170889 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.064+0000 7f6caa59c640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac101cd0 0x7f6cac19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6caad9d640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 0x7f6cac1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 -- 172.21.15.39:0/182170889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 msgr2=0x7f6cac1a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 0x7f6cac1a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 -- 172.21.15.39:0/182170889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac101cd0 msgr2=0x7f6cac19b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac101cd0 0x7f6cac19b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 -- 172.21.15.39:0/182170889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac1a1500 con 0x7f6cac1076e0 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6ca9d9b640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000d950 tx=0x7f6ca000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:07.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0017030 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1a17f0 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ca0004020 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00047a0 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.065+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1a7eb0 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.066+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac1020b0 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.068+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6ca0009a30 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.069+0000 7f6c9b7fe640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 0x7f6c940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.069+0000 7f6caa59c640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 0x7f6c940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.069+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6ca00e5eb0 con 0x7f6cac1076e0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.069+0000 7f6caa59c640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 0x7f6c940b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c031440 tx=0x7f6c9c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:07.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.072+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ca00acc20 con 0x7f6cac1076e0 2024-09-10T21:54:07.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.292+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cac1a81e0 con 0x7f6cac1076e0 2024-09-10T21:54:07.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.293+0000 7f6c9b7fe640 1 -- 172.21.15.39:0/182170889 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7f6ca00ac520 con 0x7f6cac1076e0 2024-09-10T21:54:07.294 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:07.294 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:54:07.294 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 msgr2=0x7f6c940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 0x7f6c940b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c031440 tx=0x7f6c9c005b50 comp rx=0 tx=0).stop 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 msgr2=0x7f6cac19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000d950 tx=0x7f6ca000de10 comp rx=0 tx=0).stop 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 shutdown_connections 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6c940b5370 0x7f6c940b7830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cac108060 0x7f6cac1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac1076e0 0x7f6cac19b990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 --2- 172.21.15.39:0/182170889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6cac101cd0 0x7f6cac19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:07.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 >> 172.21.15.39:0/182170889 conn(0x7f6cac0fd700 msgr2=0x7f6cac06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:07.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 shutdown_connections 2024-09-10T21:54:07.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:07.295+0000 7f6cb0d27640 1 -- 172.21.15.39:0/182170889 wait complete. 2024-09-10T21:54:07.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:06 smithi070 ceph-mon[34909]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:06 smithi173 ceph-mon[35294]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:07.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:08.103 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:08.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:08 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/182170889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:08.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:08 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/182170889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:08.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:08 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/182170889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:08.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 -- 172.21.15.39:0/494147829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 msgr2=0x7f3d201040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 --2- 172.21.15.39:0/494147829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d201040a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009900 tx=0x7f3d1002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 -- 172.21.15.39:0/494147829 shutdown_connections 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 --2- 172.21.15.39:0/494147829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d2010d120 0x7f3d2010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 --2- 172.21.15.39:0/494147829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201045e0 0x7f3d2010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 --2- 172.21.15.39:0/494147829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d201040a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 -- 172.21.15.39:0/494147829 >> 172.21.15.39:0/494147829 conn(0x7f3d200fd700 msgr2=0x7f3d200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 -- 172.21.15.39:0/494147829 shutdown_connections 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.547+0000 7f3d25757640 1 -- 172.21.15.39:0/494147829 wait complete. 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.548+0000 7f3d25757640 1 Processor -- start 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.548+0000 7f3d25757640 1 -- start start 2024-09-10T21:54:08.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d201045e0 0x7f3d20199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 0x7f3d2019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20112df0 con 0x7f3d20103cc0 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20112c70 con 0x7f3d2010d120 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20112f70 con 0x7f3d201045e0 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43246/0 (socket says 172.21.15.39:43246) 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 -- 172.21.15.39:0/2120571302 learned_addr learned my addr 172.21.15.39:0/2120571302 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1e7fc640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d201045e0 0x7f3d20199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1f7fe640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 0x7f3d2019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 -- 172.21.15.39:0/2120571302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d201045e0 msgr2=0x7f3d20199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d201045e0 0x7f3d20199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 -- 172.21.15.39:0/2120571302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 msgr2=0x7f3d2019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 0x7f3d2019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 -- 172.21.15.39:0/2120571302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2019f3f0 con 0x7f3d20103cc0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1f7fe640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 0x7f3d2019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d1effd640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005940 tx=0x7f3d100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1003f030 con 0x7f3d20103cc0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d10003cb0 con 0x7f3d20103cc0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10035070 con 0x7f3d20103cc0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.549+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2019f680 con 0x7f3d20103cc0 2024-09-10T21:54:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.550+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a5da0 con 0x7f3d20103cc0 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.550+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d201040a0 con 0x7f3d20103cc0 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.552+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3d1003bbf0 con 0x7f3d20103cc0 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.553+0000 7f3d07fff640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 0x7f3d080b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.553+0000 7f3d1e7fc640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 0x7f3d080b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.553+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3d10106b50 con 0x7f3d20103cc0 2024-09-10T21:54:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.553+0000 7f3d1e7fc640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 0x7f3d080b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d2010f860 tx=0x7f3d14009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.556+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3d100cd8c0 con 0x7f3d20103cc0 2024-09-10T21:54:08.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.780+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d2019a470 con 0x7f3d20103cc0 2024-09-10T21:54:08.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.781+0000 7f3d07fff640 1 -- 172.21.15.39:0/2120571302 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7f3d100cd1c0 con 0x7f3d20103cc0 2024-09-10T21:54:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:08.782 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:54:08.782 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 msgr2=0x7f3d080b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 0x7f3d080b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d2010f860 tx=0x7f3d14009060 comp rx=0 tx=0).stop 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 msgr2=0x7f3d20199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005940 tx=0x7f3d100042f0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 shutdown_connections 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b53f0 0x7f3d080b78b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d2010d120 0x7f3d2019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d201045e0 0x7f3d20199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 --2- 172.21.15.39:0/2120571302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103cc0 0x7f3d20199340 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:08.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 >> 172.21.15.39:0/2120571302 conn(0x7f3d200fd700 msgr2=0x7f3d200fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:08.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 shutdown_connections 2024-09-10T21:54:08.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:08.784+0000 7f3d25757640 1 -- 172.21.15.39:0/2120571302 wait complete. 2024-09-10T21:54:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:09 smithi039 ceph-mon[30872]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:09 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2120571302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:09.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:54:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:09 smithi070 ceph-mon[34909]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:09 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2120571302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:09 smithi173 ceph-mon[35294]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:09 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2120571302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:09.651 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:10.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 -- 172.21.15.39:0/2142490685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 msgr2=0x7f38cc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:10.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 --2- 172.21.15.39:0/2142490685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc10f550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009ca0 tx=0x7f38c402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 -- 172.21.15.39:0/2142490685 shutdown_connections 2024-09-10T21:54:10.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 --2- 172.21.15.39:0/2142490685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc10f550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 --2- 172.21.15.39:0/2142490685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc104530 0x7f38cc10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 --2- 172.21.15.39:0/2142490685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc103b30 0x7f38cc103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 -- 172.21.15.39:0/2142490685 >> 172.21.15.39:0/2142490685 conn(0x7f38cc0fd700 msgr2=0x7f38cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 -- 172.21.15.39:0/2142490685 shutdown_connections 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.125+0000 7f38d20c6640 1 -- 172.21.15.39:0/2142490685 wait complete. 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 Processor -- start 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 -- start start 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc103b30 0x7f38cc1019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc104530 0x7f38cc101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc112d60 con 0x7f38cc10d0e0 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc112be0 con 0x7f38cc104530 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.126+0000 7f38d20c6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc112ee0 con 0x7f38cc103b30 2024-09-10T21:54:10.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42786/0 (socket says 172.21.15.39:42786) 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 -- 172.21.15.39:0/59321879 learned_addr learned my addr 172.21.15.39:0/59321879 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cb7fe640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc103b30 0x7f38cc1019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38caffd640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc104530 0x7f38cc101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 -- 172.21.15.39:0/59321879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc103b30 msgr2=0x7f38cc1019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc103b30 0x7f38cc1019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 -- 172.21.15.39:0/59321879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc104530 msgr2=0x7f38cc101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc104530 0x7f38cc101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 -- 172.21.15.39:0/59321879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc1a7610 con 0x7f38cc10d0e0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38cbfff640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005cc0 tx=0x7f38c4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4003b70 con 0x7f38cc10d0e0 2024-09-10T21:54:10.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c40318f0 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc1a78a0 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c402f950 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.127+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc1a7de0 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.128+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38cc103f10 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.131+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f38c402fb30 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.131+0000 7f38c8ff9640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 0x7f38b40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.132+0000 7f38cb7fe640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 0x7f38b40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.132+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f38c4107000 con 0x7f38cc10d0e0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.132+0000 7f38cb7fe640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 0x7f38b40b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009bd0 tx=0x7f38bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:10.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.134+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f38c40cdd70 con 0x7f38cc10d0e0 2024-09-10T21:54:10.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.323+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38cc1a81d0 con 0x7f38cc10d0e0 2024-09-10T21:54:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:10.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.325+0000 7f38c8ff9640 1 -- 172.21.15.39:0/59321879 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22652 (secure 0 0 0) 0x7f38c40cd670 con 0x7f38cc10d0e0 2024-09-10T21:54:10.327 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:44.535601+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:54:10.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 msgr2=0x7f38b40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 0x7f38b40b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009bd0 tx=0x7f38bc005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 msgr2=0x7f38cc102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005cc0 tx=0x7f38c4031700 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 shutdown_connections 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f38b40b5370 0x7f38b40b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38cc10d0e0 0x7f38cc102430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38cc104530 0x7f38cc101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 --2- 172.21.15.39:0/59321879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38cc103b30 0x7f38cc1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 >> 172.21.15.39:0/59321879 conn(0x7f38cc0fd700 msgr2=0x7f38cc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 shutdown_connections 2024-09-10T21:54:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:10.328+0000 7f38d20c6640 1 -- 172.21.15.39:0/59321879 wait complete. 2024-09-10T21:54:10.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:11.142 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:11.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:11 smithi039 ceph-mon[30872]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:11.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:11 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/59321879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:11.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:11 smithi070 ceph-mon[34909]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:11.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:11 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/59321879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:11 smithi173 ceph-mon[35294]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:11 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/59321879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:11.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 -- 172.21.15.39:0/3472925570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10d250 msgr2=0x7f396c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 --2- 172.21.15.39:0/3472925570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10d250 0x7f396c10f640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3964009ca0 tx=0x7f396402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 -- 172.21.15.39:0/3472925570 shutdown_connections 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 --2- 172.21.15.39:0/3472925570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10d250 0x7f396c10f640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 --2- 172.21.15.39:0/3472925570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c10a920 0x7f396c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 --2- 172.21.15.39:0/3472925570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c101810 0x7f396c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 -- 172.21.15.39:0/3472925570 >> 172.21.15.39:0/3472925570 conn(0x7f396c076f50 msgr2=0x7f396c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 -- 172.21.15.39:0/3472925570 shutdown_connections 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.608+0000 7f397086d640 1 -- 172.21.15.39:0/3472925570 wait complete. 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 Processor -- start 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 -- start start 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 0x7f396c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:11.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c10d250 0x7f396c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f396c112e80 con 0x7f396c10a920 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f396c112d00 con 0x7f396c10d250 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f397086d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f396c113000 con 0x7f396c101810 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f3963fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f3963fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42796/0 (socket says 172.21.15.39:42796) 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f3963fff640 1 -- 172.21.15.39:0/2125970515 learned_addr learned my addr 172.21.15.39:0/2125970515 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f396ad9d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c10d250 0x7f396c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.609+0000 7f396a59c640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 0x7f396c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 -- 172.21.15.39:0/2125970515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 msgr2=0x7f396c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 0x7f396c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 -- 172.21.15.39:0/2125970515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c10d250 msgr2=0x7f396c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c10d250 0x7f396c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 -- 172.21.15.39:0/2125970515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19f420 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f396a59c640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 0x7f396c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f3963fff640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f395400b4a0 tx=0x7f395400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954014070 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3954010ac0 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19f710 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954017c30 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.610+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a5e50 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.611+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c101c70 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.613+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3954010610 con 0x7f396c10a920 2024-09-10T21:54:11.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.613+0000 7f39637fe640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 0x7f39580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.613+0000 7f396a59c640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 0x7f39580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.613+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f39540e56b0 con 0x7f396c10a920 2024-09-10T21:54:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.614+0000 7f396a59c640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 0x7f39580b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f395c009930 tx=0x7f395c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:11.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.616+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39540ac420 con 0x7f396c10a920 2024-09-10T21:54:11.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.843+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f396c1a6130 con 0x7f396c10a920 2024-09-10T21:54:11.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.844+0000 7f39637fe640 1 -- 172.21.15.39:0/2125970515 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7f39540abd20 con 0x7f396c10a920 2024-09-10T21:54:11.844 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:11.845 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:54:11.845 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 msgr2=0x7f39580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 0x7f39580b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f395c009930 tx=0x7f395c008040 comp rx=0 tx=0).stop 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 msgr2=0x7f396c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f395400b4a0 tx=0x7f395400b960 comp rx=0 tx=0).stop 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 shutdown_connections 2024-09-10T21:54:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39580b5370 0x7f39580b7830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c10d250 0x7f396c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f396c10a920 0x7f396c1998b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 --2- 172.21.15.39:0/2125970515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f396c101810 0x7f396c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 >> 172.21.15.39:0/2125970515 conn(0x7f396c076f50 msgr2=0x7f396c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 shutdown_connections 2024-09-10T21:54:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:11.846+0000 7f397086d640 1 -- 172.21.15.39:0/2125970515 wait complete. 2024-09-10T21:54:12.138 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:12 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2125970515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:12.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:12 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2125970515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:12.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T21:53:00.566007+0000', 'modified': '2024-09-10T21:53:11.761230+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24590, 'mds_1': 24583, 'mds_2': 24563, 'mds_3': 24562, 'mds_4': 24550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14703': {'gid': 14703, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6839/4288267736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 4288267736}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 4288267736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14715': {'gid': 14715, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6841/2073917136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6840', 'nonce': 2073917136}, {'type': 'v1', 'addr': '172.21.15.39:6841', 'nonce': 2073917136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6833/4205749592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 4205749592}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 4205749592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/4284402847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 4284402847}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 4284402847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6835/4263006579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6834', 'nonce': 4263006579}, {'type': 'v1', 'addr': '172.21.15.70:6835', 'nonce': 4263006579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.173:6835/1204968390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 1204968390}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 1204968390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/4244781378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 4244781378}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 4244781378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.70:6837/3809137442', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 3809137442}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 3809137442}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.173:6839/4266233306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 4266233306}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 4266233306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.70:6839/398684741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 398684741}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 398684741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24590, 'qdb_cluster': [24590, 24583, 24562, 24563, 24550]} 2024-09-10T21:54:12.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T21:54:12.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T21:54:12.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:12 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2125970515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:12.674 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:13.068 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:13 smithi039 ceph-mon[30872]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:13.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 -- 172.21.15.39:0/3554857509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 msgr2=0x7faed810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 --2- 172.21.15.39:0/3554857509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed810f950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faed0009ca0 tx=0x7faed002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 -- 172.21.15.39:0/3554857509 shutdown_connections 2024-09-10T21:54:13.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 --2- 172.21.15.39:0/3554857509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed810f950 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 --2- 172.21.15.39:0/3554857509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 0x7faed8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 --2- 172.21.15.39:0/3554857509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 0x7faed81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 -- 172.21.15.39:0/3554857509 >> 172.21.15.39:0/3554857509 conn(0x7faed80fe830 msgr2=0x7faed8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.077+0000 7faedd15f640 1 -- 172.21.15.39:0/3554857509 shutdown_connections 2024-09-10T21:54:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.078+0000 7faedd15f640 1 -- 172.21.15.39:0/3554857509 wait complete. 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.078+0000 7faedd15f640 1 Processor -- start 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.078+0000 7faedd15f640 1 -- start start 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.078+0000 7faedd15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 0x7faed81991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 0x7faed8199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faed8112dd0 con 0x7faed8109150 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faed8112c50 con 0x7faed8102dc0 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faed8112f50 con 0x7faed81087d0 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42812/0 (socket says 172.21.15.39:42812) 2024-09-10T21:54:13.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 -- 172.21.15.39:0/335310191 learned_addr learned my addr 172.21.15.39:0/335310191 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faecffff640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 0x7faed8199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed6d9d640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 0x7faed81991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 -- 172.21.15.39:0/335310191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 msgr2=0x7faed8199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 0x7faed8199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 -- 172.21.15.39:0/335310191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 msgr2=0x7faed81991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 0x7faed81991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 -- 172.21.15.39:0/335310191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed819f280 con 0x7faed8109150 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed759e640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faed0005cc0 tx=0x7faed002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed4d99640 1 -- 172.21.15.39:0/335310191 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0003cf0 con 0x7faed8109150 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed819f510 con 0x7faed8109150 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.079+0000 7faed4d99640 1 -- 172.21.15.39:0/335310191 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed00044f0 con 0x7faed8109150 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.080+0000 7faed4d99640 1 -- 172.21.15.39:0/335310191 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed002fc30 con 0x7faed8109150 2024-09-10T21:54:13.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.080+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed8075380 con 0x7faed8109150 2024-09-10T21:54:13.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 Processor -- start 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faed4d99640 1 -- 172.21.15.39:0/335310191 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7faed0004040 con 0x7faed8109150 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 -- start start 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc79119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555bc787ac10 con 0x555bc7902d30 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bc786a040 con 0x555bc7903650 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.082+0000 7faedf534740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555bc786de50 con 0x555bc790f5e0 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42814/0 (socket says 172.21.15.39:42814) 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 -- 172.21.15.39:0/2936236752 learned_addr learned my addr 172.21.15.39:0/2936236752 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 -- 172.21.15.39:0/2936236752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 msgr2=0x555bc79119d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc79119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 -- 172.21.15.39:0/2936236752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 msgr2=0x555bc790f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 -- 172.21.15.39:0/2936236752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc75c8540 con 0x555bc7902d30 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecffff640 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faec000acc0 tx=0x7faec00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10faef1ed0e64f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faed4d99640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 0x7faec40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faecd7fa640 1 -- 172.21.15.39:0/2936236752 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0005020 con 0x555bc7902d30 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faed6d9d640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 0x7faec40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.083+0000 7faed4d99640 1 -- 172.21.15.39:0/335310191 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7faed0107150 con 0x7faed8109150 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faecd7fa640 1 -- 172.21.15.39:0/2936236752 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec00047a0 con 0x555bc7902d30 2024-09-10T21:54:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faecd7fa640 1 -- 172.21.15.39:0/2936236752 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00126b0 con 0x555bc7902d30 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faed6d9d640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 0x7faec40b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x555bc7905eb0 tx=0x7faec8010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 -- 172.21.15.39:0/2936236752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 msgr2=0x555bc7903110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faec000acc0 tx=0x7faec00117b0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 -- 172.21.15.39:0/2936236752 shutdown_connections 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc79119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 --2- 172.21.15.39:0/2936236752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc7903110 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.084+0000 7faedf534740 1 -- 172.21.15.39:0/2936236752 >> 172.21.15.39:0/2936236752 conn(0x555bc7900b60 msgr2=0x555bc7901d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- 172.21.15.39:0/2936236752 shutdown_connections 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- 172.21.15.39:0/2936236752 wait complete. 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- start start 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 Processor -- start 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 0x555bc790c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555bc76cb5f0 con 0x555bc790f5e0 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bc7805010 con 0x555bc7903650 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555bc7912290 con 0x555bc7902d30 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faedf534740 10 client.0 _ll_register_callbacks cb 0x555bc7864340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faed759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faed759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42830/0 (socket says 172.21.15.39:42830) 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.085+0000 7faed759e640 1 -- 172.21.15.39:0/2031890446 learned_addr learned my addr 172.21.15.39:0/2031890446 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faecffff640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 0x555bc790c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 -- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 msgr2=0x555bc790c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 0x555bc790c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 -- 172.21.15.39:0/2031890446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 msgr2=0x555bc790cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 -- 172.21.15.39:0/2031890446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc7832a00 con 0x555bc790f5e0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 0x555bc790c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faed759e640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faed0104b40 tx=0x7faed0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b41cdd40d5a5f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faebe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed00cd2d0 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7faed00c9a30 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec00047a0 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faed00cdec0 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faedf534740 10 client.15075 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555bc791de80 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.086+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec00047a0 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7faed00cda20 con 0x555bc790f5e0 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 10 client.15075 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 10 client.15075 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 20 client.15075 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7920520 0x555bc7921990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 4 client.15075 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bc787cb60 con 0x555bc7920520 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7920520 0x555bc7921990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faebe7fc640 10 client.15075 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.087+0000 7faed6d9d640 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7920520 0x555bc7921990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5192bf99ac784924 server_cookie=780f76e69e521586 in_seq=0 out_seq=0 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faebe7fc640 1 -- 172.21.15.39:0/2031890446 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bc787cb60 con 0x555bc7920520 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faebe7fc640 10 client.15075 handle_command_reply: tid=0 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 client.15075 shutdown 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 msgr2=0x555bc790d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faed0104b40 tx=0x7faed0030000 comp rx=0 tx=0).stop 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 shutdown_connections 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7920520 0x555bc7921990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc790f5e0 0x555bc790d060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.088+0000 7faedf534740 1 --2- 172.21.15.39:0/2031890446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7902d30 0x555bc790c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.089+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 >> 172.21.15.39:0/2031890446 conn(0x555bc7900b60 msgr2=0x555bc7906700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.089+0000 7faebe7fc640 0 client.15075 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.089+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 shutdown_connections 2024-09-10T21:54:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.089+0000 7faedf534740 1 -- 172.21.15.39:0/2031890446 wait complete. 2024-09-10T21:54:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.089+0000 7faedf534740 20 client.15075 trim_cache size 0 max 16384 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 Processor -- start 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 -- start start 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc7901a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555bc791fcd0 con 0x555bc7902d30 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bc79203a0 con 0x555bc7903650 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faedf534740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555bc7920a70 con 0x555bc790f5e0 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42842/0 (socket says 172.21.15.39:42842) 2024-09-10T21:54:13.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 -- 172.21.15.39:0/3395617972 learned_addr learned my addr 172.21.15.39:0/3395617972 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 -- 172.21.15.39:0/3395617972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 msgr2=0x555bc7901a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc7901a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.107+0000 7faed6d9d640 1 -- 172.21.15.39:0/3395617972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 msgr2=0x555bc790b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faed6d9d640 1 -- 172.21.15.39:0/3395617972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc79015e0 con 0x555bc7902d30 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faec801a460 tx=0x7faec8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d0a36973f0fd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faeccff9640 1 -- 172.21.15.39:0/3395617972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8028810 con 0x555bc7902d30 2024-09-10T21:54:13.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faeccff9640 1 -- 172.21.15.39:0/3395617972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec801ae10 con 0x555bc7902d30 2024-09-10T21:54:13.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.108+0000 7faeccff9640 1 -- 172.21.15.39:0/3395617972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec801bbe0 con 0x555bc7902d30 2024-09-10T21:54:13.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- 172.21.15.39:0/3395617972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 msgr2=0x555bc790ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faec801a460 tx=0x7faec8018000 comp rx=0 tx=0).stop 2024-09-10T21:54:13.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- 172.21.15.39:0/3395617972 shutdown_connections 2024-09-10T21:54:13.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc790f5e0 0x555bc7901a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc7903650 0x555bc790b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 --2- 172.21.15.39:0/3395617972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc790ae60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- 172.21.15.39:0/3395617972 >> 172.21.15.39:0/3395617972 conn(0x555bc7900b60 msgr2=0x555bc791f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- 172.21.15.39:0/3395617972 shutdown_connections 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- 172.21.15.39:0/3395617972 wait complete. 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 -- start start 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.109+0000 7faedf534740 1 Processor -- start 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7903650 0x555bc7924820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc790f5e0 0x555bc7924d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555bc7921810 con 0x555bc7902d30 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bc7921140 con 0x555bc790f5e0 2024-09-10T21:54:13.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555bc7921ee0 con 0x555bc7903650 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faedf534740 10 client.0 _ll_register_callbacks cb 0x7faed00095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42856/0 (socket says 172.21.15.39:42856) 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 -- 172.21.15.39:0/3431855944 learned_addr learned my addr 172.21.15.39:0/3431855944 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faecffff640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7903650 0x555bc7924820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed759e640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc790f5e0 0x555bc7924d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 -- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7903650 msgr2=0x555bc7924820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7903650 0x555bc7924820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 -- 172.21.15.39:0/3431855944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc790f5e0 msgr2=0x555bc7924d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc790f5e0 0x555bc7924d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 -- 172.21.15.39:0/3431855944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc7907330 con 0x555bc7902d30 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faed6d9d640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faec801a670 tx=0x7faec801b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e323affaeecab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:13.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faebe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.110+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec801bb70 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7faec801bd10 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec801ae10 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faec8028610 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 10 client.15081 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555bc798dc00 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec801ae10 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7faec802f900 con 0x555bc7902d30 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 10 client.15081 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 10 client.15081 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 20 client.15081 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7992470 0x555bc7991180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:13.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 4 client.15081 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "status"}) -- 0x555bc7878610 con 0x555bc7992470 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.111+0000 7faecffff640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7992470 0x555bc7991180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faecffff640 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7992470 0x555bc7991180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f315d7a5f1ae1377 server_cookie=644738e9eeb79f19 in_seq=0 out_seq=0 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faebe7fc640 10 client.15081 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faebe7fc640 1 -- 172.21.15.39:0/3431855944 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555bc7878610 con 0x555bc7992470 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faebe7fc640 10 client.15081 handle_command_reply: tid=0 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 client.15081 shutdown 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 msgr2=0x555bc792a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faec801a670 tx=0x7faec801b690 comp rx=0 tx=0).stop 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 shutdown_connections 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x555bc7992470 0x555bc7991180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555bc790f5e0 0x555bc7924d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555bc7903650 0x555bc7924820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 --2- 172.21.15.39:0/3431855944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bc7902d30 0x555bc792a310 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 >> 172.21.15.39:0/3431855944 conn(0x555bc7900b60 msgr2=0x555bc790ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faebe7fc640 0 client.15081 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.112+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 shutdown_connections 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedf534740 1 -- 172.21.15.39:0/3431855944 wait complete. 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedf534740 20 client.15081 trim_cache size 0 max 16384 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 4, 2024-09-10T21:54:13.120 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24550, 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 62.010333119999999, 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 98.498599827999996 2024-09-10T21:54:13.121 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 msgr2=0x7faec40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 0x7faec40b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x555bc7905eb0 tx=0x7faec8010040 comp rx=0 tx=0).stop 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 msgr2=0x7faed819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faed0005cc0 tx=0x7faed002f470 comp rx=0 tx=0).stop 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 shutdown_connections 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7faec40b5370 0x7faec40b7830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faed8109150 0x7faed819eab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81087d0 0x7faed8199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 --2- 172.21.15.39:0/335310191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed8102dc0 0x7faed81991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 >> 172.21.15.39:0/335310191 conn(0x7faed80fe830 msgr2=0x7faed8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 shutdown_connections 2024-09-10T21:54:13.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:13.113+0000 7faedd15f640 1 -- 172.21.15.39:0/335310191 wait complete. 2024-09-10T21:54:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:13 smithi070 ceph-mon[34909]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:13 smithi173 ceph-mon[35294]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:13.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T21:54:14.021 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 -- 172.21.15.39:0/3286455334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 msgr2=0x7f6b7010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 --2- 172.21.15.39:0/3286455334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7010f640 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009ca0 tx=0x7f6b6802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 -- 172.21.15.39:0/3286455334 shutdown_connections 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 --2- 172.21.15.39:0/3286455334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7010f640 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 --2- 172.21.15.39:0/3286455334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7010a920 0x7f6b7010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 --2- 172.21.15.39:0/3286455334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b70101810 0x7f6b70101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 -- 172.21.15.39:0/3286455334 >> 172.21.15.39:0/3286455334 conn(0x7f6b70076f50 msgr2=0x7f6b70077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 -- 172.21.15.39:0/3286455334 shutdown_connections 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.477+0000 7f6b7651e640 1 -- 172.21.15.39:0/3286455334 wait complete. 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 Processor -- start 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 -- start start 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b70101810 0x7f6b70199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 0x7f6b70199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70112dd0 con 0x7f6b7010d250 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70112c50 con 0x7f6b70101810 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b7651e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70112f50 con 0x7f6b7010a920 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b74abb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b74abb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42862/0 (socket says 172.21.15.39:42862) 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.478+0000 7f6b74abb640 1 -- 172.21.15.39:0/2653121978 learned_addr learned my addr 172.21.15.39:0/2653121978 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 0x7f6b70199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b70101810 0x7f6b70199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 -- 172.21.15.39:0/2653121978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 msgr2=0x7f6b70199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 0x7f6b70199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 -- 172.21.15.39:0/2653121978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b70101810 msgr2=0x7f6b70199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b70101810 0x7f6b70199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 -- 172.21.15.39:0/2653121978 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7019f2f0 con 0x7f6b7010d250 2024-09-10T21:54:14.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 0x7f6b70199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b74abb640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b68005cc0 tx=0x7f6b6802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6d7fa640 1 -- 172.21.15.39:0/2653121978 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003cf0 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6d7fa640 1 -- 172.21.15.39:0/2653121978 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b680044f0 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7019f580 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b6d7fa640 1 -- 172.21.15.39:0/2653121978 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6802fd10 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.479+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b701a5d20 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 Processor -- start 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6d7fa640 1 -- 172.21.15.39:0/2653121978 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6b68004040 con 0x7f6b7010d250 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 -- start start 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56380ae2bc10 con 0x56380aeb3d30 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380ae1b040 con 0x56380aec49f0 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b788f3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56380ae1ee50 con 0x56380aeb4650 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42868/0 (socket says 172.21.15.39:42868) 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/3407153260 learned_addr learned my addr 172.21.15.39:0/3407153260 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.482+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/3407153260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 msgr2=0x56380aec44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/3407153260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 msgr2=0x56380aec6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/3407153260 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380ab79540 con 0x56380aeb3d30 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:14.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6d7fa640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 0x7f6b580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007f60 tx=0x7f6b64007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f06dbdf5a839a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 0x7f6b580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b6d7fa640 1 -- 172.21.15.39:0/2653121978 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b681074b0 con 0x7f6b7010d250 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b567fc640 1 -- 172.21.15.39:0/3407153260 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6401c070 con 0x56380aeb3d30 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b567fc640 1 -- 172.21.15.39:0/3407153260 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b64010040 con 0x56380aeb3d30 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.483+0000 7f6b567fc640 1 -- 172.21.15.39:0/3407153260 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64014730 con 0x56380aeb3d30 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- 172.21.15.39:0/3407153260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 msgr2=0x56380aeb4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 0x7f6b580b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005fd0 tx=0x7f6b60005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007f60 tx=0x7f6b64007420 comp rx=0 tx=0).stop 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- 172.21.15.39:0/3407153260 shutdown_connections 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3407153260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aeb4110 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- 172.21.15.39:0/3407153260 >> 172.21.15.39:0/3407153260 conn(0x56380aeb1b60 msgr2=0x56380aeb2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- 172.21.15.39:0/3407153260 shutdown_connections 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- 172.21.15.39:0/3407153260 wait complete. 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.484+0000 7f6b788f3740 1 -- start start 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 Processor -- start 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 0x56380aec1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56380ac7c5f0 con 0x56380aec49f0 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380adb6010 con 0x56380aeb3d30 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56380aec76a0 con 0x56380aeb4650 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b788f3740 10 client.0 _ll_register_callbacks cb 0x56380ae15340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42874/0 (socket says 172.21.15.39:42874) 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 -- 172.21.15.39:0/599034499 learned_addr learned my addr 172.21.15.39:0/599034499 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 0x56380aec1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 -- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 msgr2=0x56380aec1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 -- 172.21.15.39:0/599034499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 msgr2=0x56380aec1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 0x56380aec1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b74abb640 1 -- 172.21.15.39:0/599034499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380ade3a00 con 0x56380aec49f0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.485+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 0x56380aec1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b74abb640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b68104ea0 tx=0x7f6b681052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5076a021f67780d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680098d0 con 0x56380aec49f0 2024-09-10T21:54:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b681070d0 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b64010040 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b680e8050 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 10 client.15093 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56380aed3260 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b64010040 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f6b680d21c0 con 0x56380aec49f0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 10 client.15093 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 10 client.15093 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 20 client.15093 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380aed5910 0x56380aed6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 4 client.15093 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.486+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56380ae2db60 con 0x56380aed5910 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.487+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380aed5910 0x56380aed6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.487+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380aed5910 0x56380aed6d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5abe32e78f089118 server_cookie=27a765ac9f6b5556 in_seq=0 out_seq=0 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.487+0000 7f6b4f7fe640 10 client.15093 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/599034499 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56380ae2db60 con 0x56380aed5910 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b4f7fe640 10 client.15093 handle_command_reply: tid=0 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 client.15093 shutdown 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 msgr2=0x56380aec23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b68104ea0 tx=0x7f6b681052f0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 shutdown_connections 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aec49f0 0x56380aec23e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aec1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380aed5910 0x56380aed6d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 --2- 172.21.15.39:0/599034499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aeb3d30 0x56380aec1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 >> 172.21.15.39:0/599034499 conn(0x56380aeb1b60 msgr2=0x56380aeb0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b4f7fe640 0 client.15093 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:14.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 shutdown_connections 2024-09-10T21:54:14.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 1 -- 172.21.15.39:0/599034499 wait complete. 2024-09-10T21:54:14.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.488+0000 7f6b788f3740 20 client.15093 trim_cache size 0 max 16384 2024-09-10T21:54:14.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 Processor -- start 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 -- start start 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb3d30 0x56380aed45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56380aed50c0 con 0x56380aeb4650 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380aed5790 con 0x56380aec49f0 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b788f3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56380aed5e60 con 0x56380aeb3d30 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42888/0 (socket says 172.21.15.39:42888) 2024-09-10T21:54:14.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/143413446 learned_addr learned my addr 172.21.15.39:0/143413446 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:14.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb3d30 0x56380aed45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b74abb640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/143413446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb3d30 msgr2=0x56380aed45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb3d30 0x56380aed45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/143413446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 msgr2=0x56380aec5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b6f7fe640 1 -- 172.21.15.39:0/143413446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380aeb1990 con 0x56380aeb4650 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.507+0000 7f6b74abb640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007fd0 tx=0x7f6b64007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882b75c199d465a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b55ffb640 1 -- 172.21.15.39:0/143413446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6401c030 con 0x56380aeb4650 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b55ffb640 1 -- 172.21.15.39:0/143413446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b64007000 con 0x56380aeb4650 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b55ffb640 1 -- 172.21.15.39:0/143413446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b640066a0 con 0x56380aeb4650 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 -- 172.21.15.39:0/143413446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 msgr2=0x56380aed4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007fd0 tx=0x7f6b64007b10 comp rx=0 tx=0).stop 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 -- 172.21.15.39:0/143413446 shutdown_connections 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aec5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb4650 0x56380aed4af0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.508+0000 7f6b788f3740 1 --2- 172.21.15.39:0/143413446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb3d30 0x56380aed45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- 172.21.15.39:0/143413446 >> 172.21.15.39:0/143413446 conn(0x56380aeb1b60 msgr2=0x56380aec6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- 172.21.15.39:0/143413446 shutdown_connections 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- 172.21.15.39:0/143413446 wait complete. 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- start start 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 Processor -- start 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aebe470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aebe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56380aed6c00 con 0x56380aeb3d30 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.509+0000 7f6b788f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380aed6530 con 0x56380aec49f0 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b788f3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56380aed72d0 con 0x56380aeb4650 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b788f3740 10 client.0 _ll_register_callbacks cb 0x7f6b68003f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42890/0 (socket says 172.21.15.39:42890) 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 -- 172.21.15.39:0/3799635439 learned_addr learned my addr 172.21.15.39:0/3799635439 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 -- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 msgr2=0x56380aebe470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aebe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aebe470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 -- 172.21.15.39:0/3799635439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 msgr2=0x56380aebe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:14.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aebe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 -- 172.21.15.39:0/3799635439 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380aebf1b0 con 0x56380aeb3d30 2024-09-10T21:54:14.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b6ffff640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001e9e0 tx=0x7f6b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fa62bd92e839d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:14.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60010d40 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b6002e420 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b64007000 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b6002e620 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b788f3740 10 client.15099 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.510+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56380af422b0 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b64007000 con 0x56380aeb3d30 2024-09-10T21:54:14.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f6b6001d680 con 0x56380aeb3d30 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 10 client.15099 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 10 client.15099 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 20 client.15099 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380af46fc0 0x56380af45cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 4 client.15099 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "status"}) -- 0x56380ae29610 con 0x56380af46fc0 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.511+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380af46fc0 0x56380af45cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b4f7fe640 10 client.15099 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b6f7fe640 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380af46fc0 0x56380af45cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=96ae2e50300efae0 server_cookie=b232b52df561ad46 in_seq=0 out_seq=0 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b4f7fe640 1 -- 172.21.15.39:0/3799635439 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56380ae29610 con 0x56380af46fc0 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b4f7fe640 10 client.15099 handle_command_reply: tid=0 2024-09-10T21:54:14.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 client.15099 shutdown 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 msgr2=0x56380aedf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001e9e0 tx=0x7f6b600046c0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 shutdown_connections 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56380af46fc0 0x56380af45cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380aec49f0 0x56380aebe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56380aeb4650 0x56380aebe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b4f7fe640 0 client.15099 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 --2- 172.21.15.39:0/3799635439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56380aeb3d30 0x56380aedf7e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 >> 172.21.15.39:0/3799635439 conn(0x56380aeb1b60 msgr2=0x56380aed45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 shutdown_connections 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 1 -- 172.21.15.39:0/3799635439 wait complete. 2024-09-10T21:54:14.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.512+0000 7f6b788f3740 20 client.15099 trim_cache size 0 max 16384 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 3, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24562, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 64.423449313999996, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 97.363446800000006 2024-09-10T21:54:14.519 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:14.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 msgr2=0x7f6b580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 0x7f6b580b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005fd0 tx=0x7f6b60005f00 comp rx=0 tx=0).stop 2024-09-10T21:54:14.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 msgr2=0x7f6b7019eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:14.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b68005cc0 tx=0x7f6b6802f470 comp rx=0 tx=0).stop 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 shutdown_connections 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b580b5370 0x7f6b580b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b7010d250 0x7f6b7019eb20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b7010a920 0x7f6b70199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 --2- 172.21.15.39:0/2653121978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b70101810 0x7f6b70199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 >> 172.21.15.39:0/2653121978 conn(0x7f6b70076f50 msgr2=0x7f6b701005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 shutdown_connections 2024-09-10T21:54:14.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:14.513+0000 7f6b7651e640 1 -- 172.21.15.39:0/2653121978 wait complete. 2024-09-10T21:54:15.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:15 smithi039 ceph-mon[30872]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:15.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T21:54:15.368 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:15.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:15 smithi070 ceph-mon[34909]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:15 smithi173 ceph-mon[35294]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.860+0000 7fe6109c7640 1 -- 172.21.15.39:0/1348932654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c108020 msgr2=0x7fe60c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.860+0000 7fe6109c7640 1 --2- 172.21.15.39:0/1348932654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c108020 0x7fe60c10e820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe604009ca0 tx=0x7fe60402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 -- 172.21.15.39:0/1348932654 shutdown_connections 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 --2- 172.21.15.39:0/1348932654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c108020 0x7fe60c10e820 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 --2- 172.21.15.39:0/1348932654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c1076a0 0x7fe60c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 --2- 172.21.15.39:0/1348932654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c101c90 0x7fe60c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 -- 172.21.15.39:0/1348932654 >> 172.21.15.39:0/1348932654 conn(0x7fe60c0fd700 msgr2=0x7fe60c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 -- 172.21.15.39:0/1348932654 shutdown_connections 2024-09-10T21:54:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 -- 172.21.15.39:0/1348932654 wait complete. 2024-09-10T21:54:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.861+0000 7fe6109c7640 1 Processor -- start 2024-09-10T21:54:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 -- start start 2024-09-10T21:54:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c1076a0 0x7fe60c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 0x7fe60c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c112de0 con 0x7fe60c101c90 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c112c60 con 0x7fe60c1076a0 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe6109c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c112f60 con 0x7fe60c108020 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42908/0 (socket says 172.21.15.39:42908) 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 -- 172.21.15.39:0/4057597243 learned_addr learned my addr 172.21.15.39:0/4057597243 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe601d9b640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c1076a0 0x7fe60c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 0x7fe60c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 -- 172.21.15.39:0/4057597243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 msgr2=0x7fe60c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 0x7fe60c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 -- 172.21.15.39:0/4057597243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c1076a0 msgr2=0x7fe60c10f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c1076a0 0x7fe60c10f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.862+0000 7fe60a59c640 1 -- 172.21.15.39:0/4057597243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c1a7670 con 0x7fe60c101c90 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 0x7fe60c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe60a59c640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00d950 tx=0x7fe5fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe603fff640 1 -- 172.21.15.39:0/4057597243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc017070 con 0x7fe60c101c90 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c1a7960 con 0x7fe60c101c90 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1a7ef0 con 0x7fe60c101c90 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe603fff640 1 -- 172.21.15.39:0/4057597243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5fc009c30 con 0x7fe60c101c90 2024-09-10T21:54:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.863+0000 7fe603fff640 1 -- 172.21.15.39:0/4057597243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00f620 con 0x7fe60c101c90 2024-09-10T21:54:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 Processor -- start 2024-09-10T21:54:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 -- start start 2024-09-10T21:54:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe603fff640 1 -- 172.21.15.39:0/4057597243 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe5fc00f7c0 con 0x7fe60c101c90 2024-09-10T21:54:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f8264110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f82700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f9f81dbc10 con 0x55f9f82705e0 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9f81cb040 con 0x55f9f8264650 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe612d9c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9f81cee50 con 0x55f9f8263d30 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42924/0 (socket says 172.21.15.39:42924) 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.866+0000 7fe601d9b640 1 -- 172.21.15.39:0/1904714570 learned_addr learned my addr 172.21.15.39:0/1904714570 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f8264110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe60a59c640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f82700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 -- 172.21.15.39:0/1904714570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 msgr2=0x55f9f8264110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f8264110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 -- 172.21.15.39:0/1904714570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 msgr2=0x55f9f82700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f82700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 -- 172.21.15.39:0/1904714570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f7f29540 con 0x55f9f82705e0 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f8264110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe60a59c640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f82700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe601d9b640 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400dcb0 tx=0x7fe5f400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdecc04aacd918c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe603fff640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 0x7fe5f80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe600d99640 1 -- 172.21.15.39:0/1904714570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4015070 con 0x55f9f82705e0 2024-09-10T21:54:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe600d99640 1 -- 172.21.15.39:0/1904714570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f401a910 con 0x55f9f82705e0 2024-09-10T21:54:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 0x7fe5f80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe600d99640 1 -- 172.21.15.39:0/1904714570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40119c0 con 0x55f9f82705e0 2024-09-10T21:54:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.867+0000 7fe603fff640 1 -- 172.21.15.39:0/4057597243 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe5fc0e58f0 con 0x7fe60c101c90 2024-09-10T21:54:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 0x7fe5f80b78b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe60402f500 tx=0x7fe60402f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- 172.21.15.39:0/1904714570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 msgr2=0x55f9f82729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400dcb0 tx=0x7fe5f400f730 comp rx=0 tx=0).stop 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- 172.21.15.39:0/1904714570 shutdown_connections 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f82729d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f82700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 --2- 172.21.15.39:0/1904714570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f8264110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- 172.21.15.39:0/1904714570 >> 172.21.15.39:0/1904714570 conn(0x55f9f8261b60 msgr2=0x55f9f8262d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- 172.21.15.39:0/1904714570 shutdown_connections 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- 172.21.15.39:0/1904714570 wait complete. 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.868+0000 7fe612d9c740 1 -- start start 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 Processor -- start 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f826da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f9f802c5f0 con 0x55f9f82705e0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8166010 con 0x55f9f8264650 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9f82732e0 con 0x55f9f8263d30 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe612d9c740 10 client.0 _ll_register_callbacks cb 0x55f9f81c5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f826da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42932/0 (socket says 172.21.15.39:42932) 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 -- 172.21.15.39:0/2239322135 learned_addr learned my addr 172.21.15.39:0/2239322135 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60a59c640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 -- 172.21.15.39:0/2239322135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 msgr2=0x55f9f826d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 -- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 msgr2=0x55f9f826da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f826da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.869+0000 7fe60ad9d640 1 -- 172.21.15.39:0/2239322135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f8193a00 con 0x55f9f82705e0 2024-09-10T21:54:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe60ad9d640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6040316d0 tx=0x7fe6040095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f3f2d10fc5dafa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60404e070 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe604004540 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f401a910 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe604031910 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe612d9c740 10 client.15111 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f9f827ee80 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f401a910 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe604043040 con 0x55f9f82705e0 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.870+0000 7fe612d9c740 10 client.15111 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe612d9c740 10 client.15111 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe612d9c740 20 client.15111 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82815f0 0x55f9f8282a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe612d9c740 4 client.15111 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9f81ddb60 con 0x55f9f82815f0 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe60a59c640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82815f0 0x55f9f8282a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe60a59c640 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82815f0 0x55f9f8282a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=15f3e3a325fc8e49 server_cookie=ad52ce17f96899ea in_seq=0 out_seq=0 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.871+0000 7fe5f1ffb640 10 client.15111 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/2239322135 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9f81ddb60 con 0x55f9f82815f0 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe5f1ffb640 10 client.15111 handle_command_reply: tid=0 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 client.15111 shutdown 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 msgr2=0x55f9f826df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6040316d0 tx=0x7fe6040095c0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 shutdown_connections 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82815f0 0x55f9f8282a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f82705e0 0x55f9f826df80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f8264650 0x55f9f826da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2239322135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 >> 172.21.15.39:0/2239322135 conn(0x55f9f8261b60 msgr2=0x55f9f8267700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe5f1ffb640 0 client.15111 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 shutdown_connections 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.872+0000 7fe612d9c740 1 -- 172.21.15.39:0/2239322135 wait complete. 2024-09-10T21:54:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.873+0000 7fe612d9c740 20 client.15111 trim_cache size 0 max 16384 2024-09-10T21:54:15.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 Processor -- start 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 -- start start 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f82801d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8280da0 con 0x55f9f8264650 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8281470 con 0x55f9f82705e0 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe612d9c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8281b40 con 0x55f9f8263d30 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42946/0 (socket says 172.21.15.39:42946) 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 -- 172.21.15.39:0/2203119448 learned_addr learned my addr 172.21.15.39:0/2203119448 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 -- 172.21.15.39:0/2203119448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 msgr2=0x55f9f826c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 -- 172.21.15.39:0/2203119448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 msgr2=0x55f9f82801d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f82801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.891+0000 7fe601d9b640 1 -- 172.21.15.39:0/2203119448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f82625e0 con 0x55f9f8264650 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe601d9b640 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55f9f8263ce0 tx=0x7fe5f4005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89db9fb73c735f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe5f3fff640 1 -- 172.21.15.39:0/2203119448 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4029070 con 0x55f9f8264650 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe5f3fff640 1 -- 172.21.15.39:0/2203119448 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f40054f0 con 0x55f9f8264650 2024-09-10T21:54:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe5f3fff640 1 -- 172.21.15.39:0/2203119448 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4015040 con 0x55f9f8264650 2024-09-10T21:54:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 -- 172.21.15.39:0/2203119448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 msgr2=0x55f9f826e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55f9f8263ce0 tx=0x7fe5f4005a70 comp rx=0 tx=0).stop 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 -- 172.21.15.39:0/2203119448 shutdown_connections 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f82801d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8264650 0x55f9f826e2c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 --2- 172.21.15.39:0/2203119448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8263d30 0x55f9f826c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 -- 172.21.15.39:0/2203119448 >> 172.21.15.39:0/2203119448 conn(0x55f9f8261b60 msgr2=0x55f9f82687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 -- 172.21.15.39:0/2203119448 shutdown_connections 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.892+0000 7fe612d9c740 1 -- 172.21.15.39:0/2203119448 wait complete. 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 -- start start 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 Processor -- start 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8264650 0x55f9f8285ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f828aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f9f82828e0 con 0x55f9f8263d30 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8282210 con 0x55f9f82705e0 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9f8282fb0 con 0x55f9f8264650 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe612d9c740 10 client.0 _ll_register_callbacks cb 0x7fe604009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe60a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe60a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42958/0 (socket says 172.21.15.39:42958) 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe60a59c640 1 -- 172.21.15.39:0/157556125 learned_addr learned my addr 172.21.15.39:0/157556125 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe60a59c640 1 -- 172.21.15.39:0/157556125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8264650 msgr2=0x55f9f8285ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.893+0000 7fe601d9b640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8264650 0x55f9f8285ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe60a59c640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8264650 0x55f9f8285ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe60a59c640 1 -- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 msgr2=0x55f9f828aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe60a59c640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f828aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe60a59c640 1 -- 172.21.15.39:0/157556125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f828b230 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe60a59c640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0a91d0 tx=0x7fe5fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1306997b6072e55e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc020040 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe5fc0ab3c0 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f40054f0 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe5fc0ab6d0 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe612d9c740 10 client.15117 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f9f82ee970 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f40054f0 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe5fc0aac30 con 0x55f9f8263d30 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.894+0000 7fe612d9c740 10 client.15117 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 20 client.15117 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82f35e0 0x55f9f82f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 4 client.15117 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "status"}) -- 0x55f9f81d9610 con 0x55f9f82f35e0 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe601d9b640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82f35e0 0x55f9f82f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe5f1ffb640 10 client.15117 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe601d9b640 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82f35e0 0x55f9f82f22f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad266df437626354 server_cookie=66a656beca7a401a in_seq=0 out_seq=0 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe5f1ffb640 1 -- 172.21.15.39:0/157556125 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f9f81d9610 con 0x55f9f82f35e0 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe5f1ffb640 10 client.15117 handle_command_reply: tid=0 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.895+0000 7fe612d9c740 1 client.15117 shutdown 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 msgr2=0x55f9f8285540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0a91d0 tx=0x7fe5fc000bc0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 shutdown_connections 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55f9f82f35e0 0x55f9f82f22f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9f82705e0 0x55f9f828aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9f8264650 0x55f9f8285ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe5f1ffb640 0 client.15117 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 --2- 172.21.15.39:0/157556125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f9f8263d30 0x55f9f8285540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 >> 172.21.15.39:0/157556125 conn(0x55f9f8261b60 msgr2=0x55f9f82801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 shutdown_connections 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 1 -- 172.21.15.39:0/157556125 wait complete. 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe612d9c740 20 client.15117 trim_cache size 0 max 16384 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:15.902 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24563, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 66.820918934999995, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 96.179810496000002 2024-09-10T21:54:15.903 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:15.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 msgr2=0x7fe5f80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 0x7fe5f80b78b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe60402f500 tx=0x7fe60402f310 comp rx=0 tx=0).stop 2024-09-10T21:54:15.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 msgr2=0x7fe60c10f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:15.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00d950 tx=0x7fe5fc00de10 comp rx=0 tx=0).stop 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 shutdown_connections 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe5f80b53f0 0x7fe5f80b78b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe60c108020 0x7fe60c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe60c1076a0 0x7fe60c10f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 --2- 172.21.15.39:0/4057597243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe60c101c90 0x7fe60c10f180 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.896+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 >> 172.21.15.39:0/4057597243 conn(0x7fe60c0fd700 msgr2=0x7fe60c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.897+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 shutdown_connections 2024-09-10T21:54:15.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:15.897+0000 7fe6109c7640 1 -- 172.21.15.39:0/4057597243 wait complete. 2024-09-10T21:54:16.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T21:54:16.867 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:17.239 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:17 smithi039 ceph-mon[30872]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- 172.21.15.39:0/1640422626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec101cd0 msgr2=0x7f43ec1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 --2- 172.21.15.39:0/1640422626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec101cd0 0x7f43ec1020b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- 172.21.15.39:0/1640422626 shutdown_connections 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 --2- 172.21.15.39:0/1640422626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec108060 0x7f43ec10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 --2- 172.21.15.39:0/1640422626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 --2- 172.21.15.39:0/1640422626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec101cd0 0x7f43ec1020b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- 172.21.15.39:0/1640422626 >> 172.21.15.39:0/1640422626 conn(0x7f43ec0fd720 msgr2=0x7f43ec0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- 172.21.15.39:0/1640422626 shutdown_connections 2024-09-10T21:54:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- 172.21.15.39:0/1640422626 wait complete. 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 Processor -- start 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.319+0000 7f43f270f640 1 -- start start 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec101cd0 0x7f43ec199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112e40 con 0x7f43ec108060 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112cc0 con 0x7f43ec101cd0 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f270f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112fc0 con 0x7f43ec1076e0 2024-09-10T21:54:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42980/0 (socket says 172.21.15.39:42980) 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 -- 172.21.15.39:0/641451810 learned_addr learned my addr 172.21.15.39:0/641451810 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43ebfff640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec101cd0 0x7f43ec199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 -- 172.21.15.39:0/641451810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 msgr2=0x7f43ec199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 -- 172.21.15.39:0/641451810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec101cd0 msgr2=0x7f43ec199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec101cd0 0x7f43ec199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43f0cac640 1 -- 172.21.15.39:0/641451810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec19f3c0 con 0x7f43ec108060 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.320+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43f0cac640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b970 tx=0x7f43e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43e97fa640 1 -- 172.21.15.39:0/641451810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4019070 con 0x7f43ec108060 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43e97fa640 1 -- 172.21.15.39:0/641451810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e4014440 con 0x7f43ec108060 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec19f6b0 con 0x7f43ec108060 2024-09-10T21:54:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43e97fa640 1 -- 172.21.15.39:0/641451810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40075d0 con 0x7f43ec108060 2024-09-10T21:54:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.321+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1a5df0 con 0x7f43ec108060 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.323+0000 7f43f4ae4740 1 Processor -- start 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.323+0000 7f43e97fa640 1 -- 172.21.15.39:0/641451810 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f43e400cb40 con 0x7f43ec108060 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.323+0000 7f43f4ae4740 1 -- start start 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271368080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f2712c8c10 con 0x55f271350d30 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f2712b8040 con 0x55f271365c90 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f2712bbe50 con 0x55f27135b090 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42994/0 (socket says 172.21.15.39:42994) 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 -- 172.21.15.39:0/2272639483 learned_addr learned my addr 172.21.15.39:0/2272639483 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43ebfff640 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271368080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 -- 172.21.15.39:0/2272639483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27135b090 msgr2=0x55f271351650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 -- 172.21.15.39:0/2272639483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 msgr2=0x55f271368080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271368080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 -- 172.21.15.39:0/2272639483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f271016540 con 0x55f271350d30 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43e0005d00 tx=0x7f43e000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24be5880864fffa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43e97fa640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 0x7f43d40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43d27fc640 1 -- 172.21.15.39:0/2272639483 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0004030 con 0x55f271350d30 2024-09-10T21:54:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.324+0000 7f43ebfff640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 0x7f43d40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43e97fa640 1 -- 172.21.15.39:0/641451810 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f43e40e5510 con 0x7f43ec108060 2024-09-10T21:54:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43d27fc640 1 -- 172.21.15.39:0/2272639483 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e000ed00 con 0x55f271350d30 2024-09-10T21:54:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43d27fc640 1 -- 172.21.15.39:0/2272639483 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0005440 con 0x55f271350d30 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43ebfff640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 0x7f43d40b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43dc031440 tx=0x7f43dc005e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 -- 172.21.15.39:0/2272639483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 msgr2=0x55f271351110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43e0005d00 tx=0x7f43e000bc10 comp rx=0 tx=0).stop 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 -- 172.21.15.39:0/2272639483 shutdown_connections 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271368080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/2272639483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 -- 172.21.15.39:0/2272639483 >> 172.21.15.39:0/2272639483 conn(0x55f27134eb60 msgr2=0x55f27134fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 -- 172.21.15.39:0/2272639483 shutdown_connections 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.325+0000 7f43f4ae4740 1 -- 172.21.15.39:0/2272639483 wait complete. 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 -- start start 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 Processor -- start 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f271358b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f2711195f0 con 0x55f271350d30 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f271253010 con 0x55f27135b090 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f271368a80 con 0x55f271365c90 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.326+0000 7f43f4ae4740 10 client.0 _ll_register_callbacks cb 0x55f2712b2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42998/0 (socket says 172.21.15.39:42998) 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 -- 172.21.15.39:0/3362860446 learned_addr learned my addr 172.21.15.39:0/3362860446 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43f0cac640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f271358b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 -- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 msgr2=0x55f271358b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f271358b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 -- 172.21.15.39:0/3362860446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 msgr2=0x55f2713585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 -- 172.21.15.39:0/3362860446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f271280a00 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43f0cac640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f271358b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43ebfff640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950362facea371f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc04d070 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f43dc005030 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43e000ed00 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f43dc059050 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.327+0000 7f43f4ae4740 10 client.15129 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f271374660 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e000ed00 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f43dc0035f0 con 0x55f271350d30 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 10 client.15129 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 20 client.15129 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f271376ca0 0x55f271378110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 4 client.15129 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2712cab60 con 0x55f271376ca0 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.328+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f271376ca0 0x55f271378110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.329+0000 7f43cb7fe640 10 client.15129 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.329+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f271376ca0 0x55f271378110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=792603e3f8fc906b server_cookie=f4fd32b562275666 in_seq=0 out_seq=0 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43cb7fe640 1 -- 172.21.15.39:0/3362860446 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2712cab60 con 0x55f271376ca0 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43cb7fe640 10 client.15129 handle_command_reply: tid=0 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 client.15129 shutdown 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 msgr2=0x55f271358080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc009260 comp rx=0 tx=0).stop 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 shutdown_connections 2024-09-10T21:54:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f271376ca0 0x55f271378110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f271358b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43cb7fe640 0 client.15129 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/3362860446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271358080 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 >> 172.21.15.39:0/3362860446 conn(0x55f27134eb60 msgr2=0x55f271353e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 shutdown_connections 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 1 -- 172.21.15.39:0/3362860446 wait complete. 2024-09-10T21:54:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.330+0000 7f43f4ae4740 20 client.15129 trim_cache size 0 max 16384 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.348+0000 7f43f4ae4740 1 Processor -- start 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.348+0000 7f43f4ae4740 1 -- start start 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271356900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f271376450 con 0x55f27135b090 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f271376b20 con 0x55f271365c90 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f2713771f0 con 0x55f271350d30 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43014/0 (socket says 172.21.15.39:43014) 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 -- 172.21.15.39:0/1662886459 learned_addr learned my addr 172.21.15.39:0/1662886459 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f0cac640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271356900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43ebfff640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 -- 172.21.15.39:0/1662886459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271350d30 msgr2=0x55f271351110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 -- 172.21.15.39:0/1662886459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 msgr2=0x55f271356900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271356900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 -- 172.21.15.39:0/1662886459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27134e980 con 0x55f27135b090 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43f0cac640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271356900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43e00045c0 tx=0x7f43e00050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf322c16914d59f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43d1ffb640 1 -- 172.21.15.39:0/1662886459 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e002e070 con 0x55f27135b090 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43d1ffb640 1 -- 172.21.15.39:0/1662886459 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e0005600 con 0x55f27135b090 2024-09-10T21:54:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.349+0000 7f43d1ffb640 1 -- 172.21.15.39:0/1662886459 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ee10 con 0x55f27135b090 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1662886459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 msgr2=0x55f271351650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43e00045c0 tx=0x7f43e00050e0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1662886459 shutdown_connections 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f271365c90 0x55f271356900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f27135b090 0x55f271351650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1662886459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271350d30 0x55f271351110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1662886459 >> 172.21.15.39:0/1662886459 conn(0x55f27134eb60 msgr2=0x55f271375ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1662886459 shutdown_connections 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1662886459 wait complete. 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.350+0000 7f43f4ae4740 1 -- start start 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 Processor -- start 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f27137b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f271377f90 con 0x55f271350d30 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f2713778c0 con 0x55f27135b090 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f271378660 con 0x55f271365c90 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f4ae4740 10 client.0 _ll_register_callbacks cb 0x7f43dc032d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43020/0 (socket says 172.21.15.39:43020) 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 -- 172.21.15.39:0/1773821340 learned_addr learned my addr 172.21.15.39:0/1773821340 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f0cac640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f27137b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 -- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 msgr2=0x55f27137b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f27137b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 -- 172.21.15.39:0/1773821340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 msgr2=0x55f2713808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713808b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43ebfff640 1 -- 172.21.15.39:0/1773821340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27137b860 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.351+0000 7f43f0cac640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f27137b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43ebfff640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43dc006010 tx=0x7f43dc005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4e7d368cc5d53d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc061070 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f43dc003e00 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43e0005600 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f43dc04d050 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 10 client.15135 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f2713e3ca0 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e0005600 con 0x55f271350d30 2024-09-10T21:54:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f43dc004b00 con 0x55f271350d30 2024-09-10T21:54:17.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:17.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 10 client.15135 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 20 client.15135 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f2713e88d0 0x55f2713e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.352+0000 7f43f4ae4740 4 client.15135 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "status"}) -- 0x55f2713762a0 con 0x55f2713e88d0 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f2713e88d0 0x55f2713e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43eb7fe640 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f2713e88d0 0x55f2713e75e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24c18c58aac48415 server_cookie=92f4096e5b60a7b9 in_seq=0 out_seq=0 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43cb7fe640 10 client.15135 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43cb7fe640 1 -- 172.21.15.39:0/1773821340 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f2713762a0 con 0x55f2713e88d0 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43cb7fe640 10 client.15135 handle_command_reply: tid=0 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.353+0000 7f43f4ae4740 1 client.15135 shutdown 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 msgr2=0x55f271380370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43dc006010 tx=0x7f43dc005920 comp rx=0 tx=0).stop 2024-09-10T21:54:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 shutdown_connections 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55f2713e88d0 0x55f2713e75e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f271365c90 0x55f27137b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f27135b090 0x55f2713808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43cb7fe640 0 client.15135 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 --2- 172.21.15.39:0/1773821340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f271350d30 0x55f271380370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 >> 172.21.15.39:0/1773821340 conn(0x55f27134eb60 msgr2=0x55f2713667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 shutdown_connections 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 1 -- 172.21.15.39:0/1773821340 wait complete. 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.354+0000 7f43f4ae4740 20 client.15135 trim_cache size 0 max 16384 2024-09-10T21:54:17.361 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24583, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 69.284573709, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 95.065115177999999 2024-09-10T21:54:17.362 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 msgr2=0x7f43d40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 0x7f43d40b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43dc031440 tx=0x7f43dc005e60 comp rx=0 tx=0).stop 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 msgr2=0x7f43ec19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b970 tx=0x7f43e400be30 comp rx=0 tx=0).stop 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 shutdown_connections 2024-09-10T21:54:17.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43d40b5370 0x7f43d40b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43ec108060 0x7f43ec19ebf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43ec1076e0 0x7f43ec199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 --2- 172.21.15.39:0/641451810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43ec101cd0 0x7f43ec199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 >> 172.21.15.39:0/641451810 conn(0x7f43ec0fd720 msgr2=0x7f43ec0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 shutdown_connections 2024-09-10T21:54:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:17.355+0000 7f43f270f640 1 -- 172.21.15.39:0/641451810 wait complete. 2024-09-10T21:54:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:17 smithi070 ceph-mon[34909]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:17 smithi173 ceph-mon[35294]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:17.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T21:54:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:18.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 -- 172.21.15.39:0/714835703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6641087d0 msgr2=0x7ff664108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 --2- 172.21.15.39:0/714835703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6641087d0 0x7ff664108c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff660009900 tx=0x7ff66002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 -- 172.21.15.39:0/714835703 shutdown_connections 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 --2- 172.21.15.39:0/714835703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664109150 0x7ff66410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 --2- 172.21.15.39:0/714835703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6641087d0 0x7ff664108c10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 --2- 172.21.15.39:0/714835703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 0x7ff6641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.692+0000 7ff66be4a640 1 -- 172.21.15.39:0/714835703 >> 172.21.15.39:0/714835703 conn(0x7ff6640fe830 msgr2=0x7ff664100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.693+0000 7ff66be4a640 1 -- 172.21.15.39:0/714835703 shutdown_connections 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.693+0000 7ff66be4a640 1 -- 172.21.15.39:0/714835703 wait complete. 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.693+0000 7ff66be4a640 1 Processor -- start 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.693+0000 7ff66be4a640 1 -- start start 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 0x7ff664199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6641087d0 0x7ff664199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112da0 con 0x7ff664109150 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112c20 con 0x7ff664102dc0 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112f20 con 0x7ff6641087d0 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff669be6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 0x7ff664199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43044/0 (socket says 172.21.15.39:43044) 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 -- 172.21.15.39:0/2369433762 learned_addr learned my addr 172.21.15.39:0/2369433762 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff6693e5640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6641087d0 0x7ff664199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 -- 172.21.15.39:0/2369433762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6641087d0 msgr2=0x7ff664199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6641087d0 0x7ff664199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 -- 172.21.15.39:0/2369433762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 msgr2=0x7ff664199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 0x7ff664199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 -- 172.21.15.39:0/2369433762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66419f2e0 con 0x7ff664109150 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009fd0 tx=0x7ff65c00def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff656ffd640 1 -- 172.21.15.39:0/2369433762 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c017070 con 0x7ff664109150 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff656ffd640 1 -- 172.21.15.39:0/2369433762 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff65c003e20 con 0x7ff664109150 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.694+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66419f5d0 con 0x7ff664109150 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.695+0000 7ff656ffd640 1 -- 172.21.15.39:0/2369433762 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c010460 con 0x7ff664109150 2024-09-10T21:54:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.695+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff664075380 con 0x7ff664109150 2024-09-10T21:54:18.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.697+0000 7ff66e21f740 1 Processor -- start 2024-09-10T21:54:18.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.697+0000 7ff656ffd640 1 -- 172.21.15.39:0/2369433762 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff65c003970 con 0x7ff664109150 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.697+0000 7ff66e21f740 1 -- start start 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f2f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d9f261c10 con 0x560d9f2e9d30 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9f251040 con 0x560d9f2f65e0 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff66e21f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d9f254e50 con 0x560d9f2ea650 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43060/0 (socket says 172.21.15.39:43060) 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 -- 172.21.15.39:0/1841105376 learned_addr learned my addr 172.21.15.39:0/1841105376 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff669be6640 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f2f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 -- 172.21.15.39:0/1841105376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 msgr2=0x560d9f2f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f2f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 -- 172.21.15.39:0/1841105376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 msgr2=0x560d9f2f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 -- 172.21.15.39:0/1841105376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9efaf540 con 0x560d9f2e9d30 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff656ffd640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 0x7ff6500b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff669be6640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 0x7ff6500b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff6693e5640 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff660009900 tx=0x7ff660005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e97734197c3e12d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.698+0000 7ff656ffd640 1 -- 172.21.15.39:0/2369433762 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff65c0e5a10 con 0x7ff664109150 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff64ffff640 1 -- 172.21.15.39:0/1841105376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660035040 con 0x560d9f2e9d30 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff64ffff640 1 -- 172.21.15.39:0/1841105376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff660045070 con 0x560d9f2e9d30 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff64ffff640 1 -- 172.21.15.39:0/1841105376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660004750 con 0x560d9f2e9d30 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 -- 172.21.15.39:0/1841105376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 msgr2=0x560d9f2ea110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff669be6640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 0x7ff6500b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x560d9f2eceb0 tx=0x7ff65800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff660009900 tx=0x7ff660005e60 comp rx=0 tx=0).stop 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 -- 172.21.15.39:0/1841105376 shutdown_connections 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f2f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 --2- 172.21.15.39:0/1841105376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2e9d30 0x560d9f2ea110 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.699+0000 7ff66e21f740 1 -- 172.21.15.39:0/1841105376 >> 172.21.15.39:0/1841105376 conn(0x560d9f2e7b60 msgr2=0x560d9f2e8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- 172.21.15.39:0/1841105376 shutdown_connections 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- 172.21.15.39:0/1841105376 wait complete. 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- start start 2024-09-10T21:54:18.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 Processor -- start 2024-09-10T21:54:18.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 0x560d9f2f3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d9f0b25f0 con 0x560d9f2ea650 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9f1ec010 con 0x560d9f2f65e0 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d9f2f9230 con 0x560d9f2e9d30 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.700+0000 7ff66e21f740 10 client.0 _ll_register_callbacks cb 0x560d9f24b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43076/0 (socket says 172.21.15.39:43076) 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 -- 172.21.15.39:0/2730384960 learned_addr learned my addr 172.21.15.39:0/2730384960 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff669be6640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 0x560d9f2f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 -- 172.21.15.39:0/2730384960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 msgr2=0x560d9f2f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 0x560d9f2f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 -- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 msgr2=0x560d9f2f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 -- 172.21.15.39:0/2730384960 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9f219a00 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff669be6640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 0x560d9f2f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff6693e5640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff660005940 tx=0x7ff660005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcd4b3136d385fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff64d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660035070 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff660004250 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.701+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff660045070 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff660004450 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 10 client.15147 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560d9f304e40 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff660045070 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7ff6600495c0 con 0x560d9f2ea650 2024-09-10T21:54:18.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 10 client.15147 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 20 client.15147 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f306f60 0x560d9f3083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 4 client.15147 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d9f263b60 con 0x560d9f306f60 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.702+0000 7ff669be6640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f306f60 0x560d9f3083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.703+0000 7ff64d7fa640 10 client.15147 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.703+0000 7ff669be6640 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f306f60 0x560d9f3083d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde0a03a14efb47e server_cookie=31bd4276b9b8d1b8 in_seq=0 out_seq=0 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff64d7fa640 1 -- 172.21.15.39:0/2730384960 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d9f263b60 con 0x560d9f306f60 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff64d7fa640 10 client.15147 handle_command_reply: tid=0 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 client.15147 shutdown 2024-09-10T21:54:18.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 msgr2=0x560d9f2f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff660005940 tx=0x7ff660005390 comp rx=0 tx=0).stop 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 shutdown_connections 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f306f60 0x560d9f3083d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2f65e0 0x560d9f2f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f3b40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff64d7fa640 0 client.15147 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 --2- 172.21.15.39:0/2730384960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2e9d30 0x560d9f2f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 >> 172.21.15.39:0/2730384960 conn(0x560d9f2e7b60 msgr2=0x560d9f2ed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 shutdown_connections 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 1 -- 172.21.15.39:0/2730384960 wait complete. 2024-09-10T21:54:18.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.704+0000 7ff66e21f740 20 client.15147 trim_cache size 0 max 16384 2024-09-10T21:54:18.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 Processor -- start 2024-09-10T21:54:18.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 -- start start 2024-09-10T21:54:18.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f2edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2f65e0 0x560d9f2f0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d9f306710 con 0x560d9f2ea650 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9f306de0 con 0x560d9f2e9d30 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff66e21f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d9f3074b0 con 0x560d9f2f65e0 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43084/0 (socket says 172.21.15.39:43084) 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 -- 172.21.15.39:0/30779331 learned_addr learned my addr 172.21.15.39:0/30779331 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff669be6640 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f2edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 -- 172.21.15.39:0/30779331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2f65e0 msgr2=0x560d9f2f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2f65e0 0x560d9f2f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 -- 172.21.15.39:0/30779331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 msgr2=0x560d9f2edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f2edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 -- 172.21.15.39:0/30779331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9f2e7990 con 0x560d9f2ea650 2024-09-10T21:54:18.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.723+0000 7ff6693e5640 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff660000c00 tx=0x7ff660032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c499071127e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff64f7fe640 1 -- 172.21.15.39:0/30779331 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660058070 con 0x560d9f2ea650 2024-09-10T21:54:18.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff64f7fe640 1 -- 172.21.15.39:0/30779331 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff660045070 con 0x560d9f2ea650 2024-09-10T21:54:18.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff64f7fe640 1 -- 172.21.15.39:0/30779331 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660035040 con 0x560d9f2ea650 2024-09-10T21:54:18.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 -- 172.21.15.39:0/30779331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 msgr2=0x560d9f2f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff660000c00 tx=0x7ff660032f00 comp rx=0 tx=0).stop 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 -- 172.21.15.39:0/30779331 shutdown_connections 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2f65e0 0x560d9f2f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2ea650 0x560d9f2f5340 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 --2- 172.21.15.39:0/30779331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f2edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 -- 172.21.15.39:0/30779331 >> 172.21.15.39:0/30779331 conn(0x560d9f2e7b60 msgr2=0x560d9f2f4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 -- 172.21.15.39:0/30779331 shutdown_connections 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.724+0000 7ff66e21f740 1 -- 172.21.15.39:0/30779331 wait complete. 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 -- start start 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 Processor -- start 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f310b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f311090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d9f308250 con 0x560d9f2f65e0 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9f307b80 con 0x560d9f2e9d30 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d9f308920 con 0x560d9f2ea650 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66e21f740 10 client.0 _ll_register_callbacks cb 0x7ff65800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43088/0 (socket says 172.21.15.39:43088) 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 -- 172.21.15.39:0/885205080 learned_addr learned my addr 172.21.15.39:0/885205080 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff6693e5640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f311090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff669be6640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f310b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 -- 172.21.15.39:0/885205080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 msgr2=0x560d9f311090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f311090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 -- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 msgr2=0x560d9f310b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f310b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.725+0000 7ff66a3e7640 1 -- 172.21.15.39:0/885205080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9f2e85e0 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff669be6640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f310b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66a3e7640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0ac010 tx=0x7ff65c0abf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6963eae418164641 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c020040 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff65c0ab2e0 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff660045070 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff65c0abb90 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 10 client.15153 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560d9f374400 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff660045070 con 0x560d9f2f65e0 2024-09-10T21:54:18.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7ff65c0971a0 con 0x560d9f2f65e0 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 10 client.15153 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 20 client.15153 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f379020 0x560d9f377d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 4 client.15153 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.726+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "status"}) -- 0x560d9f25f610 con 0x560d9f379020 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff669be6640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f379020 0x560d9f377d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff669be6640 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f379020 0x560d9f377d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=441ddac4f795586a server_cookie=3b7349502dd8230d in_seq=0 out_seq=0 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff64d7fa640 10 client.15153 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff64d7fa640 1 -- 172.21.15.39:0/885205080 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560d9f25f610 con 0x560d9f379020 2024-09-10T21:54:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff64d7fa640 10 client.15153 handle_command_reply: tid=0 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.727+0000 7ff66e21f740 1 client.15153 shutdown 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 msgr2=0x560d9f30b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0ac010 tx=0x7ff65c0abf20 comp rx=0 tx=0).stop 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 shutdown_connections 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d9f379020 0x560d9f377d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d9f2f65e0 0x560d9f30b270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff64d7fa640 0 client.15153 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d9f2ea650 0x560d9f311090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 --2- 172.21.15.39:0/885205080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9f2e9d30 0x560d9f310b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 >> 172.21.15.39:0/885205080 conn(0x560d9f2e7b60 msgr2=0x560d9f2f5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 shutdown_connections 2024-09-10T21:54:18.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 1 -- 172.21.15.39:0/885205080 wait complete. 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66e21f740 20 client.15153 trim_cache size 0 max 16384 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24590, 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 77.711571964000001, 2024-09-10T21:54:18.735 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 87.976120355999996 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 msgr2=0x7ff6500b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 0x7ff6500b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x560d9f2eceb0 tx=0x7ff65800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 msgr2=0x7ff66419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009fd0 tx=0x7ff65c00def0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 shutdown_connections 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff6500b5370 0x7ff6500b7830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff664109150 0x7ff66419eb10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6641087d0 0x7ff664199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 --2- 172.21.15.39:0/2369433762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff664102dc0 0x7ff664199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.728+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 >> 172.21.15.39:0/2369433762 conn(0x7ff6640fe830 msgr2=0x7ff664100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.729+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 shutdown_connections 2024-09-10T21:54:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:18.729+0000 7ff66be4a640 1 -- 172.21.15.39:0/2369433762 wait complete. 2024-09-10T21:54:19.348 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:19 smithi039 ceph-mon[30872]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:19.379 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T21:54:19.379 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T21:54:19.389 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T21:54:19.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T21:54:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:19 smithi070 ceph-mon[34909]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:19 smithi173 ceph-mon[35294]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:19.649 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 -- 172.21.15.39:0/3724500539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc103460 msgr2=0x7f5efc109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 --2- 172.21.15.39:0/3724500539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc103460 0x7f5efc109fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009cd0 tx=0x7f5ef402a8d0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 -- 172.21.15.39:0/3724500539 shutdown_connections 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 --2- 172.21.15.39:0/3724500539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc103460 0x7f5efc109fb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 --2- 172.21.15.39:0/3724500539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc1028f0 0x7f5efc102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 --2- 172.21.15.39:0/3724500539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 0x7f5efc1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 -- 172.21.15.39:0/3724500539 >> 172.21.15.39:0/3724500539 conn(0x7f5efc0fc9b0 msgr2=0x7f5efc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 -- 172.21.15.39:0/3724500539 shutdown_connections 2024-09-10T21:54:20.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 -- 172.21.15.39:0/3724500539 wait complete. 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.053+0000 7f5f01767640 1 Processor -- start 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 -- start start 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 0x7f5efc1058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc103460 0x7f5efc104680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10d5a0 con 0x7f5efc1028f0 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10d420 con 0x7f5efc103460 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5f01767640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10d720 con 0x7f5efc101fb0 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59832/0 (socket says 172.21.15.39:59832) 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 -- 172.21.15.39:0/2594579881 learned_addr learned my addr 172.21.15.39:0/2594579881 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efaffd640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 0x7f5efc1058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:20.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efb7fe640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc103460 0x7f5efc104680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 -- 172.21.15.39:0/2594579881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 msgr2=0x7f5efc1058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 0x7f5efc1058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 -- 172.21.15.39:0/2594579881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc103460 msgr2=0x7f5efc104680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc103460 0x7f5efc104680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 -- 172.21.15.39:0/2594579881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc104f40 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.054+0000 7f5efa7fc640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c920 tx=0x7f5ef000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.055+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007c70 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.055+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ef0007e10 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.055+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5efc1a2ea0 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.055+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0018820 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.055+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5efc1a3350 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.056+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5efc1a35e0 con 0x7f5efc1028f0 2024-09-10T21:54:20.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.057+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5ef000f450 con 0x7f5efc1028f0 2024-09-10T21:54:20.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.058+0000 7f5ee3fff640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 0x7f5ee40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:20.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.058+0000 7f5efaffd640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 0x7f5ee40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:20.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.058+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f5ef00e6100 con 0x7f5efc1028f0 2024-09-10T21:54:20.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.059+0000 7f5efaffd640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 0x7f5ee40b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0058c0 tx=0x7f5eec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:20.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.062+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ef0014030 con 0x7f5efc1028f0 2024-09-10T21:54:20.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.265+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5efc0fea60 con 0x7f5ee40b5370 2024-09-10T21:54:20.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.266+0000 7f5ee3fff640 1 -- 172.21.15.39:0/2594579881 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5efc0fea60 con 0x7f5ee40b5370 2024-09-10T21:54:20.267 INFO:teuthology.orchestra.run.smithi039.stdout:Backend: cephadm 2024-09-10T21:54:20.267 INFO:teuthology.orchestra.run.smithi039.stdout:Available: Yes 2024-09-10T21:54:20.267 INFO:teuthology.orchestra.run.smithi039.stdout:Paused: No 2024-09-10T21:54:20.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 msgr2=0x7f5ee40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:20.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 0x7f5ee40b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0058c0 tx=0x7f5eec00a2d0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 msgr2=0x7f5efc104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:20.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c920 tx=0x7f5ef000cde0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 shutdown_connections 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f5ee40b5370 0x7f5ee40b7830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5efc103460 0x7f5efc104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5efc1028f0 0x7f5efc104140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 --2- 172.21.15.39:0/2594579881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5efc101fb0 0x7f5efc1058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.268+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 >> 172.21.15.39:0/2594579881 conn(0x7f5efc0fc9b0 msgr2=0x7f5efc0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.269+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 shutdown_connections 2024-09-10T21:54:20.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:20.269+0000 7f5f01767640 1 -- 172.21.15.39:0/2594579881 wait complete. 2024-09-10T21:54:20.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T21:54:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:21 smithi039 ceph-mon[30872]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:21.181 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:21 smithi070 ceph-mon[34909]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:21 smithi173 ceph-mon[35294]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.659+0000 7f369af6e640 1 -- 172.21.15.39:0/4145520929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694104560 msgr2=0x7f369410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.659+0000 7f369af6e640 1 --2- 172.21.15.39:0/4145520929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694104560 0x7f369410aee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f368c009cd0 tx=0x7f368c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.659+0000 7f369af6e640 1 -- 172.21.15.39:0/4145520929 shutdown_connections 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- 172.21.15.39:0/4145520929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694104560 0x7f369410aee0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- 172.21.15.39:0/4145520929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694103ba0 0x7f3694104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- 172.21.15.39:0/4145520929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 0x7f3694102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- 172.21.15.39:0/4145520929 >> 172.21.15.39:0/4145520929 conn(0x7f36940fe2f0 msgr2=0x7f3694100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- 172.21.15.39:0/4145520929 shutdown_connections 2024-09-10T21:54:21.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- 172.21.15.39:0/4145520929 wait complete. 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 Processor -- start 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- start start 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 0x7f3694076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 0x7f3694075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f369410e6a0 con 0x7f3694103ba0 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f369410e520 con 0x7f3694102a40 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.660+0000 7f369af6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f369410e820 con 0x7f3694104560 2024-09-10T21:54:21.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59860/0 (socket says 172.21.15.39:59860) 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 -- 172.21.15.39:0/4057066126 learned_addr learned my addr 172.21.15.39:0/4057066126 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f369950b640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 0x7f3694075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3698d0a640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 0x7f3694076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 -- 172.21.15.39:0/4057066126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 msgr2=0x7f3694075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 0x7f3694075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 -- 172.21.15.39:0/4057066126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 msgr2=0x7f3694076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 0x7f3694076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 -- 172.21.15.39:0/4057066126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3694076340 con 0x7f3694103ba0 2024-09-10T21:54:21.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f369950b640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 0x7f3694075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3693fff640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f368800d950 tx=0x7f368800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688017070 con 0x7f3694103ba0 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3688009c30 con 0x7f3694103ba0 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36941a2ed0 con 0x7f3694103ba0 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.661+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368800f620 con 0x7f3694103ba0 2024-09-10T21:54:21.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.662+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36941a3380 con 0x7f3694103ba0 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.662+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3694109d60 con 0x7f3694103ba0 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.664+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3688010460 con 0x7f3694103ba0 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.665+0000 7f3691ffb640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 0x7f367c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.665+0000 7f3698d0a640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 0x7f367c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.665+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f36880e5a60 con 0x7f3694103ba0 2024-09-10T21:54:21.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.665+0000 7f3698d0a640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 0x7f367c0b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36840058c0 tx=0x7f368400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:21.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.669+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36880ac7d0 con 0x7f3694103ba0 2024-09-10T21:54:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.862+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3694063590 con 0x7f367c0b5370 2024-09-10T21:54:21.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.875+0000 7f3691ffb640 1 -- 172.21.15.39:0/4057066126 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f3694063590 con 0x7f367c0b5370 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.a smithi039 running (94s) 18s ago 93s 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 618407c2c407 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.b smithi070 running (91s) 24s ago 91s 25.8M - 19.3.0-4854-g8f219c47 589dd18248e4 4db4ee9e02a1 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.c smithi173 running (105s) 24s ago 104s 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 a6b9726171dd 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.d smithi039 running (112s) 18s ago 112s 13.6M - 19.3.0-4854-g8f219c47 589dd18248e4 89fbf827c705 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.e smithi070 running (110s) 24s ago 109s 20.7M - 19.3.0-4854-g8f219c47 589dd18248e4 14d89c334065 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.f smithi173 running (107s) 24s ago 107s 19.6M - 19.3.0-4854-g8f219c47 589dd18248e4 ad6e525ff2cc 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.g smithi039 running (97s) 18s ago 97s 17.5M - 19.3.0-4854-g8f219c47 589dd18248e4 bf6b7abae1b2 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.h smithi070 running (102s) 24s ago 102s 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 c978537ba4a8 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.i smithi173 running (99s) 24s ago 99s 18.4M - 19.3.0-4854-g8f219c47 589dd18248e4 52c6d0a17a08 2024-09-10T21:54:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:mds.j smithi039 running (115s) 18s ago 115s 14.5M - 19.3.0-4854-g8f219c47 589dd18248e4 1466b8138168 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mds.k smithi070 running (119s) 24s ago 118s 18.8M - 19.3.0-4854-g8f219c47 589dd18248e4 27151c616098 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mds.l smithi173 running (2m) 24s ago 2m 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 fafc271d58f1 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.x smithi039 *:9283,8765 running (9m) 18s ago 9m 523M - 19.3.0-4854-g8f219c47 589dd18248e4 b3670a4e5984 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.y smithi070 *:8443,8765 running (7m) 24s ago 7m 455M - 19.3.0-4854-g8f219c47 589dd18248e4 29c82c1056a6 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.z smithi173 *:8443,8765 running (7m) 24s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 a8544c72c370 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mon.a smithi039 running (9m) 18s ago 9m 52.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 17ce4ff0c63c 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mon.b smithi070 running (7m) 24s ago 7m 41.5M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 1e1fc8e6cc95 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:mon.c smithi173 running (8m) 24s ago 8m 40.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 c0c4baeb24da 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 smithi039 running (6m) 18s ago 6m 57.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 155baa1002df 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 smithi070 running (6m) 24s ago 6m 57.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 58923c5cdfd3 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 smithi173 running (6m) 24s ago 6m 55.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 39b9ec5c1275 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 smithi039 running (5m) 18s ago 5m 45.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 a015b28ffe39 2024-09-10T21:54:21.877 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 smithi070 running (5m) 24s ago 5m 47.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 79d719b4d1fc 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 smithi173 running (4m) 24s ago 4m 47.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 9587ce4b9db1 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 smithi039 running (4m) 18s ago 4m 52.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 a58864d9ec25 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 smithi070 running (3m) 24s ago 3m 45.6M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 51e245292b2e 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 smithi173 running (3m) 24s ago 3m 46.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 430f7a3c3d1a 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 smithi039 running (3m) 18s ago 3m 47.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 394b966b8715 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 smithi070 running (2m) 24s ago 2m 46.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 aab0dd44d5e3 2024-09-10T21:54:21.878 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 smithi173 running (2m) 24s ago 2m 49.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0cf0ecb06eac 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.877+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 msgr2=0x7f367c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.877+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 0x7f367c0b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36840058c0 tx=0x7f368400a4c0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.877+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 msgr2=0x7f3694075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.877+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f368800d950 tx=0x7f368800de10 comp rx=0 tx=0).stop 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 shutdown_connections 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f367c0b5370 0x7f367c0b7830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3694104560 0x7f3694075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3694103ba0 0x7f3694075540 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 --2- 172.21.15.39:0/4057066126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3694102a40 0x7f3694076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 >> 172.21.15.39:0/4057066126 conn(0x7f36940fe2f0 msgr2=0x7f3694106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 shutdown_connections 2024-09-10T21:54:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:21.878+0000 7f369af6e640 1 -- 172.21.15.39:0/4057066126 wait complete. 2024-09-10T21:54:22.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:22 smithi039 ceph-mon[30872]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:22.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:22 smithi070 ceph-mon[34909]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:22.486 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T21:54:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:22 smithi173 ceph-mon[35294]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:22.744 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:23.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:23 smithi039 ceph-mon[30872]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:23.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:23 smithi039 ceph-mon[30872]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 -- 172.21.15.39:0/2752572053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 msgr2=0x7ff55c101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 --2- 172.21.15.39:0/2752572053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c101d40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff558009930 tx=0x7ff55802a420 comp rx=0 tx=0).stop 2024-09-10T21:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 -- 172.21.15.39:0/2752572053 shutdown_connections 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 --2- 172.21.15.39:0/2752572053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 0x7ff55c109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 --2- 172.21.15.39:0/2752572053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 0x7ff55c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 --2- 172.21.15.39:0/2752572053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c101d40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 -- 172.21.15.39:0/2752572053 >> 172.21.15.39:0/2752572053 conn(0x7ff55c0fd1f0 msgr2=0x7ff55c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.165+0000 7ff56395a640 1 -- 172.21.15.39:0/2752572053 shutdown_connections 2024-09-10T21:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.166+0000 7ff56395a640 1 -- 172.21.15.39:0/2752572053 wait complete. 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.166+0000 7ff56395a640 1 Processor -- start 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.166+0000 7ff56395a640 1 -- start start 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 0x7ff55c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 0x7ff55c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10d5a0 con 0x7ff55c101940 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10d420 con 0x7ff55c103460 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff56395a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10d720 con 0x7ff55c102aa0 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59872/0 (socket says 172.21.15.39:59872) 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 -- 172.21.15.39:0/1894990956 learned_addr learned my addr 172.21.15.39:0/1894990956 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff561ef7640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 0x7ff55c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff560ef5640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 0x7ff55c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 -- 172.21.15.39:0/1894990956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 msgr2=0x7ff55c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 0x7ff55c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 -- 172.21.15.39:0/1894990956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 msgr2=0x7ff55c198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 0x7ff55c198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 -- 172.21.15.39:0/1894990956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c1997d0 con 0x7ff55c101940 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5616f6640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff558005ab0 tx=0x7ff5580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55803f030 con 0x7ff55c101940 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.167+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff558003cb0 con 0x7ff55c101940 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.168+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c199a60 con 0x7ff55c101940 2024-09-10T21:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.168+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558035070 con 0x7ff55c101940 2024-09-10T21:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.168+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c1a01a0 con 0x7ff55c101940 2024-09-10T21:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.169+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c101d40 con 0x7ff55c101940 2024-09-10T21:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.170+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff55803bc20 con 0x7ff55c101940 2024-09-10T21:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.171+0000 7ff5527fc640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 0x7ff5480b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.171+0000 7ff560ef5640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 0x7ff5480b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.171+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff558106b40 con 0x7ff55c101940 2024-09-10T21:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.171+0000 7ff560ef5640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 0x7ff5480b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff54c005e10 tx=0x7ff54c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.174+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff5580cd8b0 con 0x7ff55c101940 2024-09-10T21:54:23.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.368+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff55c063590 con 0x7ff5480b53f0 2024-09-10T21:54:23.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.374+0000 7ff5527fc640 1 -- 172.21.15.39:0/1894990956 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff55c063590 con 0x7ff5480b53f0 2024-09-10T21:54:23.375 INFO:teuthology.orchestra.run.smithi039.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T21:54:23.375 INFO:teuthology.orchestra.run.smithi039.stdout:mds.all 12/12 25s ago 2m smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi070=b;smithi070=e;smithi070=h;smithi070=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-10T21:54:23.375 INFO:teuthology.orchestra.run.smithi039.stdout:mgr 3/3 25s ago 7m smithi039=x;smithi070=y;smithi173=z;count:3 2024-09-10T21:54:23.375 INFO:teuthology.orchestra.run.smithi039.stdout:mon 3/3 25s ago 8m smithi039:172.21.15.39=a;smithi070:172.21.15.70=b;smithi173:172.21.15.173=c;count:3 2024-09-10T21:54:23.375 INFO:teuthology.orchestra.run.smithi039.stdout:osd 12 25s ago - 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 msgr2=0x7ff5480b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 0x7ff5480b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff54c005e10 tx=0x7ff54c005da0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 msgr2=0x7ff55c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff558005ab0 tx=0x7ff5580042f0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 shutdown_connections 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff5480b53f0 0x7ff5480b78b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff55c103460 0x7ff55c198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff55c102aa0 0x7ff55c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 --2- 172.21.15.39:0/1894990956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55c101940 0x7ff55c197ca0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 >> 172.21.15.39:0/1894990956 conn(0x7ff55c0fd1f0 msgr2=0x7ff55c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:23.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 shutdown_connections 2024-09-10T21:54:23.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:23.376+0000 7ff56395a640 1 -- 172.21.15.39:0/1894990956 wait complete. 2024-09-10T21:54:23.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:23 smithi070 ceph-mon[34909]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:23.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:23 smithi070 ceph-mon[34909]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:23 smithi173 ceph-mon[35294]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:23 smithi173 ceph-mon[35294]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:23.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T21:54:24.218 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:24.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 -- 172.21.15.39:0/1273432102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 msgr2=0x7f0a90107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:24.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/1273432102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a90107a10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009900 tx=0x7f0a8c02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:24.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 -- 172.21.15.39:0/1273432102 shutdown_connections 2024-09-10T21:54:24.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/1273432102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9010a960 0x7f0a9010ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/1273432102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a90107f50 0x7f0a9010a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/1273432102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a90107a10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 -- 172.21.15.39:0/1273432102 >> 172.21.15.39:0/1273432102 conn(0x7f0a900fd200 msgr2=0x7f0a900ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 -- 172.21.15.39:0/1273432102 shutdown_connections 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.682+0000 7f0a97cdd640 1 -- 172.21.15.39:0/1273432102 wait complete. 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 Processor -- start 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 -- start start 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 0x7f0a9019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a9010a960 0x7f0a9019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a901109b0 con 0x7f0a9006bff0 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a90110830 con 0x7f0a90107f50 2024-09-10T21:54:24.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a97cdd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a90110b30 con 0x7f0a9010a960 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59886/0 (socket says 172.21.15.39:59886) 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 -- 172.21.15.39:0/2462592325 learned_addr learned my addr 172.21.15.39:0/2462592325 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a9627a640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a9010a960 0x7f0a9019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95278640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 0x7f0a9019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 -- 172.21.15.39:0/2462592325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a9010a960 msgr2=0x7f0a9019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a9010a960 0x7f0a9019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 -- 172.21.15.39:0/2462592325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 msgr2=0x7f0a9019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 0x7f0a9019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95a79640 1 -- 172.21.15.39:0/2462592325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9019cd10 con 0x7f0a9006bff0 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.683+0000 7f0a95278640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 0x7f0a9019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a95a79640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c031500 tx=0x7f0a8c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c03f030 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a8c003800 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9019cfa0 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c035070 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.684+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a901a3590 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.685+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a900fecf0 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.686+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0a8c031b10 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.687+0000 7f0a86ffd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 0x7f0a7c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.687+0000 7f0a95278640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 0x7f0a7c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.687+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0a8c106a00 con 0x7f0a9006bff0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.688+0000 7f0a95278640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 0x7f0a7c0b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a80006fd0 tx=0x7f0a80008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.690+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0a8c0cd770 con 0x7f0a9006bff0 2024-09-10T21:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.884+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0a90063590 con 0x7f0a7c0b5370 2024-09-10T21:54:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.885+0000 7f0a86ffd640 1 -- 172.21.15.39:0/2462592325 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f0a90063590 con 0x7f0a7c0b5370 2024-09-10T21:54:24.886 INFO:teuthology.orchestra.run.smithi039.stdout:HOST ADDR LABELS STATUS 2024-09-10T21:54:24.886 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 172.21.15.39 2024-09-10T21:54:24.886 INFO:teuthology.orchestra.run.smithi039.stdout:smithi070 172.21.15.70 2024-09-10T21:54:24.886 INFO:teuthology.orchestra.run.smithi039.stdout:smithi173 172.21.15.173 2024-09-10T21:54:24.887 INFO:teuthology.orchestra.run.smithi039.stdout:3 hosts in cluster 2024-09-10T21:54:24.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 msgr2=0x7f0a7c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:24.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 0x7f0a7c0b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a80006fd0 tx=0x7f0a80008040 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 msgr2=0x7f0a9019b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c031500 tx=0x7f0a8c0043c0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 shutdown_connections 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a7c0b5370 0x7f0a7c0b7830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a9010a960 0x7f0a9019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a90107f50 0x7f0a9019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 --2- 172.21.15.39:0/2462592325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a9006bff0 0x7f0a9019b250 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.887+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 >> 172.21.15.39:0/2462592325 conn(0x7f0a900fd200 msgr2=0x7f0a90108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.888+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 shutdown_connections 2024-09-10T21:54:24.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:24.888+0000 7f0a97cdd640 1 -- 172.21.15.39:0/2462592325 wait complete. 2024-09-10T21:54:25.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:25 smithi039 ceph-mon[30872]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:25.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:25 smithi039 ceph-mon[30872]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:25 smithi070 ceph-mon[34909]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:25 smithi070 ceph-mon[34909]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:25.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:25 smithi173 ceph-mon[35294]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:25.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:25 smithi173 ceph-mon[35294]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:25.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T21:54:25.763 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:26.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:26 smithi039 ceph-mon[30872]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 -- 172.21.15.39:0/2562318903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 msgr2=0x7fd24c109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 --2- 172.21.15.39:0/2562318903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c109de0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd244009cd0 tx=0x7fd24402a8e0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 -- 172.21.15.39:0/2562318903 shutdown_connections 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 --2- 172.21.15.39:0/2562318903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c109de0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 --2- 172.21.15.39:0/2562318903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c102aa0 0x7fd24c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 --2- 172.21.15.39:0/2562318903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c101940 0x7fd24c101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 -- 172.21.15.39:0/2562318903 >> 172.21.15.39:0/2562318903 conn(0x7fd24c0fd1f0 msgr2=0x7fd24c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:26.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 -- 172.21.15.39:0/2562318903 shutdown_connections 2024-09-10T21:54:26.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.182+0000 7fd253c6d640 1 -- 172.21.15.39:0/2562318903 wait complete. 2024-09-10T21:54:26.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 Processor -- start 2024-09-10T21:54:26.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 -- start start 2024-09-10T21:54:26.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c101940 0x7fd24c105700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:26.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c102aa0 0x7fd24c103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:26.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10d5a0 con 0x7fd24c103460 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10d420 con 0x7fd24c101940 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd253c6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10d720 con 0x7fd24c102aa0 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd25220a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd25220a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59900/0 (socket says 172.21.15.39:59900) 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.183+0000 7fd25220a640 1 -- 172.21.15.39:0/3997645339 learned_addr learned my addr 172.21.15.39:0/3997645339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd251208640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c102aa0 0x7fd24c103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd251a09640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c101940 0x7fd24c105700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 -- 172.21.15.39:0/3997645339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c102aa0 msgr2=0x7fd24c103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c102aa0 0x7fd24c103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 -- 172.21.15.39:0/3997645339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c101940 msgr2=0x7fd24c105700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c101940 0x7fd24c105700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 -- 172.21.15.39:0/3997645339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c104d70 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd25220a640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd2440097b0 tx=0x7fd244003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244004450 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2440045f0 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1a2ec0 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24403b660 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.184+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1a3370 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.185+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c1a3660 con 0x7fd24c103460 2024-09-10T21:54:26.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.187+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd24404c060 con 0x7fd24c103460 2024-09-10T21:54:26.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.188+0000 7fd242ffd640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 0x7fd2380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:26.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.188+0000 7fd251a09640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 0x7fd2380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:26.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.188+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd24402e030 con 0x7fd24c103460 2024-09-10T21:54:26.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.188+0000 7fd251a09640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 0x7fd2380b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd248005e10 tx=0x7fd248005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:26.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.191+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2440047a0 con 0x7fd24c103460 2024-09-10T21:54:26.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.385+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd24c1a3830 con 0x7fd2380b5370 2024-09-10T21:54:26.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.386+0000 7fd242ffd640 1 -- 172.21.15.39:0/3997645339 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd24c1a3830 con 0x7fd2380b5370 2024-09-10T21:54:26.387 INFO:teuthology.orchestra.run.smithi039.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T21:54:26.387 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-09-10T21:54:26.387 INFO:teuthology.orchestra.run.smithi039.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-10T21:54:26.387 INFO:teuthology.orchestra.run.smithi039.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T21:54:26.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 msgr2=0x7fd2380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:26.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 0x7fd2380b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd248005e10 tx=0x7fd248005da0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 msgr2=0x7fd24c1044b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:26.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd2440097b0 tx=0x7fd244003f10 comp rx=0 tx=0).stop 2024-09-10T21:54:26.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 shutdown_connections 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2380b5370 0x7fd2380b7830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c103460 0x7fd24c1044b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd24c102aa0 0x7fd24c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 --2- 172.21.15.39:0/3997645339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c101940 0x7fd24c105700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 >> 172.21.15.39:0/3997645339 conn(0x7fd24c0fd1f0 msgr2=0x7fd24c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 shutdown_connections 2024-09-10T21:54:26.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:26.388+0000 7fd253c6d640 1 -- 172.21.15.39:0/3997645339 wait complete. 2024-09-10T21:54:26.393 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:26 smithi173 ceph-mon[35294]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:26.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:26 smithi070 ceph-mon[34909]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:27.245 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:27 smithi039 ceph-mon[30872]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:27.276 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T21:54:27.285 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T21:54:27.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T21:54:27.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:27 smithi070 ceph-mon[34909]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:27.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:27 smithi173 ceph-mon[35294]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:27.546 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 -- 172.21.15.39:0/3056408089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 msgr2=0x7f0990075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 --2- 172.21.15.39:0/3056408089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f0990075fa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0980009900 tx=0x7f098002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 -- 172.21.15.39:0/3056408089 shutdown_connections 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 --2- 172.21.15.39:0/3056408089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099010a970 0x7f099010ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 --2- 172.21.15.39:0/3056408089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f0990075fa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 --2- 172.21.15.39:0/3056408089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0990076f80 0x7f09900755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 -- 172.21.15.39:0/3056408089 >> 172.21.15.39:0/3056408089 conn(0x7f09900fe2f0 msgr2=0x7f0990100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.939+0000 7f099771a640 1 -- 172.21.15.39:0/3056408089 shutdown_connections 2024-09-10T21:54:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 -- 172.21.15.39:0/3056408089 wait complete. 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 Processor -- start 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 -- start start 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0990076f80 0x7f099019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f099010a970 0x7f099019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0990110980 con 0x7f0990075b20 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0990110800 con 0x7f0990076f80 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f099771a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0990110b00 con 0x7f099010a970 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f09954b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f09954b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59914/0 (socket says 172.21.15.39:59914) 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.940+0000 7f09954b6640 1 -- 172.21.15.39:0/1152537826 learned_addr learned my addr 172.21.15.39:0/1152537826 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f0994cb5640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0990076f80 0x7f099019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 -- 172.21.15.39:0/1152537826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f099010a970 msgr2=0x7f099019c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f099010a970 0x7f099019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 -- 172.21.15.39:0/1152537826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0990076f80 msgr2=0x7f099019b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0990076f80 0x7f099019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 -- 172.21.15.39:0/1152537826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099019cc70 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09954b6640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b4a0 tx=0x7f098c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c014070 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099019cf60 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f098c010ac0 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c017c30 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.941+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901a3640 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.942+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0990109070 con 0x7f0990075b20 2024-09-10T21:54:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.944+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f098c010610 con 0x7f0990075b20 2024-09-10T21:54:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.944+0000 7f09867fc640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 0x7f097c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.944+0000 7f0994cb5640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 0x7f097c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.944+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f098c0e56c0 con 0x7f0990075b20 2024-09-10T21:54:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.945+0000 7f0994cb5640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 0x7f097c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0980005c40 tx=0x7f0980000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:27.948+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f098c0ac430 con 0x7f0990075b20 2024-09-10T21:54:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.176+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f099002e5c0 con 0x7f0990075b20 2024-09-10T21:54:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.176+0000 7f09867fc640 1 -- 172.21.15.39:0/1152537826 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3128 (secure 0 0 0) 0x7f098c0abd30 con 0x7f0990075b20 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:e26 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:btime 2024-09-10T21:53:12:250294+0000 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:legacy client fscid: 1 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:Filesystem 'cephfs' (1) 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:fs_name cephfs 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 26 2024-09-10T21:54:28.178 INFO:teuthology.orchestra.run.smithi039.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-10T21:53:00.566007+0000 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-10T21:53:11.761230+0000 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:tableserver 0 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:root 0 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:session_timeout 300 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:session_autoclose 300 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:max_file_size 1099511627776 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:max_xattr_size 65536 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:required_client_features {} 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure 0 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure_osd_epoch 0 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:max_mds 5 2024-09-10T21:54:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:in 0,1,2,3,4 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:up {0=24590,1=24583,2=24563,3=24562,4=24550} 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:failed 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:damaged 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:stopped 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:data_pools [3] 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:metadata_pool 2 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:inline_data disabled 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:balancer 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:bal_rank_mask -1 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:standby_count_wanted 0 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:qdb_cluster leader: 24590 members: 24590,24583,24562,24563,24550 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b{0:24590} state up:active seq 4 addr [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.180 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.e{0:24542} state up:standby-replay seq 1 addr [v2:172.21.15.70:6834/4263006579,v1:172.21.15.70:6835/4263006579] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.i{1:24583} state up:active seq 8 addr [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.l{1:24520} state up:standby-replay seq 1 addr [v2:172.21.15.173:6832/4284402847,v1:172.21.15.173:6833/4284402847] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.h{2:24563} state up:active seq 9 addr [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.k{2:24515} state up:standby-replay seq 1 addr [v2:172.21.15.70:6832/4205749592,v1:172.21.15.70:6833/4205749592] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c{3:24562} state up:active seq 10 addr [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a{3:14715} state up:standby-replay seq 1 addr [v2:172.21.15.39:6840/2073917136,v1:172.21.15.39:6841/2073917136] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.f{4:24550} state up:active seq 11 addr [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.g{4:14703} state up:standby-replay seq 1 addr [v2:172.21.15.39:6838/4288267736,v1:172.21.15.39:6839/4288267736] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:Standby daemons: 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.j{-1:14646} state up:standby seq 1 addr [v2:172.21.15.39:6834/2261493823,v1:172.21.15.39:6835/2261493823] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.181 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d{-1:14658} state up:standby seq 1 addr [v2:172.21.15.39:6836/1193570849,v1:172.21.15.39:6837/1193570849] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:54:28.182 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:28.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 msgr2=0x7f097c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 0x7f097c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0980005c40 tx=0x7f0980000bc0 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 msgr2=0x7f099019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b4a0 tx=0x7f098c00b960 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 shutdown_connections 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f097c0b5370 0x7f097c0b7830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f099010a970 0x7f099019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0990076f80 0x7f099019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 --2- 172.21.15.39:0/1152537826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0990075b20 0x7f099019b140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 >> 172.21.15.39:0/1152537826 conn(0x7f09900fe2f0 msgr2=0x7f09901006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 shutdown_connections 2024-09-10T21:54:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:28.179+0000 7f099771a640 1 -- 172.21.15.39:0/1152537826 wait complete. 2024-09-10T21:54:28.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:28 smithi070 ceph-mon[34909]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:28.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:28 smithi039 ceph-mon[30872]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:28.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:28 smithi173 ceph-mon[35294]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:28.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T21:54:29.013 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:29.356 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:29 smithi039 ceph-mon[30872]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:29.356 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:29 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1152537826' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:54:29.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:29 smithi070 ceph-mon[34909]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:29.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1152537826' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:54:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 -- 172.21.15.39:0/3101806040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4406b6e0 msgr2=0x7fea441055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 --2- 172.21.15.39:0/3101806040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4406b6e0 0x7fea441055f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fea34009900 tx=0x7fea3402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 -- 172.21.15.39:0/3101806040 shutdown_connections 2024-09-10T21:54:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 --2- 172.21.15.39:0/3101806040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 0x7fea4410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 --2- 172.21.15.39:0/3101806040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea44105b80 0x7fea44107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 --2- 172.21.15.39:0/3101806040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4406b6e0 0x7fea441055f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 -- 172.21.15.39:0/3101806040 >> 172.21.15.39:0/3101806040 conn(0x7fea440fd1e0 msgr2=0x7fea440ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 -- 172.21.15.39:0/3101806040 shutdown_connections 2024-09-10T21:54:29.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.438+0000 7fea4a196640 1 -- 172.21.15.39:0/3101806040 wait complete. 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 Processor -- start 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 -- start start 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea4406b6e0 0x7fea44102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 0x7fea44101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea4410e6b0 con 0x7fea44105b80 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea4410e530 con 0x7fea44108730 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea4a196640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fea4410e830 con 0x7fea4406b6e0 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:29.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59932/0 (socket says 172.21.15.39:59932) 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.439+0000 7fea42ffd640 1 -- 172.21.15.39:0/3617751677 learned_addr learned my addr 172.21.15.39:0/3617751677 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea43fff640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 0x7fea44101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea437fe640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea4406b6e0 0x7fea44102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 -- 172.21.15.39:0/3617751677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea4406b6e0 msgr2=0x7fea44102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea4406b6e0 0x7fea44102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 -- 172.21.15.39:0/3617751677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 msgr2=0x7fea44101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 0x7fea44101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 -- 172.21.15.39:0/3617751677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea44102390 con 0x7fea44105b80 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea42ffd640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c970 tx=0x7fea3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38007bb0 con 0x7fea44105b80 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea441a2ea0 con 0x7fea44105b80 2024-09-10T21:54:29.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea38007d50 con 0x7fea44105b80 2024-09-10T21:54:29.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38018730 con 0x7fea44105b80 2024-09-10T21:54:29.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.440+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441a3300 con 0x7fea44105b80 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.442+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea440fecd0 con 0x7fea44105b80 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.443+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fea38020030 con 0x7fea44105b80 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.443+0000 7fea40ff9640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 0x7fea2c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.444+0000 7fea437fe640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 0x7fea2c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.444+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fea380e5aa0 con 0x7fea44105b80 2024-09-10T21:54:29.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.444+0000 7fea437fe640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 0x7fea2c0b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea34000c00 tx=0x7fea340314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.448+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fea38014030 con 0x7fea44105b80 2024-09-10T21:54:29.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:29 smithi173 ceph-mon[35294]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:29.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:29 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1152537826' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:54:29.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.635+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fea4402e810 con 0x7fea44105b80 2024-09-10T21:54:29.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.636+0000 7fea40ff9640 1 -- 172.21.15.39:0/3617751677 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v73) ==== 56+0+5259 (secure 0 0 0) 0x7fea380ac7b0 con 0x7fea44105b80 2024-09-10T21:54:29.637 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 73 2024-09-10T21:54:29.637 INFO:teuthology.orchestra.run.smithi039.stdout:fsid c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-10T21:44:49.364474+0000 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-10T21:53:44.535601+0000 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:crush_version 26 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:full_ratio 0.95 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:backfillfull_ratio 0.9 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:nearfull_ratio 0.85 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:require_min_compat_client luminous 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:min_compat_client luminous 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:require_osd_release squid 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:stretch_mode_enabled false 2024-09-10T21:54:29.638 INFO:teuthology.orchestra.run.smithi039.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 71 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 71 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:max_osd 12 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 up in weight 1 up_from 8 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6802/3224124863,v1:172.21.15.39:6803/3224124863] [v2:172.21.15.39:6804/3224124863,v1:172.21.15.39:6805/3224124863] exists,up 56332c27-ff44-404f-888f-2afe3c4a79e5 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 up in weight 1 up_from 12 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/2437314157,v1:172.21.15.70:6801/2437314157] [v2:172.21.15.70:6802/2437314157,v1:172.21.15.70:6803/2437314157] exists,up 9c072d34-38e6-475a-b178-5482d9d1cd77 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 up in weight 1 up_from 17 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/2216129379,v1:172.21.15.173:6801/2216129379] [v2:172.21.15.173:6802/2216129379,v1:172.21.15.173:6803/2216129379] exists,up 1368958a-2ba8-4150-a83e-34fe758cc97c 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 up in weight 1 up_from 23 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6810/924157830,v1:172.21.15.39:6811/924157830] [v2:172.21.15.39:6812/924157830,v1:172.21.15.39:6813/924157830] exists,up 1e1d4a1d-b631-4b70-91f0-ac23984ab2c0 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 up in weight 1 up_from 29 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/345717748,v1:172.21.15.70:6809/345717748] [v2:172.21.15.70:6810/345717748,v1:172.21.15.70:6811/345717748] exists,up 28463f55-3ef4-40b9-8ee0-2ce24d86681e 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 up in weight 1 up_from 34 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/1964049526,v1:172.21.15.173:6809/1964049526] [v2:172.21.15.173:6810/1964049526,v1:172.21.15.173:6811/1964049526] exists,up b164260c-3662-492f-82c1-9514e6eaddc3 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 up in weight 1 up_from 39 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6818/52541614,v1:172.21.15.39:6819/52541614] [v2:172.21.15.39:6820/52541614,v1:172.21.15.39:6821/52541614] exists,up 2699e689-3038-4851-b19e-c1d2db643248 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 up in weight 1 up_from 43 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/2255770710,v1:172.21.15.70:6817/2255770710] [v2:172.21.15.70:6818/2255770710,v1:172.21.15.70:6819/2255770710] exists,up a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76 2024-09-10T21:54:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 up in weight 1 up_from 49 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/1670675498,v1:172.21.15.173:6817/1670675498] [v2:172.21.15.173:6818/1670675498,v1:172.21.15.173:6819/1670675498] exists,up 92a3c209-2026-4723-8b0c-b0e780c4cdf3 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 up in weight 1 up_from 55 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6826/4072421182,v1:172.21.15.39:6827/4072421182] [v2:172.21.15.39:6828/4072421182,v1:172.21.15.39:6829/4072421182] exists,up 44086006-8ec9-46fd-bf78-c82043bdb546 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 up in weight 1 up_from 60 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/1015386076,v1:172.21.15.70:6825/1015386076] [v2:172.21.15.70:6826/1015386076,v1:172.21.15.70:6827/1015386076] exists,up c9ca0ca6-7ace-4069-b3c2-d5630dca41fa 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 up in weight 1 up_from 65 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/921760262,v1:172.21.15.173:6825/921760262] [v2:172.21.15.173:6826/921760262,v1:172.21.15.173:6827/921760262] exists,up a925b267-e78c-4cd2-b4c3-a236abc4ce1d 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.a [2,11] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.1c [8,11] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.1d [2,4] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.1 [4,9] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.e [5,9] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.1d [4,6] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.21 [4,8] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.38 [3,9] 2024-09-10T21:54:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2182482631 expires 2024-09-11T21:45:43.360662+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1818411713 expires 2024-09-11T21:45:43.360662+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/1744585389 expires 2024-09-11T21:45:43.360662+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1854014949 expires 2024-09-11T21:45:18.572537+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2652652450 expires 2024-09-11T21:45:18.572537+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/1744585389 expires 2024-09-11T21:45:43.360662+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/189886877 expires 2024-09-11T21:45:18.572537+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2133570636 expires 2024-09-11T21:45:43.360662+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/189886877 expires 2024-09-11T21:45:18.572537+0000 2024-09-10T21:54:29.641 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1872994819 expires 2024-09-11T21:45:18.572537+0000 2024-09-10T21:54:29.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 msgr2=0x7fea2c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:29.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 0x7fea2c0b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea34000c00 tx=0x7fea340314a0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 msgr2=0x7fea44101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:29.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c970 tx=0x7fea3800ce30 comp rx=0 tx=0).stop 2024-09-10T21:54:29.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 shutdown_connections 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fea2c0b5370 0x7fea2c0b7830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea44108730 0x7fea44101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea44105b80 0x7fea44101590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 --2- 172.21.15.39:0/3617751677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea4406b6e0 0x7fea44102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 >> 172.21.15.39:0/3617751677 conn(0x7fea440fd1e0 msgr2=0x7fea44103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 shutdown_connections 2024-09-10T21:54:29.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:29.639+0000 7fea4a196640 1 -- 172.21.15.39:0/3617751677 wait complete. 2024-09-10T21:54:30.189 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T21:54:30.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:30.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:30 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3617751677' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:54:30.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:30 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3617751677' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:54:30.456 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:30.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:30 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3617751677' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:54:30.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 -- 172.21.15.39:0/2577040702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44641076c0 msgr2=0x7f4464107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 --2- 172.21.15.39:0/2577040702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44641076c0 0x7f4464107b00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 -- 172.21.15.39:0/2577040702 shutdown_connections 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 --2- 172.21.15.39:0/2577040702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4464108040 0x7f446410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 --2- 172.21.15.39:0/2577040702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44641076c0 0x7f4464107b00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 --2- 172.21.15.39:0/2577040702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464101cb0 0x7f4464102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 -- 172.21.15.39:0/2577040702 >> 172.21.15.39:0/2577040702 conn(0x7f44640fd740 msgr2=0x7f44640ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 -- 172.21.15.39:0/2577040702 shutdown_connections 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.836+0000 7f4468d1e640 1 -- 172.21.15.39:0/2577040702 wait complete. 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 Processor -- start 2024-09-10T21:54:30.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 -- start start 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 0x7f446419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 0x7f44641a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4464111ce0 con 0x7f4464101cb0 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4464111b60 con 0x7f44641076c0 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f4468d1e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4464111e60 con 0x7f4464108040 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f446259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:30.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f446259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60076/0 (socket says 172.21.15.39:60076) 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.837+0000 7f446259c640 1 -- 172.21.15.39:0/1455153493 learned_addr learned my addr 172.21.15.39:0/1455153493 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4461d9b640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 0x7f446419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 -- 172.21.15.39:0/1455153493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 msgr2=0x7f44641a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4462d9d640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 0x7f44641a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 0x7f44641a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 -- 172.21.15.39:0/1455153493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 msgr2=0x7f446419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 0x7f446419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 -- 172.21.15.39:0/1455153493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44641a1510 con 0x7f4464101cb0 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4461d9b640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 0x7f446419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4462d9d640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 0x7f44641a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f446259c640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f445c00cce0 tx=0x7f445c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c00f650 con 0x7f4464101cb0 2024-09-10T21:54:30.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44641a1800 con 0x7f4464101cb0 2024-09-10T21:54:30.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c00fca0 con 0x7f4464101cb0 2024-09-10T21:54:30.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c018b40 con 0x7f4464101cb0 2024-09-10T21:54:30.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.838+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44641a8090 con 0x7f4464101cb0 2024-09-10T21:54:30.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.839+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4464102090 con 0x7f4464101cb0 2024-09-10T21:54:30.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.841+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f445c00f7f0 con 0x7f4464101cb0 2024-09-10T21:54:30.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.842+0000 7f445b7fe640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 0x7f44500b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:30.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.842+0000 7f4461d9b640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 0x7f44500b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:30.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.842+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f445c0e6590 con 0x7f4464101cb0 2024-09-10T21:54:30.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.842+0000 7f4461d9b640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 0x7f44500b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f444c005ab0 tx=0x7f444c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:30.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:30.844+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f445c014030 con 0x7f4464101cb0 2024-09-10T21:54:31.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.064+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f446419c590 con 0x7f4464101cb0 2024-09-10T21:54:31.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.065+0000 7f445b7fe640 1 -- 172.21.15.39:0/1455153493 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7f445c0ad330 con 0x7f4464101cb0 2024-09-10T21:54:31.066 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:31.066 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:54:31.066 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 msgr2=0x7f44500b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 0x7f44500b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f444c005ab0 tx=0x7f444c000bc0 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 msgr2=0x7f446419b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f445c00cce0 tx=0x7f445c00a620 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 shutdown_connections 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f44500b5370 0x7f44500b7830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4464108040 0x7f44641a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44641076c0 0x7f446419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 --2- 172.21.15.39:0/1455153493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4464101cb0 0x7f446419b460 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 >> 172.21.15.39:0/1455153493 conn(0x7f44640fd740 msgr2=0x7f44641003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 shutdown_connections 2024-09-10T21:54:31.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:31.067+0000 7f4468d1e640 1 -- 172.21.15.39:0/1455153493 wait complete. 2024-09-10T21:54:31.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:31 smithi039 ceph-mon[30872]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:31.376 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:31 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1455153493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:31 smithi070 ceph-mon[34909]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:31 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1455153493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:31.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:31 smithi173 ceph-mon[35294]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:31.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:31 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1455153493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:31.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:31.948 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:32.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2278194174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794075540 msgr2=0x7fc794075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:32.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2278194174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794075540 0x7fc794075920 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc790009900 tx=0x7fc79002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2278194174 shutdown_connections 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2278194174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794113b20 0x7fc794115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2278194174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075e60 0x7fc7941135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2278194174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794075540 0x7fc794075920 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2278194174 >> 172.21.15.39:0/2278194174 conn(0x7fc7940fe830 msgr2=0x7fc794100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2278194174 shutdown_connections 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.435+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2278194174 wait complete. 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 Processor -- start 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 -- start start 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 0x7fc79419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 0x7fc79419ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc794119480 con 0x7fc794113b20 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc794119300 con 0x7fc794075e60 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc79b2b9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc794119600 con 0x7fc794075540 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc799856640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc799856640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60082/0 (socket says 172.21.15.39:60082) 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.436+0000 7fc799856640 1 -- 172.21.15.39:0/2769487430 learned_addr learned my addr 172.21.15.39:0/2769487430 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc798854640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 0x7fc79419ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799055640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 0x7fc79419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 -- 172.21.15.39:0/2769487430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 msgr2=0x7fc79419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 0x7fc79419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 -- 172.21.15.39:0/2769487430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 msgr2=0x7fc79419ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 0x7fc79419ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 -- 172.21.15.39:0/2769487430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7941a5ae0 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799055640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 0x7fc79419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc798854640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 0x7fc79419ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc799856640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00b9e0 tx=0x7fc78c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c019070 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc78c014440 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7941a5dd0 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0125a0 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.437+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7941ac510 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.438+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7940759a0 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.441+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc78c0145f0 con 0x7fc794113b20 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.441+0000 7fc78a7fc640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 0x7fc7800b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.441+0000 7fc799055640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 0x7fc7800b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:32.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.442+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc78c0e5b30 con 0x7fc794113b20 2024-09-10T21:54:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.442+0000 7fc799055640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 0x7fc7800b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc790000c00 tx=0x7fc790031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.445+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc78c0ac8a0 con 0x7fc794113b20 2024-09-10T21:54:32.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.667+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7941a0b60 con 0x7fc794113b20 2024-09-10T21:54:32.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.668+0000 7fc78a7fc640 1 -- 172.21.15.39:0/2769487430 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11973 (secure 0 0 0) 0x7fc78c0ac1a0 con 0x7fc794113b20 2024-09-10T21:54:32.669 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:32.669 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-10T21:53:12:250294+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:53:11.761230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:54:32.670 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-10T21:54:32.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 msgr2=0x7fc7800b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:32.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 0x7fc7800b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc790000c00 tx=0x7fc790031400 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 msgr2=0x7fc7941a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00b9e0 tx=0x7fc78c00bea0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 shutdown_connections 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.670+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7800b5370 0x7fc7800b7830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc794113b20 0x7fc7941a5310 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc794075e60 0x7fc79419ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 --2- 172.21.15.39:0/2769487430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc794075540 0x7fc79419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 >> 172.21.15.39:0/2769487430 conn(0x7fc7940fe830 msgr2=0x7fc7940ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 shutdown_connections 2024-09-10T21:54:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:32.671+0000 7fc79b2b9640 1 -- 172.21.15.39:0/2769487430 wait complete. 2024-09-10T21:54:33.211 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:33 smithi039 ceph-mon[30872]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:33.211 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:33 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2769487430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:33.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:54:33.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:33 smithi070 ceph-mon[34909]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:33.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:33 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2769487430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:33.469 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:33.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:33 smithi173 ceph-mon[35294]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:33.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:33 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2769487430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:33.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 -- 172.21.15.39:0/2427803565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05001087d0 msgr2=0x7f0500108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:33.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 --2- 172.21.15.39:0/2427803565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05001087d0 0x7f0500108c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009900 tx=0x7f04f002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:33.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 -- 172.21.15.39:0/2427803565 shutdown_connections 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 --2- 172.21.15.39:0/2427803565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0500109150 0x7f050010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 --2- 172.21.15.39:0/2427803565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05001087d0 0x7f0500108c10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 --2- 172.21.15.39:0/2427803565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 0x7f05001031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 -- 172.21.15.39:0/2427803565 >> 172.21.15.39:0/2427803565 conn(0x7f05000fe830 msgr2=0x7f0500100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 -- 172.21.15.39:0/2427803565 shutdown_connections 2024-09-10T21:54:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.952+0000 7f0507e3e640 1 -- 172.21.15.39:0/2427803565 wait complete. 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 Processor -- start 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 -- start start 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 0x7f050019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05001087d0 0x7f050019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0500112e10 con 0x7f0500109150 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0500112c90 con 0x7f0500102dc0 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f0507e3e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0500112f90 con 0x7f05001087d0 2024-09-10T21:54:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f05063db640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f05063db640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60092/0 (socket says 172.21.15.39:60092) 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.953+0000 7f05063db640 1 -- 172.21.15.39:0/1340020050 learned_addr learned my addr 172.21.15.39:0/1340020050 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f0505bda640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 0x7f050019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05053d9640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05001087d0 0x7f050019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 -- 172.21.15.39:0/1340020050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05001087d0 msgr2=0x7f050019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05001087d0 0x7f050019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 -- 172.21.15.39:0/1340020050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 msgr2=0x7f050019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 0x7f050019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 -- 172.21.15.39:0/1340020050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05001a1610 con 0x7f0500109150 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f05063db640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b970 tx=0x7f04f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8019070 con 0x7f0500109150 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f8014440 con 0x7f0500109150 2024-09-10T21:54:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05001a1900 con 0x7f0500109150 2024-09-10T21:54:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80075d0 con 0x7f0500109150 2024-09-10T21:54:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.954+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05001a8040 con 0x7f0500109150 2024-09-10T21:54:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.955+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05001031a0 con 0x7f0500109150 2024-09-10T21:54:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.958+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f04f800cb40 con 0x7f0500109150 2024-09-10T21:54:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.958+0000 7f04f6ffd640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 0x7f04ec0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.958+0000 7f0505bda640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 0x7f04ec0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.958+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f04f80e5900 con 0x7f0500109150 2024-09-10T21:54:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.959+0000 7f0505bda640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 0x7f04ec0b78b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00bbe0 tx=0x7f04fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:33.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:33.961+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04f80ac020 con 0x7f0500109150 2024-09-10T21:54:34.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.148+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f050019c690 con 0x7f0500109150 2024-09-10T21:54:34.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.149+0000 7f04f6ffd640 1 -- 172.21.15.39:0/1340020050 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22652 (secure 0 0 0) 0x7f050019c690 con 0x7f0500109150 2024-09-10T21:54:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:34.152 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:44.535601+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:54:34.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 msgr2=0x7f04ec0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 0x7f04ec0b78b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00bbe0 tx=0x7f04fc00b390 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 msgr2=0x7f05001a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b970 tx=0x7f04f800be30 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 shutdown_connections 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f04ec0b53f0 0x7f04ec0b78b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0500109150 0x7f05001a0e40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05001087d0 0x7f050019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 --2- 172.21.15.39:0/1340020050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0500102dc0 0x7f050019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 >> 172.21.15.39:0/1340020050 conn(0x7f05000fe830 msgr2=0x7f0500105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 shutdown_connections 2024-09-10T21:54:34.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:34.152+0000 7f0507e3e640 1 -- 172.21.15.39:0/1340020050 wait complete. 2024-09-10T21:54:34.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T21:53:00.566007+0000', 'modified': '2024-09-10T21:53:11.761230+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24590, 'mds_1': 24583, 'mds_2': 24563, 'mds_3': 24562, 'mds_4': 24550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14703': {'gid': 14703, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6839/4288267736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 4288267736}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 4288267736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14715': {'gid': 14715, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6841/2073917136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6840', 'nonce': 2073917136}, {'type': 'v1', 'addr': '172.21.15.39:6841', 'nonce': 2073917136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6833/4205749592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 4205749592}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 4205749592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/4284402847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 4284402847}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 4284402847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6835/4263006579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6834', 'nonce': 4263006579}, {'type': 'v1', 'addr': '172.21.15.70:6835', 'nonce': 4263006579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.173:6835/1204968390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 1204968390}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 1204968390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/4244781378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 4244781378}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 4244781378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.70:6837/3809137442', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 3809137442}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 3809137442}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.173:6839/4266233306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 4266233306}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 4266233306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.70:6839/398684741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 398684741}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 398684741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24590, 'qdb_cluster': [24590, 24583, 24562, 24563, 24550]} 2024-09-10T21:54:34.722 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T21:54:34.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T21:54:34.978 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:35.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:35 smithi070 ceph-mon[34909]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:35 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1340020050' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:35 smithi039 ceph-mon[30872]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:35 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1340020050' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 -- 172.21.15.39:0/2725759751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58501076c0 msgr2=0x7f5850107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 --2- 172.21.15.39:0/2725759751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58501076c0 0x7f5850107b00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f584002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 -- 172.21.15.39:0/2725759751 shutdown_connections 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 --2- 172.21.15.39:0/2725759751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850108040 0x7f585010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 --2- 172.21.15.39:0/2725759751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58501076c0 0x7f5850107b00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 --2- 172.21.15.39:0/2725759751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850101cb0 0x7f5850102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.426+0000 7f5857ca1640 1 -- 172.21.15.39:0/2725759751 >> 172.21.15.39:0/2725759751 conn(0x7f58500fd700 msgr2=0x7f58500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- 172.21.15.39:0/2725759751 shutdown_connections 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- 172.21.15.39:0/2725759751 wait complete. 2024-09-10T21:54:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 Processor -- start 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- start start 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 0x7f58500fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58501076c0 0x7f58500fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5850111d50 con 0x7f5850108040 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5850111bd0 con 0x7f5850101cb0 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f5857ca1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5850111ed0 con 0x7f58501076c0 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f585623e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f585623e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60114/0 (socket says 172.21.15.39:60114) 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.427+0000 7f585623e640 1 -- 172.21.15.39:0/696977259 learned_addr learned my addr 172.21.15.39:0/696977259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585523c640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58501076c0 0x7f58500fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5855a3d640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 0x7f58500fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 -- 172.21.15.39:0/696977259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58501076c0 msgr2=0x7f58500fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58501076c0 0x7f58500fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 -- 172.21.15.39:0/696977259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 msgr2=0x7f58500fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 0x7f58500fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 -- 172.21.15.39:0/696977259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58501a7720 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5855a3d640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 0x7f58500fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f585623e640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f584800cce0 tx=0x7f584800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5846ffd640 1 -- 172.21.15.39:0/696977259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584800f450 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58501a7a10 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5846ffd640 1 -- 172.21.15.39:0/696977259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584800faa0 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5846ffd640 1 -- 172.21.15.39:0/696977259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848018b70 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.428+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501a7f20 con 0x7f5850108040 2024-09-10T21:54:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f5846ffd640 1 -- 172.21.15.39:0/696977259 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f584800f5f0 con 0x7f5850108040 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 Processor -- start 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 -- start start 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a92110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a92139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5603a917cc10 con 0x5603a9204d30 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603a916c040 con 0x5603a9205650 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585a076740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603a916fe50 con 0x5603a92115e0 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60124/0 (socket says 172.21.15.39:60124) 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585523c640 1 -- 172.21.15.39:0/2475657009 learned_addr learned my addr 172.21.15.39:0/2475657009 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f5855a3d640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a92110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.431+0000 7f585523c640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a92139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 -- 172.21.15.39:0/2475657009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 msgr2=0x5603a92139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a92139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 -- 172.21.15.39:0/2475657009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 msgr2=0x5603a92110a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a92110a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 -- 172.21.15.39:0/2475657009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a8eca540 con 0x5603a9204d30 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f5855a3d640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a92110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f5846ffd640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 0x7f583c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f5855a3d640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 0x7f583c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f585523c640 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f5840005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dffa313fc59c6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f5846ffd640 1 -- 172.21.15.39:0/696977259 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f58480e6470 con 0x7f5850108040 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f583bfff640 1 -- 172.21.15.39:0/2475657009 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840044020 con 0x5603a9204d30 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f583bfff640 1 -- 172.21.15.39:0/2475657009 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5840004770 con 0x5603a9204d30 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.432+0000 7f583bfff640 1 -- 172.21.15.39:0/2475657009 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840035040 con 0x5603a9204d30 2024-09-10T21:54:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- 172.21.15.39:0/2475657009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 msgr2=0x5603a9205110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f5855a3d640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 0x7f583c0b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5603a9207eb0 tx=0x7f584c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f5840005fd0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- 172.21.15.39:0/2475657009 shutdown_connections 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a92139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a92110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 --2- 172.21.15.39:0/2475657009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9204d30 0x5603a9205110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- 172.21.15.39:0/2475657009 >> 172.21.15.39:0/2475657009 conn(0x5603a9202b60 msgr2=0x5603a9203d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- 172.21.15.39:0/2475657009 shutdown_connections 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- 172.21.15.39:0/2475657009 wait complete. 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 -- start start 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.433+0000 7f585a076740 1 Processor -- start 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a920e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a920eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5603a8fcd5f0 con 0x5603a92115e0 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603a9107010 con 0x5603a9205650 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603a9214230 con 0x5603a9204d30 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585a076740 10 client.0 _ll_register_callbacks cb 0x5603a9166340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60132/0 (socket says 172.21.15.39:60132) 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 -- 172.21.15.39:0/1423827429 learned_addr learned my addr 172.21.15.39:0/1423827429 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585523c640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a920eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f5855a3d640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a920e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 -- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 msgr2=0x5603a920e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a920e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 -- 172.21.15.39:0/1423827429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 msgr2=0x5603a920eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a920eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.434+0000 7f585623e640 1 -- 172.21.15.39:0/1423827429 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a9134a00 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585623e640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f584800ff90 tx=0x7f58480ac970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c404e9f12d7d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480ac5f0 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f58480b1200 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5840004770 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f58480ad1e0 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 10 client.15225 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5603a921fea0 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5840004770 con 0x5603a92115e0 2024-09-10T21:54:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f58480e6070 con 0x5603a92115e0 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 10 client.15225 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 10 client.15225 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 20 client.15225 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9222450 0x5603a92238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 4 client.15225 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.435+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603a917eb60 con 0x5603a9222450 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.436+0000 7f5855a3d640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9222450 0x5603a92238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.436+0000 7f58397fa640 10 client.15225 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.436+0000 7f5855a3d640 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9222450 0x5603a92238c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8b41ad365ca14fa4 server_cookie=d7171ff4020c85a6 in_seq=0 out_seq=0 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f58397fa640 1 -- 172.21.15.39:0/1423827429 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603a917eb60 con 0x5603a9222450 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f58397fa640 10 client.15225 handle_command_reply: tid=0 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 client.15225 shutdown 2024-09-10T21:54:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 msgr2=0x5603a920f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f584800ff90 tx=0x7f58480ac970 comp rx=0 tx=0).stop 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 shutdown_connections 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9222450 0x5603a92238c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a92115e0 0x5603a920f050 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9205650 0x5603a920eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 --2- 172.21.15.39:0/1423827429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a920e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f58397fa640 0 client.15225 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 >> 172.21.15.39:0/1423827429 conn(0x5603a9202b60 msgr2=0x5603a9208700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 shutdown_connections 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 1 -- 172.21.15.39:0/1423827429 wait complete. 2024-09-10T21:54:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.437+0000 7f585a076740 20 client.15225 trim_cache size 0 max 16384 2024-09-10T21:54:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 Processor -- start 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 -- start start 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a9208ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 0x5603a9209dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5603a9221c00 con 0x5603a9205650 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603a92222d0 con 0x5603a92115e0 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585a076740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603a92229a0 con 0x5603a9204d30 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60138/0 (socket says 172.21.15.39:60138) 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.455+0000 7f585523c640 1 -- 172.21.15.39:0/1419908214 learned_addr learned my addr 172.21.15.39:0/1419908214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585623e640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 0x5603a9209dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 -- 172.21.15.39:0/1419908214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 msgr2=0x5603a9208ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f5855a3d640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a9208ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a9208ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 -- 172.21.15.39:0/1419908214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 msgr2=0x5603a9209dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 0x5603a9209dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 -- 172.21.15.39:0/1419908214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a9204710 con 0x5603a9205650 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585623e640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 0x5603a9209dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f585523c640 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f5840004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e597a9cf14ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f583b7fe640 1 -- 172.21.15.39:0/1419908214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840044070 con 0x5603a9205650 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f583b7fe640 1 -- 172.21.15.39:0/1419908214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584004d020 con 0x5603a9205650 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.456+0000 7f583b7fe640 1 -- 172.21.15.39:0/1419908214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840035040 con 0x5603a9205650 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- 172.21.15.39:0/1419908214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 msgr2=0x5603a9209880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f5840004fd0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- 172.21.15.39:0/1419908214 shutdown_connections 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a92115e0 0x5603a9209dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a9209880 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 --2- 172.21.15.39:0/1419908214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a9204d30 0x5603a9208ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- 172.21.15.39:0/1419908214 >> 172.21.15.39:0/1419908214 conn(0x5603a9202b60 msgr2=0x5603a9203a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- 172.21.15.39:0/1419908214 shutdown_connections 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- 172.21.15.39:0/1419908214 wait complete. 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 -- start start 2024-09-10T21:54:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.457+0000 7f585a076740 1 Processor -- start 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 0x5603a9225e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a922b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5603a9223740 con 0x5603a9205650 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603a9223070 con 0x5603a9204d30 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603a9223e10 con 0x5603a92115e0 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585a076740 10 client.0 _ll_register_callbacks cb 0x7f58480077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f5855a3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 0x5603a9225e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60142/0 (socket says 172.21.15.39:60142) 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 -- 172.21.15.39:0/2047250854 learned_addr learned my addr 172.21.15.39:0/2047250854 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585623e640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a922b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 -- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 msgr2=0x5603a922b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a922b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 -- 172.21.15.39:0/2047250854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 msgr2=0x5603a9225e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 0x5603a9225e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 -- 172.21.15.39:0/2047250854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a922bb60 con 0x5603a9205650 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f5855a3d640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 0x5603a9225e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f585523c640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f584002a450 tx=0x7f5840005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364dd88a084ff0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f58397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.458+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840057060 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f5840005240 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584004d020 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5840044070 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 10 client.15231 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5603a928f410 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584004d020 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f58400314a0 con 0x5603a9205650 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 10 client.15231 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 10 client.15231 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 20 client.15231 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9293870 0x5603a9292580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 4 client.15231 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "status"}) -- 0x5603a917a610 con 0x5603a9293870 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.459+0000 7f5855a3d640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9293870 0x5603a9292580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f58397fa640 10 client.15231 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f5855a3d640 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9293870 0x5603a9292580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9ac3847ec987c2b server_cookie=b99a638aa793b2c1 in_seq=0 out_seq=0 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f58397fa640 1 -- 172.21.15.39:0/2047250854 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5603a917a610 con 0x5603a9293870 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f58397fa640 10 client.15231 handle_command_reply: tid=0 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 client.15231 shutdown 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 msgr2=0x5603a92263d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f584002a450 tx=0x7f5840005fd0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 shutdown_connections 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5603a9293870 0x5603a9292580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603a92115e0 0x5603a922b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603a9205650 0x5603a92263d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f58397fa640 0 client.15231 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 --2- 172.21.15.39:0/2047250854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603a9204d30 0x5603a9225e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 >> 172.21.15.39:0/2047250854 conn(0x5603a9202b60 msgr2=0x5603a9203a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 shutdown_connections 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.460+0000 7f585a076740 1 -- 172.21.15.39:0/2047250854 wait complete. 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f585a076740 20 client.15231 trim_cache size 0 max 16384 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 4, 2024-09-10T21:54:35.468 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24550, 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 84.359236125999999, 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 120.84750299300001 2024-09-10T21:54:35.469 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 msgr2=0x7f583c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 0x7f583c0b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5603a9207eb0 tx=0x7f584c005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 msgr2=0x7f58500fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f584800cce0 tx=0x7f584800a620 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 shutdown_connections 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f583c0b5370 0x7f583c0b7830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5850108040 0x7f58500fe680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58501076c0 0x7f58500fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 --2- 172.21.15.39:0/696977259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5850101cb0 0x7f58500fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 >> 172.21.15.39:0/696977259 conn(0x7f58500fd700 msgr2=0x7f585006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 shutdown_connections 2024-09-10T21:54:35.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:35.461+0000 7f5857ca1640 1 -- 172.21.15.39:0/696977259 wait complete. 2024-09-10T21:54:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:35 smithi173 ceph-mon[35294]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:35 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1340020050' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:36.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T21:54:36.358 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:36.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- 172.21.15.39:0/3056101902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8108020 msgr2=0x7fc7e810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 --2- 172.21.15.39:0/3056101902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8108020 0x7fc7e810e820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009900 tx=0x7fc7e002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- 172.21.15.39:0/3056101902 shutdown_connections 2024-09-10T21:54:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 --2- 172.21.15.39:0/3056101902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8108020 0x7fc7e810e820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 --2- 172.21.15.39:0/3056101902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e81076a0 0x7fc7e8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 --2- 172.21.15.39:0/3056101902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e8101c90 0x7fc7e8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- 172.21.15.39:0/3056101902 >> 172.21.15.39:0/3056101902 conn(0x7fc7e80fd700 msgr2=0x7fc7e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- 172.21.15.39:0/3056101902 shutdown_connections 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- 172.21.15.39:0/3056101902 wait complete. 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 Processor -- start 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.742+0000 7fc7f017b640 1 -- start start 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e81076a0 0x7fc7e81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8108020 0x7fc7e819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8112dc0 con 0x7fc7e8101c90 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8112c40 con 0x7fc7e81076a0 2024-09-10T21:54:36.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7f017b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8112f40 con 0x7fc7e8108020 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60168/0 (socket says 172.21.15.39:60168) 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 -- 172.21.15.39:0/2120605807 learned_addr learned my addr 172.21.15.39:0/2120605807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7ee718640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8108020 0x7fc7e819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7ed716640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e81076a0 0x7fc7e81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 -- 172.21.15.39:0/2120605807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8108020 msgr2=0x7fc7e819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8108020 0x7fc7e819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 -- 172.21.15.39:0/2120605807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e81076a0 msgr2=0x7fc7e81997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e81076a0 0x7fc7e81997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 -- 172.21.15.39:0/2120605807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e819f320 con 0x7fc7e8101c90 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400d950 tx=0x7fc7e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.743+0000 7fc7daffd640 1 -- 172.21.15.39:0/2120605807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4017070 con 0x7fc7e8101c90 2024-09-10T21:54:36.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.744+0000 7fc7daffd640 1 -- 172.21.15.39:0/2120605807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e4009c30 con 0x7fc7e8101c90 2024-09-10T21:54:36.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.744+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e819f610 con 0x7fc7e8101c90 2024-09-10T21:54:36.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.744+0000 7fc7daffd640 1 -- 172.21.15.39:0/2120605807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400f620 con 0x7fc7e8101c90 2024-09-10T21:54:36.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.744+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e81a5ea0 con 0x7fc7e8101c90 2024-09-10T21:54:36.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.746+0000 7fc7daffd640 1 -- 172.21.15.39:0/2120605807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc7e4010460 con 0x7fc7e8101c90 2024-09-10T21:54:36.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.746+0000 7fc7f2550740 1 Processor -- start 2024-09-10T21:54:36.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.746+0000 7fc7f2550740 1 -- start start 2024-09-10T21:54:36.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559291630d30 0x559291631110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x55929163d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5592915a8c10 con 0x55929163d5e0 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559291598040 con 0x559291631650 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7f2550740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55929159be50 con 0x559291630d30 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60182/0 (socket says 172.21.15.39:60182) 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 -- 172.21.15.39:0/478174073 learned_addr learned my addr 172.21.15.39:0/478174073 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7edf17640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x55929163d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ee718640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559291630d30 0x559291631110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 -- 172.21.15.39:0/478174073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559291630d30 msgr2=0x559291631110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559291630d30 0x559291631110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 -- 172.21.15.39:0/478174073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 msgr2=0x55929163d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x55929163d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 -- 172.21.15.39:0/478174073 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592912f6540 con 0x55929163d5e0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7edf17640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x55929163d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7daffd640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 0x7fc7d40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ed716640 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc010450 tx=0x7fc7dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1603b176c0e189a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.747+0000 7fc7ee718640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 0x7fc7d40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7d3fff640 1 -- 172.21.15.39:0/478174073 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc016070 con 0x55929163d5e0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7daffd640 1 -- 172.21.15.39:0/2120605807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc7e40e58c0 con 0x7fc7e8101c90 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7d3fff640 1 -- 172.21.15.39:0/478174073 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc004d20 con 0x55929163d5e0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7d3fff640 1 -- 172.21.15.39:0/478174073 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc005390 con 0x55929163d5e0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 -- 172.21.15.39:0/478174073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 msgr2=0x55929163f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7ee718640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 0x7fc7d40b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006010 tx=0x7fc7e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc010450 tx=0x7fc7dc009f90 comp rx=0 tx=0).stop 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 -- 172.21.15.39:0/478174073 shutdown_connections 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55929163d5e0 0x55929163f9d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x55929163d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 --2- 172.21.15.39:0/478174073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559291630d30 0x559291631110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.748+0000 7fc7f2550740 1 -- 172.21.15.39:0/478174073 >> 172.21.15.39:0/478174073 conn(0x55929162eb60 msgr2=0x55929162fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- 172.21.15.39:0/478174073 shutdown_connections 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- 172.21.15.39:0/478174073 wait complete. 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- start start 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 Processor -- start 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x55929163a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x55929163aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5592913f95f0 con 0x559291631650 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559291533010 con 0x559291630d30 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.749+0000 7fc7f2550740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559291640290 con 0x55929163d5e0 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7f2550740 10 client.0 _ll_register_callbacks cb 0x559291592340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60188/0 (socket says 172.21.15.39:60188) 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 -- 172.21.15.39:0/2540081882 learned_addr learned my addr 172.21.15.39:0/2540081882 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ee718640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x55929163aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x55929163a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 -- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 msgr2=0x55929163aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x55929163aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 -- 172.21.15.39:0/2540081882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 msgr2=0x55929163a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x55929163a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 -- 172.21.15.39:0/2540081882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559291560a00 con 0x559291631650 2024-09-10T21:54:36.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7ed716640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc012f30 tx=0x7fc7dc004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a164f86b53b9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc016030 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc7dc003c40 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc004d20 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc7dc003e40 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7f2550740 10 client.15243 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.750+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55929164be50 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc004d20 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc7dc00f040 con 0x559291631650 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 10 client.15243 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 10 client.15243 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 20 client.15243 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55929164e210 0x55929164f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 4 client.15243 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592915aab60 con 0x55929164e210 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.751+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55929164e210 0x55929164f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7d17fa640 10 client.15243 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7edf17640 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55929164e210 0x55929164f680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=de6bb5c8e92bdbbd server_cookie=ec1cec628d56804d in_seq=0 out_seq=0 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7d17fa640 1 -- 172.21.15.39:0/2540081882 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592915aab60 con 0x55929164e210 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7d17fa640 10 client.15243 handle_command_reply: tid=0 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7f2550740 1 client.15243 shutdown 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 msgr2=0x55929163aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.752+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc012f30 tx=0x7fc7dc004c70 comp rx=0 tx=0).stop 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 shutdown_connections 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x55929163aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x55929163aab0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55929164e210 0x55929164f680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 --2- 172.21.15.39:0/2540081882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x55929163a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7d17fa640 0 client.15243 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 >> 172.21.15.39:0/2540081882 conn(0x55929162eb60 msgr2=0x559291634700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 shutdown_connections 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 1 -- 172.21.15.39:0/2540081882 wait complete. 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.753+0000 7fc7f2550740 20 client.15243 trim_cache size 0 max 16384 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 Processor -- start 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 -- start start 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x5592916358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291639330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55929164d9c0 con 0x559291631650 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55929164e090 con 0x559291630d30 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7f2550740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55929164e760 con 0x55929163d5e0 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60192/0 (socket says 172.21.15.39:60192) 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 -- 172.21.15.39:0/3304371385 learned_addr learned my addr 172.21.15.39:0/3304371385 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 -- 172.21.15.39:0/3304371385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 msgr2=0x559291639330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291639330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 -- 172.21.15.39:0/3304371385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 msgr2=0x5592916358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7edf17640 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x5592916358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x5592916358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7ed716640 1 -- 172.21.15.39:0/3304371385 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929162f5e0 con 0x559291631650 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.771+0000 7fc7edf17640 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x5592916358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7ed716640 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd23341bafdb39e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7d37fe640 1 -- 172.21.15.39:0/3304371385 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc016070 con 0x559291631650 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7d37fe640 1 -- 172.21.15.39:0/3304371385 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc02b030 con 0x559291631650 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7d37fe640 1 -- 172.21.15.39:0/3304371385 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc012510 con 0x559291631650 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 -- 172.21.15.39:0/3304371385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 msgr2=0x559291638df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc005c50 comp rx=0 tx=0).stop 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 -- 172.21.15.39:0/3304371385 shutdown_connections 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291639330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291631650 0x559291638df0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 --2- 172.21.15.39:0/3304371385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291630d30 0x5592916358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 -- 172.21.15.39:0/3304371385 >> 172.21.15.39:0/3304371385 conn(0x55929162eb60 msgr2=0x559291629c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 -- 172.21.15.39:0/3304371385 shutdown_connections 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.772+0000 7fc7f2550740 1 -- 172.21.15.39:0/3304371385 wait complete. 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 -- start start 2024-09-10T21:54:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 Processor -- start 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x559291652380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291657450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55929164f500 con 0x559291630d30 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55929164ee30 con 0x559291631650 2024-09-10T21:54:36.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55929164fbd0 con 0x55929163d5e0 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7f2550740 10 client.0 _ll_register_callbacks cb 0x7fc7e0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7edf17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7edf17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60208/0 (socket says 172.21.15.39:60208) 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7edf17640 1 -- 172.21.15.39:0/1462207346 learned_addr learned my addr 172.21.15.39:0/1462207346 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7ed716640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x559291652380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.773+0000 7fc7ee718640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291657450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 -- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 msgr2=0x559291657450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291657450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 -- 172.21.15.39:0/1462207346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 msgr2=0x559291652380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x559291652380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 -- 172.21.15.39:0/1462207346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559291657990 con 0x559291630d30 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7ed716640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x559291652380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:36.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7edf17640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40a9250 tx=0x7fc7e40e3700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87eede5487105df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4020040 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc02b030 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc7e40970e0 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc7e40ab750 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7f2550740 10 client.15249 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5592916bb2c0 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc02b030 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.774+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc7e4010780 con 0x559291630d30 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 10 client.15249 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 10 client.15249 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:54:36.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 20 client.15249 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5592916bfde0 0x5592916beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 4 client.15249 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "status"}) -- 0x5592915a6610 con 0x5592916bfde0 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7ed716640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5592916bfde0 0x5592916beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7ed716640 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5592916bfde0 0x5592916beaf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4d15d7a675abdf4c server_cookie=441ac5a662e26070 in_seq=0 out_seq=0 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7d17fa640 10 client.15249 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7d17fa640 1 -- 172.21.15.39:0/1462207346 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5592915a6610 con 0x5592916bfde0 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7d17fa640 10 client.15249 handle_command_reply: tid=0 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 1 client.15249 shutdown 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 msgr2=0x559291651e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.775+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40a9250 tx=0x7fc7e40e3700 comp rx=0 tx=0).stop 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 shutdown_connections 2024-09-10T21:54:36.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55929163d5e0 0x559291657450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5592916bfde0 0x5592916beaf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559291631650 0x559291652380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 --2- 172.21.15.39:0/1462207346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559291630d30 0x559291651e40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7d17fa640 0 client.15249 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 >> 172.21.15.39:0/1462207346 conn(0x55929162eb60 msgr2=0x5592916358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 shutdown_connections 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 1 -- 172.21.15.39:0/1462207346 wait complete. 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f2550740 20 client.15249 trim_cache size 0 max 16384 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:36.792 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 3, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24562, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 86.688021062000004, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 119.628018016 2024-09-10T21:54:36.793 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 msgr2=0x7fc7d40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 0x7fc7d40b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006010 tx=0x7fc7e00058d0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 msgr2=0x7fc7e8199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400d950 tx=0x7fc7e400de10 comp rx=0 tx=0).stop 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 shutdown_connections 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc7d40b53f0 0x7fc7d40b78b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8108020 0x7fc7e819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7e81076a0 0x7fc7e81997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 --2- 172.21.15.39:0/2120605807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7e8101c90 0x7fc7e8199270 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:36.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.776+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 >> 172.21.15.39:0/2120605807 conn(0x7fc7e80fd700 msgr2=0x7fc7e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:36.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.777+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 shutdown_connections 2024-09-10T21:54:36.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:36.777+0000 7fc7f017b640 1 -- 172.21.15.39:0/2120605807 wait complete. 2024-09-10T21:54:37.366 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:37 smithi039 ceph-mon[30872]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:37.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T21:54:37.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:37 smithi070 ceph-mon[34909]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:37 smithi173 ceph-mon[35294]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:37.651 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 -- 172.21.15.39:0/2946477793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 msgr2=0x7f96ac104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 --2- 172.21.15.39:0/2946477793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac104080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009900 tx=0x7f96a402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 -- 172.21.15.39:0/2946477793 shutdown_connections 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 --2- 172.21.15.39:0/2946477793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac10d100 0x7f96ac10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 --2- 172.21.15.39:0/2946477793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac1045c0 0x7f96ac10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 --2- 172.21.15.39:0/2946477793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac104080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 -- 172.21.15.39:0/2946477793 >> 172.21.15.39:0/2946477793 conn(0x7f96ac0fd700 msgr2=0x7f96ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 -- 172.21.15.39:0/2946477793 shutdown_connections 2024-09-10T21:54:38.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.034+0000 7f96b36ed640 1 -- 172.21.15.39:0/2946477793 wait complete. 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 Processor -- start 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 -- start start 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac1045c0 0x7f96ac199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac10d100 0x7f96ac19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac112d70 con 0x7f96ac103ca0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac112bf0 con 0x7f96ac10d100 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b36ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac112ef0 con 0x7f96ac1045c0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b1489640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b1489640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60236/0 (socket says 172.21.15.39:60236) 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b1489640 1 -- 172.21.15.39:0/589728397 learned_addr learned my addr 172.21.15.39:0/589728397 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.035+0000 7f96b0c88640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac1045c0 0x7f96ac199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac10d100 0x7f96ac19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 -- 172.21.15.39:0/589728397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac1045c0 msgr2=0x7f96ac199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac1045c0 0x7f96ac199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 -- 172.21.15.39:0/589728397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac10d100 msgr2=0x7f96ac19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac10d100 0x7f96ac19eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 -- 172.21.15.39:0/589728397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac19f2b0 con 0x7f96ac103ca0 2024-09-10T21:54:38.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b1489640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96a4005940 tx=0x7f96a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96aa7fc640 1 -- 172.21.15.39:0/589728397 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a403f030 con 0x7f96ac103ca0 2024-09-10T21:54:38.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac19f540 con 0x7f96ac103ca0 2024-09-10T21:54:38.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96aa7fc640 1 -- 172.21.15.39:0/589728397 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a4003cb0 con 0x7f96ac103ca0 2024-09-10T21:54:38.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96aa7fc640 1 -- 172.21.15.39:0/589728397 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4035070 con 0x7f96ac103ca0 2024-09-10T21:54:38.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.036+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac1a5c60 con 0x7f96ac103ca0 2024-09-10T21:54:38.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 Processor -- start 2024-09-10T21:54:38.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 -- start start 2024-09-10T21:54:38.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a06110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96aa7fc640 1 -- 172.21.15.39:0/589728397 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f96a403bbf0 con 0x7f96ac103ca0 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56371797dc10 con 0x563717a169f0 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56371796d040 con 0x563717a06650 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.039+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563717970e50 con 0x563717a05d30 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60252/0 (socket says 172.21.15.39:60252) 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 -- 172.21.15.39:0/3501583142 learned_addr learned my addr 172.21.15.39:0/3501583142 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a06110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b1489640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 -- 172.21.15.39:0/3501583142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 msgr2=0x563717a06110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a06110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 -- 172.21.15.39:0/3501583142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 msgr2=0x563717a164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 -- 172.21.15.39:0/3501583142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637176cb540 con 0x563717a169f0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a06110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96b0c88640 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f96a000bc90 tx=0x7f96a00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f55f393ea7f835a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96937fe640 1 -- 172.21.15.39:0/3501583142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004220 con 0x563717a169f0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96aa7fc640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 0x7f96940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96937fe640 1 -- 172.21.15.39:0/3501583142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a000be40 con 0x563717a169f0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.040+0000 7f96937fe640 1 -- 172.21.15.39:0/3501583142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004c00 con 0x563717a169f0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 0x7f96940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96aa7fc640 1 -- 172.21.15.39:0/589728397 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f96a4106560 con 0x7f96ac103ca0 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3501583142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 msgr2=0x563717a18de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 0x7f96940b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f969c010480 tx=0x7f969c0085d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f96a000bc90 tx=0x7f96a00107a0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3501583142 shutdown_connections 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a169f0 0x563717a18de0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3501583142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a06110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3501583142 >> 172.21.15.39:0/3501583142 conn(0x563717a03b60 msgr2=0x563717a04d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3501583142 shutdown_connections 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.041+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3501583142 wait complete. 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 -- start start 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 Processor -- start 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a14430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5637177ce5f0 con 0x563717a06650 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563717908010 con 0x563717a169f0 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563717a196a0 con 0x563717a05d30 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b5ac2740 10 client.0 _ll_register_callbacks cb 0x563717967340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60260/0 (socket says 172.21.15.39:60260) 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.042+0000 7f96b0c88640 1 -- 172.21.15.39:0/1963593617 learned_addr learned my addr 172.21.15.39:0/1963593617 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b1489640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a14430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 -- 172.21.15.39:0/1963593617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 msgr2=0x563717a139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 -- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 msgr2=0x563717a14430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a14430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 -- 172.21.15.39:0/1963593617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563717935a00 con 0x563717a06650 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b1489640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f96a00057b0 tx=0x7f96a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9384cba6989b747d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f9690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a002a060 con 0x563717a06650 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f96a0011790 con 0x563717a06650 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56371797fb60 con 0x563717a06650 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96a0011990 con 0x563717a06650 2024-09-10T21:54:38.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b5ac2740 10 client.15261 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.043+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563717a25260 con 0x563717a06650 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56371797fb60 con 0x563717a06650 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f96a001bc20 con 0x563717a06650 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 10 client.15261 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 10 client.15261 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 20 client.15261 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 4 client.15261 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56371797b610 con 0x563717a274a0 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.044+0000 7f96b1489640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.045+0000 7f96b1489640 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a28910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98f4d1acfe128b72 server_cookie=9e1d41eb2d32fe4e in_seq=0 out_seq=0 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.045+0000 7f9690ff9640 10 client.15261 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.045+0000 7f9690ff9640 1 -- 172.21.15.39:0/1963593617 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56371797b610 con 0x563717a274a0 2024-09-10T21:54:38.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.045+0000 7f9690ff9640 10 client.15261 handle_command_reply: tid=0 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.045+0000 7f96b5ac2740 1 client.15261 shutdown 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 msgr2=0x563717a13ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f96a00057b0 tx=0x7f96a0004750 comp rx=0 tx=0).stop 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 shutdown_connections 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a28910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f9690ff9640 0 client.15261 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a14430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a13ef0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1963593617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 >> 172.21.15.39:0/1963593617 conn(0x563717a03b60 msgr2=0x563717a02d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 shutdown_connections 2024-09-10T21:54:38.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1963593617 wait complete. 2024-09-10T21:54:38.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.046+0000 7f96b5ac2740 20 client.15261 trim_cache size 0 max 16384 2024-09-10T21:54:38.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 Processor -- start 2024-09-10T21:54:38.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 -- start start 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a11480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 0x563717a12ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563717a26c50 con 0x563717a05d30 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563717a27320 con 0x563717a06650 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563717a279f0 con 0x563717a169f0 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60276/0 (socket says 172.21.15.39:60276) 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 -- 172.21.15.39:0/3291352967 learned_addr learned my addr 172.21.15.39:0/3291352967 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 0x563717a12ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b0c88640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a11480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 -- 172.21.15.39:0/3291352967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 msgr2=0x563717a12ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 0x563717a12ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 -- 172.21.15.39:0/3291352967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 msgr2=0x563717a11480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a11480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 -- 172.21.15.39:0/3291352967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563717a0be90 con 0x563717a05d30 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 0x563717a12ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.065+0000 7f96b1489640 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f96a40cc8d0 tx=0x7f96a40045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1374ddabed376d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f9692ffd640 1 -- 172.21.15.39:0/3291352967 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4049040 con 0x563717a05d30 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f9692ffd640 1 -- 172.21.15.39:0/3291352967 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a40cc6e0 con 0x563717a05d30 2024-09-10T21:54:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f9692ffd640 1 -- 172.21.15.39:0/3291352967 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a40ccbd0 con 0x563717a05d30 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3291352967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 msgr2=0x563717a034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f96a40cc8d0 tx=0x7f96a40045a0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3291352967 shutdown_connections 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a169f0 0x563717a12ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a06650 0x563717a11480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/3291352967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a05d30 0x563717a034f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3291352967 >> 172.21.15.39:0/3291352967 conn(0x563717a03b60 msgr2=0x563717a18a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3291352967 shutdown_connections 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.066+0000 7f96b5ac2740 1 -- 172.21.15.39:0/3291352967 wait complete. 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 -- start start 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 Processor -- start 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563717a28790 con 0x563717a06650 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563717a280c0 con 0x563717a169f0 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563717a28e60 con 0x563717a05d30 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b5ac2740 10 client.0 _ll_register_callbacks cb 0x7f969c008470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b0c88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60288/0 (socket says 172.21.15.39:60288) 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b0c88640 1 -- 172.21.15.39:0/1666350720 learned_addr learned my addr 172.21.15.39:0/1666350720 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b1489640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.067+0000 7f96b1c8a640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 -- 172.21.15.39:0/1666350720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 msgr2=0x563717a080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 -- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 msgr2=0x563717a30db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a30db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 -- 172.21.15.39:0/1666350720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563717a315b0 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b0c88640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001eb0 tx=0x7f96a0010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376d3baeeb23aac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f9690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0035030 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a40cc6e0 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f96a0021040 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96a002a070 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b5ac2740 10 client.15267 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563717a0bbe0 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.068+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a40cc6e0 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f96a0004040 con 0x563717a06650 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 10 client.15267 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:38.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 10 client.15267 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 20 client.15267 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 4 client.15267 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "status"}) -- 0x563717a175f0 con 0x563717a274a0 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b1489640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f96b1489640 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a973e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b542d72b196ffa8c server_cookie=a86b4c5d971aa579 in_seq=0 out_seq=0 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f9690ff9640 10 client.15267 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f9690ff9640 1 -- 172.21.15.39:0/1666350720 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563717a175f0 con 0x563717a274a0 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.069+0000 7f9690ff9640 10 client.15267 handle_command_reply: tid=0 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 client.15267 shutdown 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 msgr2=0x563717a08650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001eb0 tx=0x7f96a0010de0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 shutdown_connections 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x563717a274a0 0x563717a973e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563717a169f0 0x563717a30db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563717a06650 0x563717a08650 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 --2- 172.21.15.39:0/1666350720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563717a05d30 0x563717a080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 >> 172.21.15.39:0/1666350720 conn(0x563717a03b60 msgr2=0x563717a04bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f9690ff9640 0 client.15267 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 shutdown_connections 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 1 -- 172.21.15.39:0/1666350720 wait complete. 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b5ac2740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:38.077 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24563, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 88.995968231000006, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 118.354860074 2024-09-10T21:54:38.078 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 msgr2=0x7f96940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 0x7f96940b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f969c010480 tx=0x7f969c0085d0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 msgr2=0x7f96ac199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.070+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96a4005940 tx=0x7f96a40042f0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 shutdown_connections 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f96940b5370 0x7f96940b7830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96ac10d100 0x7f96ac19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96ac1045c0 0x7f96ac199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 --2- 172.21.15.39:0/589728397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96ac103ca0 0x7f96ac199200 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:38.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 >> 172.21.15.39:0/589728397 conn(0x7f96ac0fd700 msgr2=0x7f96ac10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:38.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 shutdown_connections 2024-09-10T21:54:38.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:38.071+0000 7f96b36ed640 1 -- 172.21.15.39:0/589728397 wait complete. 2024-09-10T21:54:38.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T21:54:38.969 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:39.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:39 smithi039 ceph-mon[30872]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:39.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:39 smithi070 ceph-mon[34909]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 -- 172.21.15.39:0/1497695138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b8103bb0 msgr2=0x7ff2b8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/1497695138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b8103bb0 0x7ff2b8103f90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 -- 172.21.15.39:0/1497695138 shutdown_connections 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/1497695138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/1497695138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b81045b0 0x7ff2b810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/1497695138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b8103bb0 0x7ff2b8103f90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 -- 172.21.15.39:0/1497695138 >> 172.21.15.39:0/1497695138 conn(0x7ff2b80fd700 msgr2=0x7ff2b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 -- 172.21.15.39:0/1497695138 shutdown_connections 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.444+0000 7ff2bcf33640 1 -- 172.21.15.39:0/1497695138 wait complete. 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 Processor -- start 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 -- start start 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 0x7ff2b81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8112d80 con 0x7ff2b81045b0 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8112c00 con 0x7ff2b8103bb0 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2bcf33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8112f00 con 0x7ff2b810d160 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2b5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2b5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60308/0 (socket says 172.21.15.39:60308) 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.445+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/2215363012 learned_addr learned my addr 172.21.15.39:0/2215363012 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:39.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b659c640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 0x7ff2b81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/2215363012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 msgr2=0x7ff2b819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b819ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/2215363012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 msgr2=0x7ff2b81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 0x7ff2b81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/2215363012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b819f3a0 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b659c640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 0x7ff2b81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000d950 tx=0x7ff2a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2af7fe640 1 -- 172.21.15.39:0/2215363012 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0017070 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2af7fe640 1 -- 172.21.15.39:0/2215363012 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a0009c30 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b819f690 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2af7fe640 1 -- 172.21.15.39:0/2215363012 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000f620 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.446+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b81a5d50 con 0x7ff2b81045b0 2024-09-10T21:54:39.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2af7fe640 1 -- 172.21.15.39:0/2215363012 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff2a0010460 con 0x7ff2b81045b0 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 Processor -- start 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 -- start start 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b9906520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b99129f0 0x5571b9914de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5571b9879c10 con 0x5571b9906a60 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571b9869040 con 0x5571b99129f0 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2bf308740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571b986ce50 con 0x5571b9906140 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.449+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60318/0 (socket says 172.21.15.39:60318) 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 -- 172.21.15.39:0/3962400906 learned_addr learned my addr 172.21.15.39:0/3962400906 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b9906520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2af7fe640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 0x7ff2a40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b99129f0 0x5571b9914de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 -- 172.21.15.39:0/3962400906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 msgr2=0x5571b9906520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b9906520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 -- 172.21.15.39:0/3962400906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b99129f0 msgr2=0x5571b9914de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b99129f0 0x5571b9914de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 -- 172.21.15.39:0/3962400906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571b95c7540 con 0x5571b9906a60 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 0x7ff2a40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2af7fe640 1 -- 172.21.15.39:0/2215363012 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff2a00e5aa0 con 0x7ff2b81045b0 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b0032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca7ef8db84de6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2acff9640 1 -- 172.21.15.39:0/3962400906 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b003f070 con 0x5571b9906a60 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2acff9640 1 -- 172.21.15.39:0/3962400906 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00316a0 con 0x5571b9906a60 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.450+0000 7ff2acff9640 1 -- 172.21.15.39:0/3962400906 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0035070 con 0x5571b9906a60 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 -- 172.21.15.39:0/3962400906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 msgr2=0x5571b99124b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b0032cd0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 0x7ff2a40b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2b806c5d0 tx=0x7ff2a8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 -- 172.21.15.39:0/3962400906 shutdown_connections 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b99129f0 0x5571b9914de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b99124b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3962400906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b9906520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 -- 172.21.15.39:0/3962400906 >> 172.21.15.39:0/3962400906 conn(0x5571b9903f70 msgr2=0x5571b9905110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 -- 172.21.15.39:0/3962400906 shutdown_connections 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.451+0000 7ff2bf308740 1 -- 172.21.15.39:0/3962400906 wait complete. 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 -- start start 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 Processor -- start 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b990f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5571b96ca5f0 con 0x5571b99129f0 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571b9804010 con 0x5571b9906a60 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571b9915610 con 0x5571b9906140 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2bf308740 10 client.0 _ll_register_callbacks cb 0x5571b9863340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b990f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60320/0 (socket says 172.21.15.39:60320) 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 -- 172.21.15.39:0/427733635 learned_addr learned my addr 172.21.15.39:0/427733635 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 -- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 msgr2=0x5571b990f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b990f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 -- 172.21.15.39:0/427733635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 msgr2=0x5571b990fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.452+0000 7ff2b6d9d640 1 -- 172.21.15.39:0/427733635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571b9831a00 con 0x5571b99129f0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8013750 tx=0x7ff2a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47b415bde15cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004d20 con 0x5571b99129f0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff2a801e870 con 0x5571b99129f0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b00316a0 con 0x5571b99129f0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff2a801ea70 con 0x5571b99129f0 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 10 client.15279 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:39.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5571b9921200 con 0x5571b99129f0 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00316a0 con 0x5571b99129f0 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7ff2a800f040 con 0x5571b99129f0 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 10 client.15279 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 10 client.15279 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 20 client.15279 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.453+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9923880 0x5571b9924cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.454+0000 7ff2bf308740 4 client.15279 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.454+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571b987bb60 con 0x5571b9923880 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.454+0000 7ff2b659c640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9923880 0x5571b9924cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.454+0000 7ff2b659c640 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9923880 0x5571b9924cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=825241f5c38a02af server_cookie=77ca02ff7fef5f79 in_seq=0 out_seq=0 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.454+0000 7ff29dffb640 10 client.15279 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff29dffb640 1 -- 172.21.15.39:0/427733635 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571b987bb60 con 0x5571b9923880 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff29dffb640 10 client.15279 handle_command_reply: tid=0 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 client.15279 shutdown 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 msgr2=0x5571b99103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8013750 tx=0x7ff2a8004ab0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 shutdown_connections 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9923880 0x5571b9924cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b99129f0 0x5571b99103d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff29dffb640 0 client.15279 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 --2- 172.21.15.39:0/427733635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b9906140 0x5571b990f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.455+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 >> 172.21.15.39:0/427733635 conn(0x5571b9903f70 msgr2=0x5571b98fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.456+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 shutdown_connections 2024-09-10T21:54:39.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.456+0000 7ff2bf308740 1 -- 172.21.15.39:0/427733635 wait complete. 2024-09-10T21:54:39.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.456+0000 7ff2bf308740 20 client.15279 trim_cache size 0 max 16384 2024-09-10T21:54:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 Processor -- start 2024-09-10T21:54:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 -- start start 2024-09-10T21:54:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b990b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5571b9923030 con 0x5571b9906140 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571b9923700 con 0x5571b9906a60 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2bf308740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571b9923dd0 con 0x5571b99129f0 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60328/0 (socket says 172.21.15.39:60328) 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2b659c640 1 -- 172.21.15.39:0/3735639646 learned_addr learned my addr 172.21.15.39:0/3735639646 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.474+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b990b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 -- 172.21.15.39:0/3735639646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 msgr2=0x5571b990b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b990b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 -- 172.21.15.39:0/3735639646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 msgr2=0x5571b990ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 -- 172.21.15.39:0/3735639646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571b99049f0 con 0x5571b9906140 2024-09-10T21:54:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031440 tx=0x7ff2b0005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08d9174ba6166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff29ffff640 1 -- 172.21.15.39:0/3735639646 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b003f040 con 0x5571b9906140 2024-09-10T21:54:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff29ffff640 1 -- 172.21.15.39:0/3735639646 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00318d0 con 0x5571b9906140 2024-09-10T21:54:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.475+0000 7ff29ffff640 1 -- 172.21.15.39:0/3735639646 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0035040 con 0x5571b9906140 2024-09-10T21:54:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- 172.21.15.39:0/3735639646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 msgr2=0x5571b99226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031440 tx=0x7ff2b0005370 comp rx=0 tx=0).stop 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- 172.21.15.39:0/3735639646 shutdown_connections 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b990b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906a60 0x5571b990ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3735639646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906140 0x5571b99226c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- 172.21.15.39:0/3735639646 >> 172.21.15.39:0/3735639646 conn(0x5571b9903f70 msgr2=0x5571b98fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- 172.21.15.39:0/3735639646 shutdown_connections 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- 172.21.15.39:0/3735639646 wait complete. 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- start start 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 Processor -- start 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 0x5571b9927790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b9929a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5571b9924b70 con 0x5571b9906a60 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571b99244a0 con 0x5571b9906140 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.476+0000 7ff2bf308740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571b9925240 con 0x5571b99129f0 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2bf308740 10 client.0 _ll_register_callbacks cb 0x7ff2a8009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60330/0 (socket says 172.21.15.39:60330) 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/3669995775 learned_addr learned my addr 172.21.15.39:0/3669995775 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 0x5571b9927790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b6d9d640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b9929a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 msgr2=0x5571b9929a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b9929a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/3669995775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 msgr2=0x5571b9927790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 0x5571b9927790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 -- 172.21.15.39:0/3669995775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571b992a050 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 0x5571b9927790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2b5d9b640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00e39e0 tx=0x7ff2a00e38e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763eb90dc6d56995 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff29dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0020040 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff2a00ab570 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.477+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b00318d0 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff2a00ac810 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 10 client.15285 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5571b9990a80 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00318d0 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7ff2a00cdaf0 con 0x5571b9906a60 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 10 client.15285 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:39.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 10 client.15285 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 20 client.15285 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9995660 0x5571b9994370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 4 client.15285 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "status"}) -- 0x5571b9877610 con 0x5571b9995660 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.478+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9995660 0x5571b9994370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff29dffb640 10 client.15285 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:39.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2b659c640 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9995660 0x5571b9994370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c536eb621c72c07 server_cookie=d7efcda821921a32 in_seq=0 out_seq=0 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff29dffb640 1 -- 172.21.15.39:0/3669995775 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5571b9877610 con 0x5571b9995660 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff29dffb640 10 client.15285 handle_command_reply: tid=0 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 client.15285 shutdown 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 msgr2=0x5571b9927cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00e39e0 tx=0x7ff2a00e38e0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 shutdown_connections 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5571b9995660 0x5571b9994370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571b99129f0 0x5571b9929a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b9906a60 0x5571b9927cd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 --2- 172.21.15.39:0/3669995775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571b9906140 0x5571b9927790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 >> 172.21.15.39:0/3669995775 conn(0x5571b9903f70 msgr2=0x5571b990ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff29dffb640 0 client.15285 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 shutdown_connections 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 1 -- 172.21.15.39:0/3669995775 wait complete. 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.479+0000 7ff2bf308740 20 client.15285 trim_cache size 0 max 16384 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:39.486 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24583, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 91.411178745000001, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 117.19172095 2024-09-10T21:54:39.487 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 msgr2=0x7ff2a40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 0x7ff2a40b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2b806c5d0 tx=0x7ff2a8004a40 comp rx=0 tx=0).stop 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 msgr2=0x7ff2b8199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000d950 tx=0x7ff2a000de10 comp rx=0 tx=0).stop 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 shutdown_connections 2024-09-10T21:54:39.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff2a40b5370 0x7ff2a40b7830 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2b810d160 0x7ff2b819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b81045b0 0x7ff2b8199830 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 --2- 172.21.15.39:0/2215363012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b8103bb0 0x7ff2b81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 >> 172.21.15.39:0/2215363012 conn(0x7ff2b80fd700 msgr2=0x7ff2b80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 shutdown_connections 2024-09-10T21:54:39.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:39.480+0000 7ff2bcf33640 1 -- 172.21.15.39:0/2215363012 wait complete. 2024-09-10T21:54:39.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:39 smithi173 ceph-mon[35294]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:54:40.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T21:54:40.354 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 -- 172.21.15.39:0/3833764156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd701087d0 msgr2=0x7efd70108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 --2- 172.21.15.39:0/3833764156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd701087d0 0x7efd70108c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd60009900 tx=0x7efd6002a410 comp rx=0 tx=0).stop 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 -- 172.21.15.39:0/3833764156 shutdown_connections 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 --2- 172.21.15.39:0/3833764156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 --2- 172.21.15.39:0/3833764156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd701087d0 0x7efd70108c10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 --2- 172.21.15.39:0/3833764156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd70102dc0 0x7efd701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.765+0000 7efd785ed640 1 -- 172.21.15.39:0/3833764156 >> 172.21.15.39:0/3833764156 conn(0x7efd700fe830 msgr2=0x7efd70100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.766+0000 7efd785ed640 1 -- 172.21.15.39:0/3833764156 shutdown_connections 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.766+0000 7efd785ed640 1 -- 172.21.15.39:0/3833764156 wait complete. 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.766+0000 7efd785ed640 1 Processor -- start 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.766+0000 7efd785ed640 1 -- start start 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 0x7efd70199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112df0 con 0x7efd70102dc0 2024-09-10T21:54:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112c70 con 0x7efd70109150 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112f70 con 0x7efd701087d0 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34280/0 (socket says 172.21.15.39:34280) 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 -- 172.21.15.39:0/42474348 learned_addr learned my addr 172.21.15.39:0/42474348 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76b8a640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd75b88640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 0x7efd70199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 -- 172.21.15.39:0/42474348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 msgr2=0x7efd70199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 0x7efd70199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 -- 172.21.15.39:0/42474348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 msgr2=0x7efd7019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 -- 172.21.15.39:0/42474348 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7019f2d0 con 0x7efd70102dc0 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd75b88640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 0x7efd70199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76b8a640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd76389640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c920 tx=0x7efd6c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd677fe640 1 -- 172.21.15.39:0/42474348 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c007c70 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd677fe640 1 -- 172.21.15.39:0/42474348 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6c007e10 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7019f5c0 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd677fe640 1 -- 172.21.15.39:0/42474348 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c018820 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.767+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a5c80 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.770+0000 7efd677fe640 1 -- 172.21.15.39:0/42474348 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7efd6c00f450 con 0x7efd70102dc0 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.770+0000 7efd7a9c2740 1 Processor -- start 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.770+0000 7efd7a9c2740 1 -- start start 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1cfe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d10de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564df1c75c10 con 0x564df1cfe650 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564df1c65040 con 0x564df1cfdd30 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564df1c68e50 con 0x564df1d0e9f0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34284/0 (socket says 172.21.15.39:34284) 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 -- 172.21.15.39:0/3426043728 learned_addr learned my addr 172.21.15.39:0/3426043728 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd677fe640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 0x7efd5c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd75b88640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d10de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76b8a640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1cfe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76b8a640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 0x7efd5c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd677fe640 1 -- 172.21.15.39:0/42474348 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efd6c0e5fe0 con 0x7efd70102dc0 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 -- 172.21.15.39:0/3426043728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 msgr2=0x564df1d10de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d10de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 -- 172.21.15.39:0/3426043728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 msgr2=0x564df1cfe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1cfe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76389640 1 -- 172.21.15.39:0/3426043728 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df19c3540 con 0x564df1cfe650 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd76b8a640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1cfe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.771+0000 7efd75b88640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d10de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.772+0000 7efd76389640 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a9860 tx=0x7efd6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e800cdfb7bb3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.772+0000 7efd76b8a640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 0x7efd5c0b7830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd68005c40 tx=0x7efd68009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.772+0000 7efd64ff9640 1 -- 172.21.15.39:0/3426043728 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0ac100 con 0x564df1cfe650 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.772+0000 7efd64ff9640 1 -- 172.21.15.39:0/3426043728 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6c0accf0 con 0x564df1cfe650 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.772+0000 7efd64ff9640 1 -- 172.21.15.39:0/3426043728 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0a8a00 con 0x564df1cfe650 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3426043728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 msgr2=0x564df1d0e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a9860 tx=0x7efd6c000bc0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3426043728 shutdown_connections 2024-09-10T21:54:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d10de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1d0e4b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3426043728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1cfe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3426043728 >> 172.21.15.39:0/3426043728 conn(0x564df1cfbb60 msgr2=0x564df1cfcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3426043728 shutdown_connections 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3426043728 wait complete. 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 -- start start 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.773+0000 7efd7a9c2740 1 Processor -- start 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d0bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564df1ac65f0 con 0x564df1cfdd30 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564df1c00010 con 0x564df1cfe650 2024-09-10T21:54:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564df1d11610 con 0x564df1d0e9f0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 10 client.0 _ll_register_callbacks cb 0x564df1c5f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34292/0 (socket says 172.21.15.39:34292) 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 -- 172.21.15.39:0/3994378924 learned_addr learned my addr 172.21.15.39:0/3994378924 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76b8a640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd75b88640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d0bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 -- 172.21.15.39:0/3994378924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 msgr2=0x564df1d0c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d0c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 -- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 msgr2=0x564df1d0bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d0bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 -- 172.21.15.39:0/3994378924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df1c2da00 con 0x564df1cfdd30 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76b8a640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd76389640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a6c20 tx=0x7efd6c0ac050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96afb207f6e5f46c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0ac5f0 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efd6c0ac850 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd6c0accf0 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.774+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd6c0b10d0 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 10 client.15297 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564df1d1d200 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6c0accf0 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7efd6c0e9110 con 0x564df1cfdd30 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 10 client.15297 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 20 client.15297 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d1e550 0x564df1d20630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 4 client.15297 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564df1c77b60 con 0x564df1d1e550 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.775+0000 7efd75b88640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d1e550 0x564df1d20630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.776+0000 7efd59ffb640 10 client.15297 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.776+0000 7efd75b88640 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d1e550 0x564df1d20630 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86bfbd341140a2cb server_cookie=2a2e2d21d2a1d4 in_seq=0 out_seq=0 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.776+0000 7efd59ffb640 1 -- 172.21.15.39:0/3994378924 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564df1c77b60 con 0x564df1d1e550 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.776+0000 7efd59ffb640 10 client.15297 handle_command_reply: tid=0 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 client.15297 shutdown 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 msgr2=0x564df1d0b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a6c20 tx=0x7efd6c0ac050 comp rx=0 tx=0).stop 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 shutdown_connections 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d1e550 0x564df1d20630 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d0bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd59ffb640 0 client.15297 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/3994378924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d0b9f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 >> 172.21.15.39:0/3994378924 conn(0x564df1cfbb60 msgr2=0x564df1d01700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 shutdown_connections 2024-09-10T21:54:40.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 1 -- 172.21.15.39:0/3994378924 wait complete. 2024-09-10T21:54:40.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.777+0000 7efd7a9c2740 20 client.15297 trim_cache size 0 max 16384 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 Processor -- start 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 -- start start 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1d09480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1cfcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564df1d1e970 con 0x564df1cfe650 2024-09-10T21:54:40.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564df1d1f040 con 0x564df1cfdd30 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564df1d1f710 con 0x564df1d0e9f0 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34306/0 (socket says 172.21.15.39:34306) 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 -- 172.21.15.39:0/1082310953 learned_addr learned my addr 172.21.15.39:0/1082310953 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd76389640 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1d09480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 -- 172.21.15.39:0/1082310953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 msgr2=0x564df1cfcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1cfcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 -- 172.21.15.39:0/1082310953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 msgr2=0x564df1d09480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1d09480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd75b88640 1 -- 172.21.15.39:0/1082310953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df1cfe480 con 0x564df1cfe650 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.798+0000 7efd76389640 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1d09480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.799+0000 7efd75b88640 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd60031440 tx=0x7efd60005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7304213cdc3590db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.799+0000 7efd5bfff640 1 -- 172.21.15.39:0/1082310953 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60035040 con 0x564df1cfe650 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.799+0000 7efd5bfff640 1 -- 172.21.15.39:0/1082310953 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd600054f0 con 0x564df1cfe650 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.799+0000 7efd5bfff640 1 -- 172.21.15.39:0/1082310953 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd600035f0 con 0x564df1cfe650 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1082310953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 msgr2=0x564df1cfc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd60031440 tx=0x7efd60005b70 comp rx=0 tx=0).stop 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1082310953 shutdown_connections 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1cfcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfe650 0x564df1cfc9e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1082310953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfdd30 0x564df1d09480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1082310953 >> 172.21.15.39:0/1082310953 conn(0x564df1cfbb60 msgr2=0x564df1d0fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1082310953 shutdown_connections 2024-09-10T21:54:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1082310953 wait complete. 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 -- start start 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.800+0000 7efd7a9c2740 1 Processor -- start 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d23bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564df1d204b0 con 0x564df1cfdd30 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564df1d1fde0 con 0x564df1cfe650 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564df1d20b80 con 0x564df1d0e9f0 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd7a9c2740 10 client.0 _ll_register_callbacks cb 0x7efd6c0e3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34320/0 (socket says 172.21.15.39:34320) 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 -- 172.21.15.39:0/1719544378 learned_addr learned my addr 172.21.15.39:0/1719544378 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd75b88640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d23bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76b8a640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 -- 172.21.15.39:0/1719544378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 msgr2=0x564df1d286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d286d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 -- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 msgr2=0x564df1d23bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d23bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 -- 172.21.15.39:0/1719544378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df1d24470 con 0x564df1cfdd30 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd75b88640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d23bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd76389640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a8b70 tx=0x7efd6c0b5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662464b6a6103145 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.801+0000 7efd59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0a8490 con 0x564df1cfdd30 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efd6c0aca50 con 0x564df1cfdd30 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd600054f0 con 0x564df1cfdd30 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd6c0accf0 con 0x564df1cfdd30 2024-09-10T21:54:40.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd7a9c2740 10 client.15303 fetch_fsmap learned FSMap version 26 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564df1d8c080 con 0x564df1cfdd30 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd600054f0 con 0x564df1cfdd30 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7efd6c0ab2c0 con 0x564df1cfdd30 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.802+0000 7efd7a9c2740 10 client.15303 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd7a9c2740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd7a9c2740 20 client.15303 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d909d0 0x564df1d8f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd7a9c2740 4 client.15303 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "status"}) -- 0x564df1c73610 con 0x564df1d909d0 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd75b88640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d909d0 0x564df1d8f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd75b88640 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d909d0 0x564df1d8f6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30237cfa93370496 server_cookie=cd6e15b436f0c53d in_seq=0 out_seq=0 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.803+0000 7efd59ffb640 10 client.15303 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd59ffb640 1 -- 172.21.15.39:0/1719544378 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x564df1c73610 con 0x564df1d909d0 2024-09-10T21:54:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd59ffb640 10 client.15303 handle_command_reply: tid=0 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 client.15303 shutdown 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 msgr2=0x564df1d23680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0a8b70 tx=0x7efd6c0b5760 comp rx=0 tx=0).stop 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 shutdown_connections 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564df1d909d0 0x564df1d8f6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564df1d0e9f0 0x564df1d286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564df1cfe650 0x564df1d23bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 --2- 172.21.15.39:0/1719544378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564df1cfdd30 0x564df1d23680 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd59ffb640 0 client.15303 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 >> 172.21.15.39:0/1719544378 conn(0x564df1cfbb60 msgr2=0x564df1cfc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 shutdown_connections 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 1 -- 172.21.15.39:0/1719544378 wait complete. 2024-09-10T21:54:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.804+0000 7efd7a9c2740 20 client.15303 trim_cache size 0 max 16384 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "c8786c20-6fbd-11ef-bcea-c7b262605968", 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24590, 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 99.78872518, 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 26, 2024-09-10T21:54:40.814 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 73, 2024-09-10T21:54:40.815 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 71, 2024-09-10T21:54:40.815 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 110.053273281 2024-09-10T21:54:40.815 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 msgr2=0x7efd5c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 0x7efd5c0b7830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd68005c40 tx=0x7efd68009500 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 msgr2=0x7efd70199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c920 tx=0x7efd6c00cde0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 shutdown_connections 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efd5c0b5370 0x7efd5c0b7830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70109150 0x7efd7019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd701087d0 0x7efd70199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 --2- 172.21.15.39:0/42474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd70102dc0 0x7efd70199220 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 >> 172.21.15.39:0/42474348 conn(0x7efd700fe830 msgr2=0x7efd70100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 shutdown_connections 2024-09-10T21:54:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:40.805+0000 7efd785ed640 1 -- 172.21.15.39:0/42474348 wait complete. 2024-09-10T21:54:41.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:41 smithi070 ceph-mon[34909]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:41.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:41 smithi039 ceph-mon[30872]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:41.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:41 smithi173 ceph-mon[35294]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T21:54:41.585 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T21:54:41.661 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T21:54:41.661 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T21:54:41.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:41.662 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-10T21:54:41.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:41.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-10T21:54:41.749 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-09-10T21:54:41.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:54:41.751 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T21:54:41.751 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:54:41.751 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:41.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T21:54:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:42.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:42 smithi039 ceph-mon[30872]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:42.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.576+0000 7f884919b640 1 -- 172.21.15.39:0/2931373348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88441076a0 msgr2=0x7f8844107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.576+0000 7f884919b640 1 --2- 172.21.15.39:0/2931373348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88441076a0 0x7f8844107ae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8838009900 tx=0x7f883802a410 comp rx=0 tx=0).stop 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.576+0000 7f884919b640 1 -- 172.21.15.39:0/2931373348 shutdown_connections 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.576+0000 7f884919b640 1 --2- 172.21.15.39:0/2931373348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 0x7f884410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 --2- 172.21.15.39:0/2931373348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88441076a0 0x7f8844107ae0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 --2- 172.21.15.39:0/2931373348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8844101c90 0x7f8844102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 -- 172.21.15.39:0/2931373348 >> 172.21.15.39:0/2931373348 conn(0x7f88440fd700 msgr2=0x7f88440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 -- 172.21.15.39:0/2931373348 shutdown_connections 2024-09-10T21:54:42.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 -- 172.21.15.39:0/2931373348 wait complete. 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.577+0000 7f884919b640 1 Processor -- start 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 -- start start 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88441076a0 0x7f884419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 0x7f88441a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8844111d20 con 0x7f8844101c90 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8844111ba0 con 0x7f8844108020 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884919b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8844111ea0 con 0x7f88441076a0 2024-09-10T21:54:42.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f8842d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f8842d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34332/0 (socket says 172.21.15.39:34332) 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f8842d9d640 1 -- 172.21.15.39:0/3914126739 learned_addr learned my addr 172.21.15.39:0/3914126739 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884359e640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 0x7f88441a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.578+0000 7f884259c640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88441076a0 0x7f884419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 -- 172.21.15.39:0/3914126739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88441076a0 msgr2=0x7f884419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88441076a0 0x7f884419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 -- 172.21.15.39:0/3914126739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 msgr2=0x7f88441a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 0x7f88441a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 -- 172.21.15.39:0/3914126739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88441a16a0 con 0x7f8844101c90 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f883400b4a0 tx=0x7f883400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834014070 con 0x7f8844101c90 2024-09-10T21:54:42.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88441a1990 con 0x7f8844101c90 2024-09-10T21:54:42.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834010ac0 con 0x7f8844101c90 2024-09-10T21:54:42.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834017c30 con 0x7f8844101c90 2024-09-10T21:54:42.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.579+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441a8220 con 0x7f8844101c90 2024-09-10T21:54:42.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.580+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88441020f0 con 0x7f8844101c90 2024-09-10T21:54:42.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.582+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8834010610 con 0x7f8844101c90 2024-09-10T21:54:42.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.582+0000 7f882bfff640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 0x7f882c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:42.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.583+0000 7f884259c640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 0x7f882c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:42.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.583+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f88340e55a0 con 0x7f8844101c90 2024-09-10T21:54:42.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.583+0000 7f884259c640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 0x7f882c0b78b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8838031440 tx=0x7f88380095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:42.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.586+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88340ac310 con 0x7f8844101c90 2024-09-10T21:54:42.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:42 smithi070 ceph-mon[34909]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:42.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:42 smithi173 ceph-mon[35294]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:42.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.812+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88441a8500 con 0x7f8844101c90 2024-09-10T21:54:42.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.812+0000 7f882bfff640 1 -- 172.21.15.39:0/3914126739 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f88340abc10 con 0x7f8844101c90 2024-09-10T21:54:42.814 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T21:54:42.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 msgr2=0x7f882c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:42.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 0x7f882c0b78b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8838031440 tx=0x7f88380095f0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 msgr2=0x7f884419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f883400b4a0 tx=0x7f883400b960 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 shutdown_connections 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f882c0b53f0 0x7f882c0b78b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8844108020 0x7f88441a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88441076a0 0x7f884419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 --2- 172.21.15.39:0/3914126739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844101c90 0x7f884419b5f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 >> 172.21.15.39:0/3914126739 conn(0x7f88440fd700 msgr2=0x7f8844104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.814+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 shutdown_connections 2024-09-10T21:54:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:42.815+0000 7f884919b640 1 -- 172.21.15.39:0/3914126739 wait complete. 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:43.412 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:54:43.413 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:54:43.413 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:54:43.413 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:54:43.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:43.413 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-09-10T21:54:43.430 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:54:43.430 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-09-10T21:54:43.431 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42162sec preferred_lft 42162sec 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:54:43.432 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-09-10T21:54:43.432 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T21:54:43.432 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:54:43.432 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-10T21:54:43.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-09-10T21:54:43.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-09-10T21:54:43.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-09-10T21:54:43.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T21:54:43.433 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-10T21:54:43.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:43.532 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:43 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3914126739' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:54:43.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:43.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:43.651 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:54:43.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:43 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3914126739' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:54:43.676 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-09-10T21:54:43.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:43.678 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-09-10T21:54:43.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:43 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3914126739' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:54:43.743 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-09-10T21:54:43.743 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:54:43.743 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T21:54:43.743 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T21:54:43.743 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:54:43.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:54:43.744 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-10T21:54:43.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T21:54:43.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T21:54:43.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T21:54:43.745 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-10T21:54:43.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:44.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:44.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:44.051 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-10T21:54:44.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:44.068 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-09-10T21:54:44.124 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:54:44.124 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-10T21:54:44.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:54:44.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T21:54:44.124 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-10T21:54:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:44.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:44.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T21:54:44.246 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-10T21:54:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:44.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:54:44.376 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-10T21:54:44.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-09-10T21:54:44.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T21:54:44.377 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-10T21:54:44.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:44.435 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:44 smithi039 ceph-mon[30872]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:44.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:44.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:54:44.456 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:44.472 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:54:44.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:54:44.472 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:44.528 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T21:54:44.528 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T21:54:44.528 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 2024-09-10T21:54:44.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:44.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T21:54:44.630 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T21:54:44.631 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-10T21:54:44.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:44 smithi070 ceph-mon[34909]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:44.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:44 smithi173 ceph-mon[35294]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T21:54:44.767 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T21:54:44.767 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-10T21:54:44.768 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.70:3300,172.21.15.173:3300" 2024-09-10T21:54:44.768 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with new device syntax: 0@c8786c20-6fbd-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 2024-09-10T21:54:44.768 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.39:3300/172.21.15.70:3300/172.21.15.173:3300" will pass to kernel 2024-09-10T21:54:44.769 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T21:54:44.769 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-09-10T21:54:44.769 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T21:54:44.769 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T21:54:44.769 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T21:54:44.770 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T21:54:44.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:54:44.771 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:44.802 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:54:44.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:54:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:44.899 INFO:teuthology.orchestra.run.smithi039.stdout:client24991 2024-09-10T21:54:44.900 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:54:44.900 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:54:44.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:54:45.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:54:45.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:45.014 INFO:teuthology.orchestra.run.smithi039.stdout:client24991 2024-09-10T21:54:45.015 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:54:45.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:54:45.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:45.073 INFO:teuthology.orchestra.run.smithi039.stdout:client24991 2024-09-10T21:54:45.074 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968.client24991/status') 2024-09-10T21:54:45.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:54:45.134 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.24991 (3)172.21.15.39:0/2955760987 2024-09-10T21:54:45.135 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-09-10T21:54:45.135 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-09-10T21:54:45.135 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-09-10T21:54:45.135 INFO:teuthology.orchestra.run.smithi039.stderr:71 bytes copied, 2.7174e-05 s, 2.6 MB/s 2024-09-10T21:54:45.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:54:45.142 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T21:54:45.152 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T21:54:45.152 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T21:54:45.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 -- 172.21.15.39:0/106613976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501033c0 msgr2=0x7f9350109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 --2- 172.21.15.39:0/106613976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501033c0 0x7f9350109d40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9348009cd0 tx=0x7f934802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 -- 172.21.15.39:0/106613976 shutdown_connections 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 --2- 172.21.15.39:0/106613976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501033c0 0x7f9350109d40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 --2- 172.21.15.39:0/106613976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 0x7f9350102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.255+0000 7f9357a72640 1 --2- 172.21.15.39:0/106613976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501018b0 0x7f9350101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- 172.21.15.39:0/106613976 >> 172.21.15.39:0/106613976 conn(0x7f93500fd150 msgr2=0x7f93500ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- 172.21.15.39:0/106613976 shutdown_connections 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- 172.21.15.39:0/106613976 wait complete. 2024-09-10T21:54:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 Processor -- start 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- start start 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 0x7f9350199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501033c0 0x7f935019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f935010e6d0 con 0x7f93501018b0 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f935010e550 con 0x7f9350102a00 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.256+0000 7f9357a72640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f935010e850 con 0x7f93501033c0 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34348/0 (socket says 172.21.15.39:34348) 2024-09-10T21:54:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 -- 172.21.15.39:0/2474634762 learned_addr learned my addr 172.21.15.39:0/2474634762 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935500d640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 0x7f9350199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935600f640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501033c0 0x7f935019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 -- 172.21.15.39:0/2474634762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501033c0 msgr2=0x7f935019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501033c0 0x7f935019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 -- 172.21.15.39:0/2474634762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 msgr2=0x7f9350199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 0x7f9350199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 -- 172.21.15.39:0/2474634762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935019a970 con 0x7f93501018b0 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f935580e640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b4a0 tx=0x7f934c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:45.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c014070 con 0x7f93501018b0 2024-09-10T21:54:45.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934c010ac0 con 0x7f93501018b0 2024-09-10T21:54:45.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935019ac60 con 0x7f93501018b0 2024-09-10T21:54:45.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c017c30 con 0x7f93501018b0 2024-09-10T21:54:45.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.257+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93501a1330 con 0x7f93501018b0 2024-09-10T21:54:45.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.258+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9350108bc0 con 0x7f93501018b0 2024-09-10T21:54:45.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.260+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f934c010610 con 0x7f93501018b0 2024-09-10T21:54:45.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.260+0000 7f9346ffd640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 0x7f933c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.261+0000 7f935500d640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 0x7f933c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.261+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f934c0e56d0 con 0x7f93501018b0 2024-09-10T21:54:45.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.261+0000 7f935500d640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 0x7f933c0b7830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9340005d00 tx=0x7f9340005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:45.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.263+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f934c0ac440 con 0x7f93501018b0 2024-09-10T21:54:45.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.488+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f935002e5c0 con 0x7f93501018b0 2024-09-10T21:54:45.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.541+0000 7f9346ffd640 1 -- 172.21.15.39:0/2474634762 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f934c0abd40 con 0x7f93501018b0 2024-09-10T21:54:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 msgr2=0x7f933c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 0x7f933c0b7830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9340005d00 tx=0x7f9340005c50 comp rx=0 tx=0).stop 2024-09-10T21:54:45.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 msgr2=0x7f9350198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b4a0 tx=0x7f934c00b960 comp rx=0 tx=0).stop 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 shutdown_connections 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f933c0b5370 0x7f933c0b7830 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93501033c0 0x7f935019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9350102a00 0x7f9350199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 --2- 172.21.15.39:0/2474634762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93501018b0 0x7f9350198e30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.543+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 >> 172.21.15.39:0/2474634762 conn(0x7f93500fd150 msgr2=0x7f9350105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.544+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 shutdown_connections 2024-09-10T21:54:45.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.544+0000 7f9357a72640 1 -- 172.21.15.39:0/2474634762 wait complete. 2024-09-10T21:54:45.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-10T21:54:45.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 -- 172.21.15.39:0/3221759263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10301018b0 msgr2=0x7f1030101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 --2- 172.21.15.39:0/3221759263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10301018b0 0x7f1030101cb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f102c009930 tx=0x7f102c02a420 comp rx=0 tx=0).stop 2024-09-10T21:54:45.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 -- 172.21.15.39:0/3221759263 shutdown_connections 2024-09-10T21:54:45.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 --2- 172.21.15.39:0/3221759263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f1030109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 --2- 172.21.15.39:0/3221759263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1030102a00 0x7f1030102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 --2- 172.21.15.39:0/3221759263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10301018b0 0x7f1030101cb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 -- 172.21.15.39:0/3221759263 >> 172.21.15.39:0/3221759263 conn(0x7f10300fd150 msgr2=0x7f10300ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.660+0000 7f10374c6640 1 -- 172.21.15.39:0/3221759263 shutdown_connections 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 -- 172.21.15.39:0/3221759263 wait complete. 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 Processor -- start 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 -- start start 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10301018b0 0x7f1030198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f103019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f103010d600 con 0x7f1030102a00 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f103010d480 con 0x7f10301033c0 2024-09-10T21:54:45.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f10374c6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f103010d780 con 0x7f10301018b0 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f1034a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f1034a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34360/0 (socket says 172.21.15.39:34360) 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.661+0000 7f1034a61640 1 -- 172.21.15.39:0/902621447 learned_addr learned my addr 172.21.15.39:0/902621447 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1035262640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10301018b0 0x7f1030198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1035a63640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f103019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 -- 172.21.15.39:0/902621447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10301018b0 msgr2=0x7f1030198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10301018b0 0x7f1030198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 -- 172.21.15.39:0/902621447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 msgr2=0x7f103019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f103019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 -- 172.21.15.39:0/902621447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103019aac0 con 0x7f1030102a00 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1035a63640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f103019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f1034a61640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f102000b4a0 tx=0x7f102000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:45.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020014070 con 0x7f1030102a00 2024-09-10T21:54:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103019adb0 con 0x7f1030102a00 2024-09-10T21:54:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1020010ac0 con 0x7f1030102a00 2024-09-10T21:54:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020017c30 con 0x7f1030102a00 2024-09-10T21:54:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.662+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10301a1480 con 0x7f1030102a00 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.663+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10301a16b0 con 0x7f1030102a00 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.665+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f1020010610 con 0x7f1030102a00 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.665+0000 7f10267fc640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 0x7f101c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.665+0000 7f1035262640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 0x7f101c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.666+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f10200e56d0 con 0x7f1030102a00 2024-09-10T21:54:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.666+0000 7f1035262640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 0x7f101c0b7830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f102c006010 tx=0x7f102c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.668+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10200ac440 con 0x7f1030102a00 2024-09-10T21:54:45.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.879+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f10300ff3a0 con 0x7f101c0b5370 2024-09-10T21:54:45.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T21:54:45.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.897+0000 7f10267fc640 1 -- 172.21.15.39:0/902621447 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f10300ff3a0 con 0x7f101c0b5370 2024-09-10T21:54:45.899 INFO:teuthology.orchestra.run.smithi039.stdout:{} 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 msgr2=0x7f101c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 0x7f101c0b7830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f102c006010 tx=0x7f102c0314a0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 msgr2=0x7f10301995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f102000b4a0 tx=0x7f102000b960 comp rx=0 tx=0).stop 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 shutdown_connections 2024-09-10T21:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f101c0b5370 0x7f101c0b7830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10301033c0 0x7f103019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1030102a00 0x7f10301995d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 --2- 172.21.15.39:0/902621447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10301018b0 0x7f1030198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 >> 172.21.15.39:0/902621447 conn(0x7f10300fd150 msgr2=0x7f10300fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 shutdown_connections 2024-09-10T21:54:45.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:45.899+0000 7f10374c6640 1 -- 172.21.15.39:0/902621447 wait complete. 2024-09-10T21:54:45.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T21:54:45.912 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T21:54:45.922 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T21:54:45.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:54:45.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T21:54:46.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- 172.21.15.39:0/3463407658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 msgr2=0x7f45b4109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- 172.21.15.39:0/3463407658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b4109d30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009930 tx=0x7f45a402a420 comp rx=0 tx=0).stop 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- 172.21.15.39:0/3463407658 shutdown_connections 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- 172.21.15.39:0/3463407658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b4109d30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- 172.21.15.39:0/3463407658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41029f0 0x7f45b4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- 172.21.15.39:0/3463407658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41018a0 0x7f45b4101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- 172.21.15.39:0/3463407658 >> 172.21.15.39:0/3463407658 conn(0x7f45b40fd180 msgr2=0x7f45b40ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- 172.21.15.39:0/3463407658 shutdown_connections 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- 172.21.15.39:0/3463407658 wait complete. 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 Processor -- start 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- start start 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 0x7f45b406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41029f0 0x7f45b419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f45b410d510 con 0x7f45b41033b0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45b410d390 con 0x7f45b41018a0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.048+0000 7f45bb175640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f45b410d690 con 0x7f45b41029f0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34390/0 (socket says 172.21.15.39:34390) 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 -- 172.21.15.39:0/105268550 learned_addr learned my addr 172.21.15.39:0/105268550 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b3fff640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41029f0 0x7f45b419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b8f11640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 0x7f45b406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 -- 172.21.15.39:0/105268550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41029f0 msgr2=0x7f45b419da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41029f0 0x7f45b419da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 -- 172.21.15.39:0/105268550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 msgr2=0x7f45b406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 0x7f45b406acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 -- 172.21.15.39:0/105268550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b41a08d0 con 0x7f45b41033b0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b8f11640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 0x7f45b406acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b9712640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45a4031500 tx=0x7f45a4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a403f030 con 0x7f45b41033b0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45a4003aa0 con 0x7f45b41033b0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4035070 con 0x7f45b41033b0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.049+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b41a0b60 con 0x7f45b41033b0 2024-09-10T21:54:46.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.050+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b41a1050 con 0x7f45b41033b0 2024-09-10T21:54:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.050+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b4108b90 con 0x7f45b41033b0 2024-09-10T21:54:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.052+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f45a403bb70 con 0x7f45b41033b0 2024-09-10T21:54:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.053+0000 7f45b1ffb640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 0x7f45a00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.053+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f45a4106aa0 con 0x7f45b41033b0 2024-09-10T21:54:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.053+0000 7f45b8f11640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 0x7f45a00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.053+0000 7f45b8f11640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 0x7f45a00b7830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c20 tx=0x7f45ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.056+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f45a40cd810 con 0x7f45b41033b0 2024-09-10T21:54:46.173 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:54:45.884+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:54:46.173 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:54:45.884+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:54:46.173 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:54:45.884+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:54:46.173 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:54:45.884+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:54:46.173 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 21:54:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T21:54:45.884+0000 7f6da6ec1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:54:46.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.242+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45b402e810 con 0x7f45b41033b0 2024-09-10T21:54:46.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.244+0000 7f45b1ffb640 1 -- 172.21.15.39:0/105268550 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22652 (secure 0 0 0) 0x7f45a40cd110 con 0x7f45b41033b0 2024-09-10T21:54:46.246 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:46.246 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:44.535601+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:54:46.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 msgr2=0x7f45a00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 0x7f45a00b7830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c20 tx=0x7f45ac005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:46.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 msgr2=0x7f45b41a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45a4031500 tx=0x7f45a4031a50 comp rx=0 tx=0).stop 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 shutdown_connections 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f45a00b5370 0x7f45a00b7830 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45b41033b0 0x7f45b41a0010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b41029f0 0x7f45b419da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 --2- 172.21.15.39:0/105268550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45b41018a0 0x7f45b406acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 >> 172.21.15.39:0/105268550 conn(0x7f45b40fd180 msgr2=0x7f45b4105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 shutdown_connections 2024-09-10T21:54:46.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.246+0000 7f45bb175640 1 -- 172.21.15.39:0/105268550 wait complete. 2024-09-10T21:54:46.259 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:48:27.848097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T21:52:56.779900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T21:52:58.502820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:54:46.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T21:54:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3183467969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 msgr2=0x7fb7e4105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3183467969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4105530 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009ca0 tx=0x7fb7d402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3183467969 shutdown_connections 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3183467969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3183467969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3183467969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4105530 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.364+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3183467969 >> 172.21.15.39:0/3183467969 conn(0x7fb7e40fd140 msgr2=0x7fb7e40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3183467969 shutdown_connections 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3183467969 wait complete. 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 Processor -- start 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- start start 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e410e5a0 con 0x7fb7e406afc0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e410e420 con 0x7fb7e4105ac0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7eb9d3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e410e720 con 0x7fb7e4108670 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7e976f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7e976f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34398/0 (socket says 172.21.15.39:34398) 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.365+0000 7fb7e976f640 1 -- 172.21.15.39:0/3672161326 learned_addr learned my addr 172.21.15.39:0/3672161326 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e9f70640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e8f6e640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 -- 172.21.15.39:0/3672161326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 msgr2=0x7fb7e419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 -- 172.21.15.39:0/3672161326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 msgr2=0x7fb7e41993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e41993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 -- 172.21.15.39:0/3672161326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e419a8c0 con 0x7fb7e406afc0 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e9f70640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e8f6e640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e41993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e976f640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4006010 tx=0x7fb7d4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d402f380 con 0x7fb7e406afc0 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e419ab50 con 0x7fb7e406afc0 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7d40317c0 con 0x7fb7e406afc0 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d402fc60 con 0x7fb7e406afc0 2024-09-10T21:54:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.366+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e41a1280 con 0x7fb7e406afc0 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.367+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e40fec30 con 0x7fb7e406afc0 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.368+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb7d4004040 con 0x7fb7e406afc0 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.369+0000 7fb7e27fc640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 0x7fb7cc0b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.369+0000 7fb7e8f6e640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 0x7fb7cc0b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.369+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb7d41072d0 con 0x7fb7e406afc0 2024-09-10T21:54:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.370+0000 7fb7e8f6e640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 0x7fb7cc0b79d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009b50 tx=0x7fb7d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.372+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7d40ce040 con 0x7fb7e406afc0 2024-09-10T21:54:46.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.545+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb7d40c9bb0 con 0x7fb7e406afc0 2024-09-10T21:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.563+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7e4063d50 con 0x7fb7e406afc0 2024-09-10T21:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.563+0000 7fb7e27fc640 1 -- 172.21.15.39:0/3672161326 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fb7d40c1820 con 0x7fb7e406afc0 2024-09-10T21:54:46.566 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 msgr2=0x7fb7cc0b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 0x7fb7cc0b79d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009b50 tx=0x7fb7d8005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 msgr2=0x7fb7e4198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4006010 tx=0x7fb7d4003ba0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 shutdown_connections 2024-09-10T21:54:46.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7cc0b5510 0x7fb7cc0b79d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e4108670 0x7fb7e419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7e4105ac0 0x7fb7e41993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 --2- 172.21.15.39:0/3672161326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e406afc0 0x7fb7e4198d80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 >> 172.21.15.39:0/3672161326 conn(0x7fb7e40fd140 msgr2=0x7fb7e4103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 shutdown_connections 2024-09-10T21:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.566+0000 7fb7eb9d3640 1 -- 172.21.15.39:0/3672161326 wait complete. 2024-09-10T21:54:46.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 -- 172.21.15.39:0/930995260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac105e90 msgr2=0x7fecac108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 --2- 172.21.15.39:0/930995260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac105e90 0x7fecac108280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009900 tx=0x7fec9c02a410 comp rx=0 tx=0).stop 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 -- 172.21.15.39:0/930995260 shutdown_connections 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 --2- 172.21.15.39:0/930995260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 0x7fecac10abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 --2- 172.21.15.39:0/930995260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac105e90 0x7fecac108280 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 --2- 172.21.15.39:0/930995260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac100dd0 0x7fecac1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 -- 172.21.15.39:0/930995260 >> 172.21.15.39:0/930995260 conn(0x7fecac0fc8d0 msgr2=0x7fecac0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 -- 172.21.15.39:0/930995260 shutdown_connections 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.683+0000 7fecb4507640 1 -- 172.21.15.39:0/930995260 wait complete. 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 Processor -- start 2024-09-10T21:54:46.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 -- start start 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac105e90 0x7fecac199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 0x7fecac199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10e5f0 con 0x7fecac100dd0 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10e470 con 0x7fecac1087c0 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb4507640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecac10e770 con 0x7fecac105e90 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34416/0 (socket says 172.21.15.39:34416) 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 -- 172.21.15.39:0/3995858904 learned_addr learned my addr 172.21.15.39:0/3995858904 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb1aa2640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac105e90 0x7fecac199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb2aa4640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 0x7fecac199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 -- 172.21.15.39:0/3995858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac105e90 msgr2=0x7fecac199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac105e90 0x7fecac199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 -- 172.21.15.39:0/3995858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 msgr2=0x7fecac199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 0x7fecac199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.684+0000 7fecb22a3640 1 -- 172.21.15.39:0/3995858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac19a850 con 0x7fecac100dd0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7fecb22a3640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feca800d770 tx=0x7feca800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8017070 con 0x7fecac100dd0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca80054d0 con 0x7fecac100dd0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac19ab40 con 0x7fecac100dd0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8004c30 con 0x7fecac100dd0 2024-09-10T21:54:46.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.685+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac1a1210 con 0x7fecac100dd0 2024-09-10T21:54:46.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.686+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac0fe3c0 con 0x7fecac100dd0 2024-09-10T21:54:46.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.687+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7feca8004e10 con 0x7fecac100dd0 2024-09-10T21:54:46.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.688+0000 7feca37fe640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 0x7fec980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:46.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.688+0000 7fecb1aa2640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 0x7fec980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:46.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.688+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7feca80e5610 con 0x7fecac100dd0 2024-09-10T21:54:46.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.689+0000 7fecb1aa2640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 0x7fec980b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000c00 tx=0x7fec9c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:46.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.692+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feca80abe90 con 0x7fecac100dd0 2024-09-10T21:54:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.878+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fecac063d50 con 0x7fecac100dd0 2024-09-10T21:54:46.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.878+0000 7feca37fe640 1 -- 172.21.15.39:0/3995858904 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) ==== 104+0+11 (secure 0 0 0) 0x7feca80b08c0 con 0x7fecac100dd0 2024-09-10T21:54:46.880 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-10T21:54:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 msgr2=0x7fec980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 0x7fec980b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000c00 tx=0x7fec9c0314a0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 msgr2=0x7fecac198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feca800d770 tx=0x7feca800dc30 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 shutdown_connections 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec980b52e0 0x7fec980b77a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecac1087c0 0x7fecac199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecac105e90 0x7fecac199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 --2- 172.21.15.39:0/3995858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecac100dd0 0x7fecac198d10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.880+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 >> 172.21.15.39:0/3995858904 conn(0x7fecac0fc8d0 msgr2=0x7fecac106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.881+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 shutdown_connections 2024-09-10T21:54:46.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.881+0000 7fecb4507640 1 -- 172.21.15.39:0/3995858904 wait complete. 2024-09-10T21:54:46.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:46.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T21:54:46.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:54:46.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:46.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/105268550' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:46.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:46 smithi039 ceph-mon[30872]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:54:46.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T21:54:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T21:54:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:54:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/105268550' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:46.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:46 smithi070 ceph-mon[34909]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:54:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:54:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2474634762' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T21:54:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:54:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:54:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/105268550' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:46.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:46 smithi173 ceph-mon[35294]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:54:47.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 -- 172.21.15.39:0/389325980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc104910 msgr2=0x7f43fc100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 --2- 172.21.15.39:0/389325980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc104910 0x7f43fc100a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009930 tx=0x7f43f002a420 comp rx=0 tx=0).stop 2024-09-10T21:54:47.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 -- 172.21.15.39:0/389325980 shutdown_connections 2024-09-10T21:54:47.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 --2- 172.21.15.39:0/389325980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc101160 0x7f43fc10afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 --2- 172.21.15.39:0/389325980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc104910 0x7f43fc100a40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 --2- 172.21.15.39:0/389325980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 -- 172.21.15.39:0/389325980 >> 172.21.15.39:0/389325980 conn(0x7f43fc0fc8d0 msgr2=0x7f43fc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:47.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 -- 172.21.15.39:0/389325980 shutdown_connections 2024-09-10T21:54:47.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.998+0000 7f4401240640 1 -- 172.21.15.39:0/389325980 wait complete. 2024-09-10T21:54:47.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 Processor -- start 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 -- start start 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 0x7f43fc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e660 con 0x7f43fc101160 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e4e0 con 0x7f43fc104910 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f4401240640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e7e0 con 0x7f43fc103fd0 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f43fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f43fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34422/0 (socket says 172.21.15.39:34422) 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:46.999+0000 7f43fad9d640 1 -- 172.21.15.39:0/1576098117 learned_addr learned my addr 172.21.15.39:0/1576098117 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fa59c640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fb59e640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 0x7f43fc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 -- 172.21.15.39:0/1576098117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 msgr2=0x7f43fc199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 -- 172.21.15.39:0/1576098117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 msgr2=0x7f43fc19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 0x7f43fc19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 -- 172.21.15.39:0/1576098117 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc19a940 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fa59c640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fb59e640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 0x7f43fc19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43fad9d640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e9f0 tx=0x7f43ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00cd80 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc19ac30 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ec0054d0 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec010690 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.000+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a1300 con 0x7f43fc101160 2024-09-10T21:54:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.001+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc109e90 con 0x7f43fc101160 2024-09-10T21:54:47.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.002+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f43ec004e30 con 0x7f43fc101160 2024-09-10T21:54:47.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.003+0000 7f43e3fff640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 0x7f43e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.003+0000 7f43fa59c640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 0x7f43e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.003+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f43ec0e62e0 con 0x7f43fc101160 2024-09-10T21:54:47.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.004+0000 7f43fa59c640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 0x7f43e40b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009930 tx=0x7f43f0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:47.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.006+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43ec056220 con 0x7f43fc101160 2024-09-10T21:54:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.192+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f43fc063d50 con 0x7f43fc101160 2024-09-10T21:54:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.192+0000 7f43e3fff640 1 -- 172.21.15.39:0/1576098117 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) ==== 100+0+11 (secure 0 0 0) 0x7f43ec0a8020 con 0x7f43fc101160 2024-09-10T21:54:47.194 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 msgr2=0x7f43e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 0x7f43e40b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009930 tx=0x7f43f0005fd0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 msgr2=0x7f43fc198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e9f0 tx=0x7f43ec00edf0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 shutdown_connections 2024-09-10T21:54:47.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43e40b52e0 0x7f43e40b77a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc104910 0x7f43fc19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc103fd0 0x7f43fc199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 --2- 172.21.15.39:0/1576098117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc101160 0x7f43fc198e00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 >> 172.21.15.39:0/1576098117 conn(0x7f43fc0fc8d0 msgr2=0x7f43fc107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 shutdown_connections 2024-09-10T21:54:47.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.194+0000 7f4401240640 1 -- 172.21.15.39:0/1576098117 wait complete. 2024-09-10T21:54:47.207 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T21:54:47.207 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:47.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:47 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3672161326' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:47 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3995858904' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:47 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1576098117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 -- 172.21.15.39:0/56603297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e0109150 msgr2=0x7f20e010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/56603297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e0109150 0x7f20e010f950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009ca0 tx=0x7f20d802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 -- 172.21.15.39:0/56603297 shutdown_connections 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/56603297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e0109150 0x7f20e010f950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/56603297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e01087d0 0x7f20e0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/56603297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 -- 172.21.15.39:0/56603297 >> 172.21.15.39:0/56603297 conn(0x7f20e00fe830 msgr2=0x7f20e0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 -- 172.21.15.39:0/56603297 shutdown_connections 2024-09-10T21:54:47.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 -- 172.21.15.39:0/56603297 wait complete. 2024-09-10T21:54:47.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.878+0000 7f20e5dd2640 1 Processor -- start 2024-09-10T21:54:47.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 -- start start 2024-09-10T21:54:47.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 0x7f20e019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0112e10 con 0x7f20e01087d0 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0112c90 con 0x7f20e0109150 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20e5dd2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0112f90 con 0x7f20e0102dc0 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34440/0 (socket says 172.21.15.39:34440) 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20deffd640 1 -- 172.21.15.39:0/1527678713 learned_addr learned my addr 172.21.15.39:0/1527678713 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.879+0000 7f20df7fe640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20dffff640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 0x7f20e019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 -- 172.21.15.39:0/1527678713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 msgr2=0x7f20e0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 -- 172.21.15.39:0/1527678713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 msgr2=0x7f20e019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 0x7f20e019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 -- 172.21.15.39:0/1527678713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e019f3b0 con 0x7f20e01087d0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20df7fe640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20dffff640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 0x7f20e019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20deffd640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e9f0 tx=0x7f20d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d400cd80 con 0x7f20e01087d0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e019f6a0 con 0x7f20e01087d0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d40108e0 con 0x7f20e01087d0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4018980 con 0x7f20e01087d0 2024-09-10T21:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.880+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e01a5d60 con 0x7f20e01087d0 2024-09-10T21:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.881+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e01031a0 con 0x7f20e01087d0 2024-09-10T21:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.882+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f20d4010430 con 0x7f20e01087d0 2024-09-10T21:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.883+0000 7f20dcff9640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 0x7f20c80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:47.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.884+0000 7f20df7fe640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 0x7f20c80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:47.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.884+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f20d40e6680 con 0x7f20e01087d0 2024-09-10T21:54:47.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.884+0000 7f20df7fe640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 0x7f20c80b7830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009c20 tx=0x7f20d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:47.887+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20d40ad390 con 0x7f20e01087d0 2024-09-10T21:54:47.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:47 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3672161326' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:47 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3995858904' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:47 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1576098117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:47 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3672161326' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:47 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3995858904' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:54:47.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:47 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1576098117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:54:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.107+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20e019a430 con 0x7f20e01087d0 2024-09-10T21:54:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.108+0000 7f20dcff9640 1 -- 172.21.15.39:0/1527678713 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f20d40acc90 con 0x7f20e01087d0 2024-09-10T21:54:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:48.110 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-10T21:54:45:540351+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:54:45.490131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24550,24563,24562,24583,24590]},"id":1}]} 2024-09-10T21:54:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 msgr2=0x7f20c80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 0x7f20c80b7830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009c20 tx=0x7f20d0005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 msgr2=0x7f20e0199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e9f0 tx=0x7f20d400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 shutdown_connections 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.110+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20c80b5370 0x7f20c80b7830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e0109150 0x7f20e019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e01087d0 0x7f20e0199840 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 --2- 172.21.15.39:0/1527678713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e0102dc0 0x7f20e0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 >> 172.21.15.39:0/1527678713 conn(0x7f20e00fe830 msgr2=0x7f20e0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 shutdown_connections 2024-09-10T21:54:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.111+0000 7f20e5dd2640 1 -- 172.21.15.39:0/1527678713 wait complete. 2024-09-10T21:54:48.729 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T21:54:48.729 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T21:54:48.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 -- 172.21.15.39:0/1452284616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 msgr2=0x7fd890109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 --2- 172.21.15.39:0/1452284616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd890109d40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd888009cd0 tx=0x7fd88802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 -- 172.21.15.39:0/1452284616 shutdown_connections 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 --2- 172.21.15.39:0/1452284616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd890109d40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 --2- 172.21.15.39:0/1452284616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 0x7fd890102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 --2- 172.21.15.39:0/1452284616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 0x7fd890101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 -- 172.21.15.39:0/1452284616 >> 172.21.15.39:0/1452284616 conn(0x7fd8900fd190 msgr2=0x7fd8900ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:48.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 -- 172.21.15.39:0/1452284616 shutdown_connections 2024-09-10T21:54:48.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 -- 172.21.15.39:0/1452284616 wait complete. 2024-09-10T21:54:48.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.834+0000 7fd895c9b640 1 Processor -- start 2024-09-10T21:54:48.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 -- start start 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 0x7fd89006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 0x7fd89019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd89010d580 con 0x7fd8901033c0 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd89010d400 con 0x7fd890102a00 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd895c9b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd89010d700 con 0x7fd8901018b0 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34470/0 (socket says 172.21.15.39:34470) 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 -- 172.21.15.39:0/4085228695 learned_addr learned my addr 172.21.15.39:0/4085228695 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88f7fe640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 0x7fd89006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88effd640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 0x7fd89019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:48.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 -- 172.21.15.39:0/4085228695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 msgr2=0x7fd89006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 0x7fd89006bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 -- 172.21.15.39:0/4085228695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 msgr2=0x7fd89019ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 0x7fd89019ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 -- 172.21.15.39:0/4085228695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8901a2bf0 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.835+0000 7fd88ffff640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd888006010 tx=0x7fd888003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.836+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888004450 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.836+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8880045f0 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.836+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880466e0 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.836+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8901a2e80 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.836+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8901a3410 con 0x7fd8901033c0 2024-09-10T21:54:48.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.837+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd890108bc0 con 0x7fd8901033c0 2024-09-10T21:54:48.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.838+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fd88804e070 con 0x7fd8901033c0 2024-09-10T21:54:48.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.839+0000 7fd88cff9640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 0x7fd8780b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:48.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.839+0000 7fd88f7fe640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 0x7fd8780b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:48.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.839+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd88802e030 con 0x7fd8901033c0 2024-09-10T21:54:48.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.839+0000 7fd88f7fe640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 0x7fd8780b78b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd880009990 tx=0x7fd880009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:48.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:48.843+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd88804b060 con 0x7fd8901033c0 2024-09-10T21:54:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:48 smithi070 ceph-mon[34909]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:54:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:48 smithi070 ceph-mon[34909]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T21:54:48.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1527678713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:48 smithi039 ceph-mon[30872]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:54:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:48 smithi039 ceph-mon[30872]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T21:54:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1527678713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:48 smithi173 ceph-mon[35294]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:54:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:48 smithi173 ceph-mon[35294]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T21:54:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1527678713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.025+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd890063590 con 0x7fd8780b53f0 2024-09-10T21:54:49.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.029+0000 7fd88cff9640 1 -- 172.21.15.39:0/4085228695 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258909 (secure 0 0 0) 0x7fd890063590 con 0x7fd8780b53f0 2024-09-10T21:54:49.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:54:49.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 msgr2=0x7fd8780b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 0x7fd8780b78b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd880009990 tx=0x7fd880009110 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 msgr2=0x7fd8901a2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd888006010 tx=0x7fd888003ce0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 shutdown_connections 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8780b53f0 0x7fd8780b78b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8901033c0 0x7fd8901a2470 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd890102a00 0x7fd89019ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 --2- 172.21.15.39:0/4085228695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8901018b0 0x7fd89006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 >> 172.21.15.39:0/4085228695 conn(0x7fd8900fd190 msgr2=0x7fd890105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 shutdown_connections 2024-09-10T21:54:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.032+0000 7fd895c9b640 1 -- 172.21.15.39:0/4085228695 wait complete. 2024-09-10T21:54:49.045 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-10T21:54:47.478818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664985,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1060,"num_read_kb":640,"num_write":375,"num_write_kb":2299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952422,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":573,"ondisk_log_size":573,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369104,"kb_used_data":11500,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572720,"statfs":{"total":1151940427776,"available":1151562465280,"internally_reserved":0,"allocated":11776000,"data_stored":6621812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":72,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541986+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:44.541986+0000","last_peered":"2024-09-10T21:53:44.541986+0000","last_clean":"2024-09-10T21:53:44.541986+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:44.541986+0000","last_undegraded":"2024-09-10T21:53:44.541986+0000","last_fullsized":"2024-09-10T21:53:44.541986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555466+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:44.555466+0000","last_peered":"2024-09-10T21:53:44.555466+0000","last_clean":"2024-09-10T21:53:44.555466+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:44.555466+0000","last_undegraded":"2024-09-10T21:53:44.555466+0000","last_fullsized":"2024-09-10T21:53:44.555466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555413+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:44.555413+0000","last_peered":"2024-09-10T21:53:44.555413+0000","last_clean":"2024-09-10T21:53:44.555413+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:44.555413+0000","last_undegraded":"2024-09-10T21:53:44.555413+0000","last_fullsized":"2024-09-10T21:53:44.555413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556909+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:44.556909+0000","last_peered":"2024-09-10T21:53:44.556909+0000","last_clean":"2024-09-10T21:53:44.556909+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:44.556909+0000","last_undegraded":"2024-09-10T21:53:44.556909+0000","last_fullsized":"2024-09-10T21:53:44.556909+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.850062+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:54:43.850062+0000","last_peered":"2024-09-10T21:54:43.850062+0000","last_clean":"2024-09-10T21:54:43.850062+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:54:43.850062+0000","last_undegraded":"2024-09-10T21:54:43.850062+0000","last_fullsized":"2024-09-10T21:54:43.850062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863510+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:54:43.863510+0000","last_peered":"2024-09-10T21:54:43.863510+0000","last_clean":"2024-09-10T21:54:43.863510+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:54:43.863510+0000","last_undegraded":"2024-09-10T21:54:43.863510+0000","last_fullsized":"2024-09-10T21:54:43.863510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859187+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:54:43.859187+0000","last_peered":"2024-09-10T21:54:43.859187+0000","last_clean":"2024-09-10T21:54:43.859187+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:54:43.859187+0000","last_undegraded":"2024-09-10T21:54:43.859187+0000","last_fullsized":"2024-09-10T21:54:43.859187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558841+0000","last_change":"2024-09-10T21:53:44.558293+0000","last_active":"2024-09-10T21:53:44.558841+0000","last_peered":"2024-09-10T21:53:44.558841+0000","last_clean":"2024-09-10T21:53:44.558841+0000","last_became_active":"2024-09-10T21:53:44.557902+0000","last_became_peered":"2024-09-10T21:53:44.557902+0000","last_unstale":"2024-09-10T21:53:44.558841+0000","last_undegraded":"2024-09-10T21:53:44.558841+0000","last_fullsized":"2024-09-10T21:53:44.558841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:01.123834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872826+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:54:43.872826+0000","last_peered":"2024-09-10T21:54:43.872826+0000","last_clean":"2024-09-10T21:54:43.872826+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:54:43.872826+0000","last_undegraded":"2024-09-10T21:54:43.872826+0000","last_fullsized":"2024-09-10T21:54:43.872826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"73'16","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864304+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:54:43.864304+0000","last_peered":"2024-09-10T21:54:43.864304+0000","last_clean":"2024-09-10T21:54:43.864304+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:54:43.864304+0000","last_undegraded":"2024-09-10T21:54:43.864304+0000","last_fullsized":"2024-09-10T21:54:43.864304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871022+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:54:43.871022+0000","last_peered":"2024-09-10T21:54:43.871022+0000","last_clean":"2024-09-10T21:54:43.871022+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:54:43.871022+0000","last_undegraded":"2024-09-10T21:54:43.871022+0000","last_fullsized":"2024-09-10T21:54:43.871022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857674+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:54:43.857674+0000","last_peered":"2024-09-10T21:54:43.857674+0000","last_clean":"2024-09-10T21:54:43.857674+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:54:43.857674+0000","last_undegraded":"2024-09-10T21:54:43.857674+0000","last_fullsized":"2024-09-10T21:54:43.857674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555268+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:44.555268+0000","last_peered":"2024-09-10T21:53:44.555268+0000","last_clean":"2024-09-10T21:53:44.555268+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:44.555268+0000","last_undegraded":"2024-09-10T21:53:44.555268+0000","last_fullsized":"2024-09-10T21:53:44.555268+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555328+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:44.555328+0000","last_peered":"2024-09-10T21:53:44.555328+0000","last_clean":"2024-09-10T21:53:44.555328+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:44.555328+0000","last_undegraded":"2024-09-10T21:53:44.555328+0000","last_fullsized":"2024-09-10T21:53:44.555328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872658+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:54:43.872658+0000","last_peered":"2024-09-10T21:54:43.872658+0000","last_clean":"2024-09-10T21:54:43.872658+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:54:43.872658+0000","last_undegraded":"2024-09-10T21:54:43.872658+0000","last_fullsized":"2024-09-10T21:54:43.872658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542105+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:44.542105+0000","last_peered":"2024-09-10T21:53:44.542105+0000","last_clean":"2024-09-10T21:53:44.542105+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:44.542105+0000","last_undegraded":"2024-09-10T21:53:44.542105+0000","last_fullsized":"2024-09-10T21:53:44.542105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543340+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:44.543340+0000","last_peered":"2024-09-10T21:53:44.543340+0000","last_clean":"2024-09-10T21:53:44.543340+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:44.543340+0000","last_undegraded":"2024-09-10T21:53:44.543340+0000","last_fullsized":"2024-09-10T21:53:44.543340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540012+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:44.540012+0000","last_peered":"2024-09-10T21:53:44.540012+0000","last_clean":"2024-09-10T21:53:44.540012+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:44.540012+0000","last_undegraded":"2024-09-10T21:53:44.540012+0000","last_fullsized":"2024-09-10T21:53:44.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541613+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:44.541613+0000","last_peered":"2024-09-10T21:53:44.541613+0000","last_clean":"2024-09-10T21:53:44.541613+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:44.541613+0000","last_undegraded":"2024-09-10T21:53:44.541613+0000","last_fullsized":"2024-09-10T21:53:44.541613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.868551+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:54:43.868551+0000","last_peered":"2024-09-10T21:54:43.868551+0000","last_clean":"2024-09-10T21:54:43.868551+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:54:43.868551+0000","last_undegraded":"2024-09-10T21:54:43.868551+0000","last_fullsized":"2024-09-10T21:54:43.868551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872964+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:54:43.872964+0000","last_peered":"2024-09-10T21:54:43.872964+0000","last_clean":"2024-09-10T21:54:43.872964+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:54:43.872964+0000","last_undegraded":"2024-09-10T21:54:43.872964+0000","last_fullsized":"2024-09-10T21:54:43.872964+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857062+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:54:43.857062+0000","last_peered":"2024-09-10T21:54:43.857062+0000","last_clean":"2024-09-10T21:54:43.857062+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:54:43.857062+0000","last_undegraded":"2024-09-10T21:54:43.857062+0000","last_fullsized":"2024-09-10T21:54:43.857062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544991+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:44.544991+0000","last_peered":"2024-09-10T21:53:44.544991+0000","last_clean":"2024-09-10T21:53:44.544991+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:44.544991+0000","last_undegraded":"2024-09-10T21:53:44.544991+0000","last_fullsized":"2024-09-10T21:53:44.544991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.852219+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:54:43.852219+0000","last_peered":"2024-09-10T21:54:43.852219+0000","last_clean":"2024-09-10T21:54:43.852219+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:54:43.852219+0000","last_undegraded":"2024-09-10T21:54:43.852219+0000","last_fullsized":"2024-09-10T21:54:43.852219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540227+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:44.540227+0000","last_peered":"2024-09-10T21:53:44.540227+0000","last_clean":"2024-09-10T21:53:44.540227+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:44.540227+0000","last_undegraded":"2024-09-10T21:53:44.540227+0000","last_fullsized":"2024-09-10T21:53:44.540227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541969+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:44.541969+0000","last_peered":"2024-09-10T21:53:44.541969+0000","last_clean":"2024-09-10T21:53:44.541969+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:44.541969+0000","last_undegraded":"2024-09-10T21:53:44.541969+0000","last_fullsized":"2024-09-10T21:53:44.541969+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.867698+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:54:43.867698+0000","last_peered":"2024-09-10T21:54:43.867698+0000","last_clean":"2024-09-10T21:54:43.867698+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:54:43.867698+0000","last_undegraded":"2024-09-10T21:54:43.867698+0000","last_fullsized":"2024-09-10T21:54:43.867698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555443+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:44.555443+0000","last_peered":"2024-09-10T21:53:44.555443+0000","last_clean":"2024-09-10T21:53:44.555443+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:44.555443+0000","last_undegraded":"2024-09-10T21:53:44.555443+0000","last_fullsized":"2024-09-10T21:53:44.555443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539653+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:44.539653+0000","last_peered":"2024-09-10T21:53:44.539653+0000","last_clean":"2024-09-10T21:53:44.539653+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:44.539653+0000","last_undegraded":"2024-09-10T21:53:44.539653+0000","last_fullsized":"2024-09-10T21:53:44.539653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.547111+0000","last_change":"2024-09-10T21:53:44.547016+0000","last_active":"2024-09-10T21:53:44.547111+0000","last_peered":"2024-09-10T21:53:44.547111+0000","last_clean":"2024-09-10T21:53:44.547111+0000","last_became_active":"2024-09-10T21:53:44.546627+0000","last_became_peered":"2024-09-10T21:53:44.546627+0000","last_unstale":"2024-09-10T21:53:44.547111+0000","last_undegraded":"2024-09-10T21:53:44.547111+0000","last_fullsized":"2024-09-10T21:53:44.547111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:36.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541388+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:44.541388+0000","last_peered":"2024-09-10T21:53:44.541388+0000","last_clean":"2024-09-10T21:53:44.541388+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:44.541388+0000","last_undegraded":"2024-09-10T21:53:44.541388+0000","last_fullsized":"2024-09-10T21:53:44.541388+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.861891+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:54:43.861891+0000","last_peered":"2024-09-10T21:54:43.861891+0000","last_clean":"2024-09-10T21:54:43.861891+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:54:43.861891+0000","last_undegraded":"2024-09-10T21:54:43.861891+0000","last_fullsized":"2024-09-10T21:54:43.861891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":124,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.380276+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:54:41.380276+0000","last_peered":"2024-09-10T21:54:41.380276+0000","last_clean":"2024-09-10T21:54:41.380276+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:54:41.380276+0000","last_undegraded":"2024-09-10T21:54:41.380276+0000","last_fullsized":"2024-09-10T21:54:41.380276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.546050+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:44.546050+0000","last_peered":"2024-09-10T21:53:44.546050+0000","last_clean":"2024-09-10T21:53:44.546050+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:44.546050+0000","last_undegraded":"2024-09-10T21:53:44.546050+0000","last_fullsized":"2024-09-10T21:53:44.546050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557192+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:44.557192+0000","last_peered":"2024-09-10T21:53:44.557192+0000","last_clean":"2024-09-10T21:53:44.557192+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:44.557192+0000","last_undegraded":"2024-09-10T21:53:44.557192+0000","last_fullsized":"2024-09-10T21:53:44.557192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539062+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:44.539062+0000","last_peered":"2024-09-10T21:53:44.539062+0000","last_clean":"2024-09-10T21:53:44.539062+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:44.539062+0000","last_undegraded":"2024-09-10T21:53:44.539062+0000","last_fullsized":"2024-09-10T21:53:44.539062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859089+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:54:43.859089+0000","last_peered":"2024-09-10T21:54:43.859089+0000","last_clean":"2024-09-10T21:54:43.859089+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:54:43.859089+0000","last_undegraded":"2024-09-10T21:54:43.859089+0000","last_fullsized":"2024-09-10T21:54:43.859089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545291+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:44.545291+0000","last_peered":"2024-09-10T21:53:44.545291+0000","last_clean":"2024-09-10T21:53:44.545291+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:44.545291+0000","last_undegraded":"2024-09-10T21:53:44.545291+0000","last_fullsized":"2024-09-10T21:53:44.545291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543281+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:44.543281+0000","last_peered":"2024-09-10T21:53:44.543281+0000","last_clean":"2024-09-10T21:53:44.543281+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:44.543281+0000","last_undegraded":"2024-09-10T21:53:44.543281+0000","last_fullsized":"2024-09-10T21:53:44.543281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'5","reported_seq":220,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.386425+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:54:46.386425+0000","last_peered":"2024-09-10T21:54:46.386425+0000","last_clean":"2024-09-10T21:54:46.386425+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:54:46.386425+0000","last_undegraded":"2024-09-10T21:54:46.386425+0000","last_fullsized":"2024-09-10T21:54:46.386425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873137+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:54:43.873137+0000","last_peered":"2024-09-10T21:54:43.873137+0000","last_clean":"2024-09-10T21:54:43.873137+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:54:43.873137+0000","last_undegraded":"2024-09-10T21:54:43.873137+0000","last_fullsized":"2024-09-10T21:54:43.873137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539991+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:44.539991+0000","last_peered":"2024-09-10T21:53:44.539991+0000","last_clean":"2024-09-10T21:53:44.539991+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:44.539991+0000","last_undegraded":"2024-09-10T21:53:44.539991+0000","last_fullsized":"2024-09-10T21:53:44.539991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555630+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:44.555630+0000","last_peered":"2024-09-10T21:53:44.555630+0000","last_clean":"2024-09-10T21:53:44.555630+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:44.555630+0000","last_undegraded":"2024-09-10T21:53:44.555630+0000","last_fullsized":"2024-09-10T21:53:44.555630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545577+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:44.545577+0000","last_peered":"2024-09-10T21:53:44.545577+0000","last_clean":"2024-09-10T21:53:44.545577+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:44.545577+0000","last_undegraded":"2024-09-10T21:53:44.545577+0000","last_fullsized":"2024-09-10T21:53:44.545577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.874096+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:54:43.874096+0000","last_peered":"2024-09-10T21:54:43.874096+0000","last_clean":"2024-09-10T21:54:43.874096+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:54:43.874096+0000","last_undegraded":"2024-09-10T21:54:43.874096+0000","last_fullsized":"2024-09-10T21:54:43.874096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'38","reported_seq":265,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.387154+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:54:46.387154+0000","last_peered":"2024-09-10T21:54:46.387154+0000","last_clean":"2024-09-10T21:54:46.387154+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:54:46.387154+0000","last_undegraded":"2024-09-10T21:54:46.387154+0000","last_fullsized":"2024-09-10T21:54:46.387154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67570,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":168,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856478+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:54:43.856478+0000","last_peered":"2024-09-10T21:54:43.856478+0000","last_clean":"2024-09-10T21:54:43.856478+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:54:43.856478+0000","last_undegraded":"2024-09-10T21:54:43.856478+0000","last_fullsized":"2024-09-10T21:54:43.856478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539851+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:44.539851+0000","last_peered":"2024-09-10T21:53:44.539851+0000","last_clean":"2024-09-10T21:53:44.539851+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:44.539851+0000","last_undegraded":"2024-09-10T21:53:44.539851+0000","last_fullsized":"2024-09-10T21:53:44.539851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856502+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:54:43.856502+0000","last_peered":"2024-09-10T21:54:43.856502+0000","last_clean":"2024-09-10T21:54:43.856502+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:54:43.856502+0000","last_undegraded":"2024-09-10T21:54:43.856502+0000","last_fullsized":"2024-09-10T21:54:43.856502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544851+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:44.544851+0000","last_peered":"2024-09-10T21:53:44.544851+0000","last_clean":"2024-09-10T21:53:44.544851+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:44.544851+0000","last_undegraded":"2024-09-10T21:53:44.544851+0000","last_fullsized":"2024-09-10T21:53:44.544851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"73'15","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866098+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:54:43.866098+0000","last_peered":"2024-09-10T21:54:43.866098+0000","last_clean":"2024-09-10T21:54:43.866098+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:54:43.866098+0000","last_undegraded":"2024-09-10T21:54:43.866098+0000","last_fullsized":"2024-09-10T21:54:43.866098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.379610+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:54:41.379610+0000","last_peered":"2024-09-10T21:54:41.379610+0000","last_clean":"2024-09-10T21:54:41.379610+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:54:41.379610+0000","last_undegraded":"2024-09-10T21:54:41.379610+0000","last_fullsized":"2024-09-10T21:54:41.379610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863183+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:54:43.863183+0000","last_peered":"2024-09-10T21:54:43.863183+0000","last_clean":"2024-09-10T21:54:43.863183+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:54:43.863183+0000","last_undegraded":"2024-09-10T21:54:43.863183+0000","last_fullsized":"2024-09-10T21:54:43.863183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542191+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:44.542191+0000","last_peered":"2024-09-10T21:53:44.542191+0000","last_clean":"2024-09-10T21:53:44.542191+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:44.542191+0000","last_undegraded":"2024-09-10T21:53:44.542191+0000","last_fullsized":"2024-09-10T21:53:44.542191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545688+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:44.545688+0000","last_peered":"2024-09-10T21:53:44.545688+0000","last_clean":"2024-09-10T21:53:44.545688+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:44.545688+0000","last_undegraded":"2024-09-10T21:53:44.545688+0000","last_fullsized":"2024-09-10T21:53:44.545688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542756+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:44.542756+0000","last_peered":"2024-09-10T21:53:44.542756+0000","last_clean":"2024-09-10T21:53:44.542756+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:44.542756+0000","last_undegraded":"2024-09-10T21:53:44.542756+0000","last_fullsized":"2024-09-10T21:53:44.542756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558295+0000","last_change":"2024-09-10T21:53:44.558208+0000","last_active":"2024-09-10T21:53:44.558295+0000","last_peered":"2024-09-10T21:53:44.558295+0000","last_clean":"2024-09-10T21:53:44.558295+0000","last_became_active":"2024-09-10T21:53:44.557786+0000","last_became_peered":"2024-09-10T21:53:44.557786+0000","last_unstale":"2024-09-10T21:53:44.558295+0000","last_undegraded":"2024-09-10T21:53:44.558295+0000","last_fullsized":"2024-09-10T21:53:44.558295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:35.278172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539468+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:44.539468+0000","last_peered":"2024-09-10T21:53:44.539468+0000","last_clean":"2024-09-10T21:53:44.539468+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:44.539468+0000","last_undegraded":"2024-09-10T21:53:44.539468+0000","last_fullsized":"2024-09-10T21:53:44.539468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857279+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:54:43.857279+0000","last_peered":"2024-09-10T21:54:43.857279+0000","last_clean":"2024-09-10T21:54:43.857279+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:54:43.857279+0000","last_undegraded":"2024-09-10T21:54:43.857279+0000","last_fullsized":"2024-09-10T21:54:43.857279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545708+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:44.545708+0000","last_peered":"2024-09-10T21:53:44.545708+0000","last_clean":"2024-09-10T21:53:44.545708+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:44.545708+0000","last_undegraded":"2024-09-10T21:53:44.545708+0000","last_fullsized":"2024-09-10T21:53:44.545708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858977+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:54:43.858977+0000","last_peered":"2024-09-10T21:54:43.858977+0000","last_clean":"2024-09-10T21:54:43.858977+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:54:43.858977+0000","last_undegraded":"2024-09-10T21:54:43.858977+0000","last_fullsized":"2024-09-10T21:54:43.858977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.380145+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:54:41.380145+0000","last_peered":"2024-09-10T21:54:41.380145+0000","last_clean":"2024-09-10T21:54:41.380145+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:54:41.380145+0000","last_undegraded":"2024-09-10T21:54:41.380145+0000","last_fullsized":"2024-09-10T21:54:41.380145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.870982+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:54:43.870982+0000","last_peered":"2024-09-10T21:54:43.870982+0000","last_clean":"2024-09-10T21:54:43.870982+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:54:43.870982+0000","last_undegraded":"2024-09-10T21:54:43.870982+0000","last_fullsized":"2024-09-10T21:54:43.870982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539769+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:44.539769+0000","last_peered":"2024-09-10T21:53:44.539769+0000","last_clean":"2024-09-10T21:53:44.539769+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:44.539769+0000","last_undegraded":"2024-09-10T21:53:44.539769+0000","last_fullsized":"2024-09-10T21:53:44.539769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866759+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:54:43.866759+0000","last_peered":"2024-09-10T21:54:43.866759+0000","last_clean":"2024-09-10T21:54:43.866759+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:54:43.866759+0000","last_undegraded":"2024-09-10T21:54:43.866759+0000","last_fullsized":"2024-09-10T21:54:43.866759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539673+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:44.539673+0000","last_peered":"2024-09-10T21:53:44.539673+0000","last_clean":"2024-09-10T21:53:44.539673+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:44.539673+0000","last_undegraded":"2024-09-10T21:53:44.539673+0000","last_fullsized":"2024-09-10T21:53:44.539673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'5","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858804+0000","last_change":"2024-09-10T21:53:44.544497+0000","last_active":"2024-09-10T21:54:43.858804+0000","last_peered":"2024-09-10T21:54:43.858804+0000","last_clean":"2024-09-10T21:54:43.858804+0000","last_became_active":"2024-09-10T21:53:44.544086+0000","last_became_peered":"2024-09-10T21:53:44.544086+0000","last_unstale":"2024-09-10T21:54:43.858804+0000","last_undegraded":"2024-09-10T21:54:43.858804+0000","last_fullsized":"2024-09-10T21:54:43.858804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:42.547771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.382061+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:54:43.382061+0000","last_peered":"2024-09-10T21:54:43.382061+0000","last_clean":"2024-09-10T21:54:43.382061+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:54:43.382061+0000","last_undegraded":"2024-09-10T21:54:43.382061+0000","last_fullsized":"2024-09-10T21:54:43.382061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545100+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:44.545100+0000","last_peered":"2024-09-10T21:53:44.545100+0000","last_clean":"2024-09-10T21:53:44.545100+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:44.545100+0000","last_undegraded":"2024-09-10T21:53:44.545100+0000","last_fullsized":"2024-09-10T21:53:44.545100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":125,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:45.388324+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:54:45.388324+0000","last_peered":"2024-09-10T21:54:45.388324+0000","last_clean":"2024-09-10T21:54:45.388324+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:54:45.388324+0000","last_undegraded":"2024-09-10T21:54:45.388324+0000","last_fullsized":"2024-09-10T21:54:45.388324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863028+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:54:43.863028+0000","last_peered":"2024-09-10T21:54:43.863028+0000","last_clean":"2024-09-10T21:54:43.863028+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:54:43.863028+0000","last_undegraded":"2024-09-10T21:54:43.863028+0000","last_fullsized":"2024-09-10T21:54:43.863028+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543424+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:44.543424+0000","last_peered":"2024-09-10T21:53:44.543424+0000","last_clean":"2024-09-10T21:53:44.543424+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:44.543424+0000","last_undegraded":"2024-09-10T21:53:44.543424+0000","last_fullsized":"2024-09-10T21:53:44.543424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.854707+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:54:43.854707+0000","last_peered":"2024-09-10T21:54:43.854707+0000","last_clean":"2024-09-10T21:54:43.854707+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:54:43.854707+0000","last_undegraded":"2024-09-10T21:54:43.854707+0000","last_fullsized":"2024-09-10T21:54:43.854707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543551+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:44.543551+0000","last_peered":"2024-09-10T21:53:44.543551+0000","last_clean":"2024-09-10T21:53:44.543551+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:44.543551+0000","last_undegraded":"2024-09-10T21:53:44.543551+0000","last_fullsized":"2024-09-10T21:53:44.543551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858910+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:54:43.858910+0000","last_peered":"2024-09-10T21:54:43.858910+0000","last_clean":"2024-09-10T21:54:43.858910+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:54:43.858910+0000","last_undegraded":"2024-09-10T21:54:43.858910+0000","last_fullsized":"2024-09-10T21:54:43.858910+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'14","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543451+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:44.543451+0000","last_peered":"2024-09-10T21:53:44.543451+0000","last_clean":"2024-09-10T21:53:44.543451+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:44.543451+0000","last_undegraded":"2024-09-10T21:53:44.543451+0000","last_fullsized":"2024-09-10T21:53:44.543451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.860205+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:54:43.860205+0000","last_peered":"2024-09-10T21:54:43.860205+0000","last_clean":"2024-09-10T21:54:43.860205+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:54:43.860205+0000","last_undegraded":"2024-09-10T21:54:43.860205+0000","last_fullsized":"2024-09-10T21:54:43.860205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556856+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:44.556856+0000","last_peered":"2024-09-10T21:53:44.556856+0000","last_clean":"2024-09-10T21:53:44.556856+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:44.556856+0000","last_undegraded":"2024-09-10T21:53:44.556856+0000","last_fullsized":"2024-09-10T21:53:44.556856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555472+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:44.555472+0000","last_peered":"2024-09-10T21:53:44.555472+0000","last_clean":"2024-09-10T21:53:44.555472+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:44.555472+0000","last_undegraded":"2024-09-10T21:53:44.555472+0000","last_fullsized":"2024-09-10T21:53:44.555472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543821+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:44.543821+0000","last_peered":"2024-09-10T21:53:44.543821+0000","last_clean":"2024-09-10T21:53:44.543821+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:44.543821+0000","last_undegraded":"2024-09-10T21:53:44.543821+0000","last_fullsized":"2024-09-10T21:53:44.543821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.822745+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:54:43.822745+0000","last_peered":"2024-09-10T21:54:43.822745+0000","last_clean":"2024-09-10T21:54:43.822745+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:54:43.822745+0000","last_undegraded":"2024-09-10T21:54:43.822745+0000","last_fullsized":"2024-09-10T21:54:43.822745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544539+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:44.544539+0000","last_peered":"2024-09-10T21:53:44.544539+0000","last_clean":"2024-09-10T21:53:44.544539+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:44.544539+0000","last_undegraded":"2024-09-10T21:53:44.544539+0000","last_fullsized":"2024-09-10T21:53:44.544539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541458+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:44.541458+0000","last_peered":"2024-09-10T21:53:44.541458+0000","last_clean":"2024-09-10T21:53:44.541458+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:44.541458+0000","last_undegraded":"2024-09-10T21:53:44.541458+0000","last_fullsized":"2024-09-10T21:53:44.541458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.551887+0000","last_change":"2024-09-10T21:53:44.551320+0000","last_active":"2024-09-10T21:53:44.551887+0000","last_peered":"2024-09-10T21:53:44.551887+0000","last_clean":"2024-09-10T21:53:44.551887+0000","last_became_active":"2024-09-10T21:53:44.546446+0000","last_became_peered":"2024-09-10T21:53:44.546446+0000","last_unstale":"2024-09-10T21:53:44.551887+0000","last_undegraded":"2024-09-10T21:53:44.551887+0000","last_fullsized":"2024-09-10T21:53:44.551887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:19.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.869015+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:54:43.869015+0000","last_peered":"2024-09-10T21:54:43.869015+0000","last_clean":"2024-09-10T21:54:43.869015+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:54:43.869015+0000","last_undegraded":"2024-09-10T21:54:43.869015+0000","last_fullsized":"2024-09-10T21:54:43.869015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542660+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:44.542660+0000","last_peered":"2024-09-10T21:53:44.542660+0000","last_clean":"2024-09-10T21:53:44.542660+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:44.542660+0000","last_undegraded":"2024-09-10T21:53:44.542660+0000","last_fullsized":"2024-09-10T21:53:44.542660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871320+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:54:43.871320+0000","last_peered":"2024-09-10T21:54:43.871320+0000","last_clean":"2024-09-10T21:54:43.871320+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:54:43.871320+0000","last_undegraded":"2024-09-10T21:54:43.871320+0000","last_fullsized":"2024-09-10T21:54:43.871320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.548275+0000","last_change":"2024-09-10T21:53:44.548188+0000","last_active":"2024-09-10T21:53:44.548275+0000","last_peered":"2024-09-10T21:53:44.548275+0000","last_clean":"2024-09-10T21:53:44.548275+0000","last_became_active":"2024-09-10T21:53:44.547897+0000","last_became_peered":"2024-09-10T21:53:44.547897+0000","last_unstale":"2024-09-10T21:53:44.548275+0000","last_undegraded":"2024-09-10T21:53:44.548275+0000","last_fullsized":"2024-09-10T21:53:44.548275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:21.351072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557183+0000","last_change":"2024-09-10T21:53:44.556670+0000","last_active":"2024-09-10T21:53:44.557183+0000","last_peered":"2024-09-10T21:53:44.557183+0000","last_clean":"2024-09-10T21:53:44.557183+0000","last_became_active":"2024-09-10T21:53:44.546758+0000","last_became_peered":"2024-09-10T21:53:44.546758+0000","last_unstale":"2024-09-10T21:53:44.557183+0000","last_undegraded":"2024-09-10T21:53:44.557183+0000","last_fullsized":"2024-09-10T21:53:44.557183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:02.292116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873786+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:54:43.873786+0000","last_peered":"2024-09-10T21:54:43.873786+0000","last_clean":"2024-09-10T21:54:43.873786+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:54:43.873786+0000","last_undegraded":"2024-09-10T21:54:43.873786+0000","last_fullsized":"2024-09-10T21:54:43.873786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.568857+0000","last_change":"2024-09-10T21:53:44.568775+0000","last_active":"2024-09-10T21:53:44.568857+0000","last_peered":"2024-09-10T21:53:44.568857+0000","last_clean":"2024-09-10T21:53:44.568857+0000","last_became_active":"2024-09-10T21:53:44.558126+0000","last_became_peered":"2024-09-10T21:53:44.558126+0000","last_unstale":"2024-09-10T21:53:44.568857+0000","last_undegraded":"2024-09-10T21:53:44.568857+0000","last_fullsized":"2024-09-10T21:53:44.568857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:00.789948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555627+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:44.555627+0000","last_peered":"2024-09-10T21:53:44.555627+0000","last_clean":"2024-09-10T21:53:44.555627+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:44.555627+0000","last_undegraded":"2024-09-10T21:53:44.555627+0000","last_fullsized":"2024-09-10T21:53:44.555627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544324+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:44.544324+0000","last_peered":"2024-09-10T21:53:44.544324+0000","last_clean":"2024-09-10T21:53:44.544324+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:44.544324+0000","last_undegraded":"2024-09-10T21:53:44.544324+0000","last_fullsized":"2024-09-10T21:53:44.544324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863774+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:54:43.863774+0000","last_peered":"2024-09-10T21:54:43.863774+0000","last_clean":"2024-09-10T21:54:43.863774+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:54:43.863774+0000","last_undegraded":"2024-09-10T21:54:43.863774+0000","last_fullsized":"2024-09-10T21:54:43.863774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":129,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.382933+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:54:41.382933+0000","last_peered":"2024-09-10T21:54:41.382933+0000","last_clean":"2024-09-10T21:54:41.382933+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:54:41.382933+0000","last_undegraded":"2024-09-10T21:54:41.382933+0000","last_fullsized":"2024-09-10T21:54:41.382933+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74383,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":984,"num_read_kb":576,"num_write":250,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":218727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874275,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":798720,"data_stored":388106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037799,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1041418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201324,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":387454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":387250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593782,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":981190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724603,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":387171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":980028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":387032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":386996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":451003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":455654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":823296,"data_stored":388510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:54:49.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 -- 172.21.15.39:0/1695590864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 msgr2=0x7fe3f4107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1695590864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4107f80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009900 tx=0x7fe3e402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 -- 172.21.15.39:0/1695590864 shutdown_connections 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1695590864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 0x7fe3f410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1695590864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4107f80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1695590864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 -- 172.21.15.39:0/1695590864 >> 172.21.15.39:0/1695590864 conn(0x7fe3f40fd190 msgr2=0x7fe3f40ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 -- 172.21.15.39:0/1695590864 shutdown_connections 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.189+0000 7fe3fc718640 1 -- 172.21.15.39:0/1695590864 wait complete. 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 Processor -- start 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 -- start start 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 0x7fe3f419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410e610 con 0x7fe3f4105b10 2024-09-10T21:54:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410e490 con 0x7fe3f41086c0 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fc718640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410e790 con 0x7fe3f406bec0 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34486/0 (socket says 172.21.15.39:34486) 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 -- 172.21.15.39:0/1710022806 learned_addr learned my addr 172.21.15.39:0/1710022806 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fa4b4640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3facb5640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 0x7fe3f419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 -- 172.21.15.39:0/1710022806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 msgr2=0x7fe3f4198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 -- 172.21.15.39:0/1710022806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 msgr2=0x7fe3f419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 0x7fe3f419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3f9cb3640 1 -- 172.21.15.39:0/1710022806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f419a910 con 0x7fe3f4105b10 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.190+0000 7fe3fa4b4640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3f9cb3640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4005940 tx=0x7fe3e4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e403f030 con 0x7fe3f4105b10 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e4003cb0 con 0x7fe3f4105b10 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f419aba0 con 0x7fe3f4105b10 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4035070 con 0x7fe3f4105b10 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.191+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f41a12d0 con 0x7fe3f4105b10 2024-09-10T21:54:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.192+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f4105f70 con 0x7fe3f4105b10 2024-09-10T21:54:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.193+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fe3e403b4f0 con 0x7fe3f4105b10 2024-09-10T21:54:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.194+0000 7fe3eb7fe640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 0x7fe3e00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.194+0000 7fe3fa4b4640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 0x7fe3e00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.194+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe3e4106c90 con 0x7fe3f4105b10 2024-09-10T21:54:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.195+0000 7fe3fa4b4640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 0x7fe3e00b7830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00058c0 tx=0x7fe3f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.197+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3e40cda00 con 0x7fe3f4105b10 2024-09-10T21:54:49.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.380+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3f4063590 con 0x7fe3e00b5370 2024-09-10T21:54:49.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.384+0000 7fe3eb7fe640 1 -- 172.21.15.39:0/1710022806 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258909 (secure 0 0 0) 0x7fe3f4063590 con 0x7fe3e00b5370 2024-09-10T21:54:49.388 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:49.390 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:54:49.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 msgr2=0x7fe3e00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 0x7fe3e00b7830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00058c0 tx=0x7fe3f0005850 comp rx=0 tx=0).stop 2024-09-10T21:54:49.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 msgr2=0x7fe3f4199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4005940 tx=0x7fe3e4004430 comp rx=0 tx=0).stop 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 shutdown_connections 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe3e00b5370 0x7fe3e00b7830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3f41086c0 0x7fe3f419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f4105b10 0x7fe3f4199420 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 --2- 172.21.15.39:0/1710022806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3f406bec0 0x7fe3f4198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 >> 172.21.15.39:0/1710022806 conn(0x7fe3f40fd190 msgr2=0x7fe3f4103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 shutdown_connections 2024-09-10T21:54:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.388+0000 7fe3fc718640 1 -- 172.21.15.39:0/1710022806 wait complete. 2024-09-10T21:54:49.400 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-10T21:54:47.478818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664985,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1060,"num_read_kb":640,"num_write":375,"num_write_kb":2299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952422,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":573,"ondisk_log_size":573,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369104,"kb_used_data":11500,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572720,"statfs":{"total":1151940427776,"available":1151562465280,"internally_reserved":0,"allocated":11776000,"data_stored":6621812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":72,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541986+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:53:44.541986+0000","last_peered":"2024-09-10T21:53:44.541986+0000","last_clean":"2024-09-10T21:53:44.541986+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:53:44.541986+0000","last_undegraded":"2024-09-10T21:53:44.541986+0000","last_fullsized":"2024-09-10T21:53:44.541986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555466+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:53:44.555466+0000","last_peered":"2024-09-10T21:53:44.555466+0000","last_clean":"2024-09-10T21:53:44.555466+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:53:44.555466+0000","last_undegraded":"2024-09-10T21:53:44.555466+0000","last_fullsized":"2024-09-10T21:53:44.555466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555413+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:53:44.555413+0000","last_peered":"2024-09-10T21:53:44.555413+0000","last_clean":"2024-09-10T21:53:44.555413+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:53:44.555413+0000","last_undegraded":"2024-09-10T21:53:44.555413+0000","last_fullsized":"2024-09-10T21:53:44.555413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556909+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:53:44.556909+0000","last_peered":"2024-09-10T21:53:44.556909+0000","last_clean":"2024-09-10T21:53:44.556909+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:53:44.556909+0000","last_undegraded":"2024-09-10T21:53:44.556909+0000","last_fullsized":"2024-09-10T21:53:44.556909+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.850062+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:54:43.850062+0000","last_peered":"2024-09-10T21:54:43.850062+0000","last_clean":"2024-09-10T21:54:43.850062+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:54:43.850062+0000","last_undegraded":"2024-09-10T21:54:43.850062+0000","last_fullsized":"2024-09-10T21:54:43.850062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863510+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:54:43.863510+0000","last_peered":"2024-09-10T21:54:43.863510+0000","last_clean":"2024-09-10T21:54:43.863510+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:54:43.863510+0000","last_undegraded":"2024-09-10T21:54:43.863510+0000","last_fullsized":"2024-09-10T21:54:43.863510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859187+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:54:43.859187+0000","last_peered":"2024-09-10T21:54:43.859187+0000","last_clean":"2024-09-10T21:54:43.859187+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:54:43.859187+0000","last_undegraded":"2024-09-10T21:54:43.859187+0000","last_fullsized":"2024-09-10T21:54:43.859187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558841+0000","last_change":"2024-09-10T21:53:44.558293+0000","last_active":"2024-09-10T21:53:44.558841+0000","last_peered":"2024-09-10T21:53:44.558841+0000","last_clean":"2024-09-10T21:53:44.558841+0000","last_became_active":"2024-09-10T21:53:44.557902+0000","last_became_peered":"2024-09-10T21:53:44.557902+0000","last_unstale":"2024-09-10T21:53:44.558841+0000","last_undegraded":"2024-09-10T21:53:44.558841+0000","last_fullsized":"2024-09-10T21:53:44.558841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:01.123834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872826+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:54:43.872826+0000","last_peered":"2024-09-10T21:54:43.872826+0000","last_clean":"2024-09-10T21:54:43.872826+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:54:43.872826+0000","last_undegraded":"2024-09-10T21:54:43.872826+0000","last_fullsized":"2024-09-10T21:54:43.872826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"73'16","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864304+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:54:43.864304+0000","last_peered":"2024-09-10T21:54:43.864304+0000","last_clean":"2024-09-10T21:54:43.864304+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:54:43.864304+0000","last_undegraded":"2024-09-10T21:54:43.864304+0000","last_fullsized":"2024-09-10T21:54:43.864304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871022+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:54:43.871022+0000","last_peered":"2024-09-10T21:54:43.871022+0000","last_clean":"2024-09-10T21:54:43.871022+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:54:43.871022+0000","last_undegraded":"2024-09-10T21:54:43.871022+0000","last_fullsized":"2024-09-10T21:54:43.871022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857674+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:54:43.857674+0000","last_peered":"2024-09-10T21:54:43.857674+0000","last_clean":"2024-09-10T21:54:43.857674+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:54:43.857674+0000","last_undegraded":"2024-09-10T21:54:43.857674+0000","last_fullsized":"2024-09-10T21:54:43.857674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555268+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:53:44.555268+0000","last_peered":"2024-09-10T21:53:44.555268+0000","last_clean":"2024-09-10T21:53:44.555268+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:53:44.555268+0000","last_undegraded":"2024-09-10T21:53:44.555268+0000","last_fullsized":"2024-09-10T21:53:44.555268+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555328+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:53:44.555328+0000","last_peered":"2024-09-10T21:53:44.555328+0000","last_clean":"2024-09-10T21:53:44.555328+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:53:44.555328+0000","last_undegraded":"2024-09-10T21:53:44.555328+0000","last_fullsized":"2024-09-10T21:53:44.555328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872658+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:54:43.872658+0000","last_peered":"2024-09-10T21:54:43.872658+0000","last_clean":"2024-09-10T21:54:43.872658+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:54:43.872658+0000","last_undegraded":"2024-09-10T21:54:43.872658+0000","last_fullsized":"2024-09-10T21:54:43.872658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542105+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:53:44.542105+0000","last_peered":"2024-09-10T21:53:44.542105+0000","last_clean":"2024-09-10T21:53:44.542105+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:53:44.542105+0000","last_undegraded":"2024-09-10T21:53:44.542105+0000","last_fullsized":"2024-09-10T21:53:44.542105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543340+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:53:44.543340+0000","last_peered":"2024-09-10T21:53:44.543340+0000","last_clean":"2024-09-10T21:53:44.543340+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:53:44.543340+0000","last_undegraded":"2024-09-10T21:53:44.543340+0000","last_fullsized":"2024-09-10T21:53:44.543340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540012+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:53:44.540012+0000","last_peered":"2024-09-10T21:53:44.540012+0000","last_clean":"2024-09-10T21:53:44.540012+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:53:44.540012+0000","last_undegraded":"2024-09-10T21:53:44.540012+0000","last_fullsized":"2024-09-10T21:53:44.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541613+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:53:44.541613+0000","last_peered":"2024-09-10T21:53:44.541613+0000","last_clean":"2024-09-10T21:53:44.541613+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:53:44.541613+0000","last_undegraded":"2024-09-10T21:53:44.541613+0000","last_fullsized":"2024-09-10T21:53:44.541613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.868551+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:54:43.868551+0000","last_peered":"2024-09-10T21:54:43.868551+0000","last_clean":"2024-09-10T21:54:43.868551+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:54:43.868551+0000","last_undegraded":"2024-09-10T21:54:43.868551+0000","last_fullsized":"2024-09-10T21:54:43.868551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872964+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:54:43.872964+0000","last_peered":"2024-09-10T21:54:43.872964+0000","last_clean":"2024-09-10T21:54:43.872964+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:54:43.872964+0000","last_undegraded":"2024-09-10T21:54:43.872964+0000","last_fullsized":"2024-09-10T21:54:43.872964+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857062+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:54:43.857062+0000","last_peered":"2024-09-10T21:54:43.857062+0000","last_clean":"2024-09-10T21:54:43.857062+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:54:43.857062+0000","last_undegraded":"2024-09-10T21:54:43.857062+0000","last_fullsized":"2024-09-10T21:54:43.857062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544991+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:53:44.544991+0000","last_peered":"2024-09-10T21:53:44.544991+0000","last_clean":"2024-09-10T21:53:44.544991+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:53:44.544991+0000","last_undegraded":"2024-09-10T21:53:44.544991+0000","last_fullsized":"2024-09-10T21:53:44.544991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.852219+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:54:43.852219+0000","last_peered":"2024-09-10T21:54:43.852219+0000","last_clean":"2024-09-10T21:54:43.852219+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:54:43.852219+0000","last_undegraded":"2024-09-10T21:54:43.852219+0000","last_fullsized":"2024-09-10T21:54:43.852219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.540227+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:53:44.540227+0000","last_peered":"2024-09-10T21:53:44.540227+0000","last_clean":"2024-09-10T21:53:44.540227+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:53:44.540227+0000","last_undegraded":"2024-09-10T21:53:44.540227+0000","last_fullsized":"2024-09-10T21:53:44.540227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541969+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:53:44.541969+0000","last_peered":"2024-09-10T21:53:44.541969+0000","last_clean":"2024-09-10T21:53:44.541969+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:53:44.541969+0000","last_undegraded":"2024-09-10T21:53:44.541969+0000","last_fullsized":"2024-09-10T21:53:44.541969+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.867698+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:54:43.867698+0000","last_peered":"2024-09-10T21:54:43.867698+0000","last_clean":"2024-09-10T21:54:43.867698+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:54:43.867698+0000","last_undegraded":"2024-09-10T21:54:43.867698+0000","last_fullsized":"2024-09-10T21:54:43.867698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555443+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:53:44.555443+0000","last_peered":"2024-09-10T21:53:44.555443+0000","last_clean":"2024-09-10T21:53:44.555443+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:53:44.555443+0000","last_undegraded":"2024-09-10T21:53:44.555443+0000","last_fullsized":"2024-09-10T21:53:44.555443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539653+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:53:44.539653+0000","last_peered":"2024-09-10T21:53:44.539653+0000","last_clean":"2024-09-10T21:53:44.539653+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:53:44.539653+0000","last_undegraded":"2024-09-10T21:53:44.539653+0000","last_fullsized":"2024-09-10T21:53:44.539653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.547111+0000","last_change":"2024-09-10T21:53:44.547016+0000","last_active":"2024-09-10T21:53:44.547111+0000","last_peered":"2024-09-10T21:53:44.547111+0000","last_clean":"2024-09-10T21:53:44.547111+0000","last_became_active":"2024-09-10T21:53:44.546627+0000","last_became_peered":"2024-09-10T21:53:44.546627+0000","last_unstale":"2024-09-10T21:53:44.547111+0000","last_undegraded":"2024-09-10T21:53:44.547111+0000","last_fullsized":"2024-09-10T21:53:44.547111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:36.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541388+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:53:44.541388+0000","last_peered":"2024-09-10T21:53:44.541388+0000","last_clean":"2024-09-10T21:53:44.541388+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:53:44.541388+0000","last_undegraded":"2024-09-10T21:53:44.541388+0000","last_fullsized":"2024-09-10T21:53:44.541388+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.861891+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:54:43.861891+0000","last_peered":"2024-09-10T21:54:43.861891+0000","last_clean":"2024-09-10T21:54:43.861891+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:54:43.861891+0000","last_undegraded":"2024-09-10T21:54:43.861891+0000","last_fullsized":"2024-09-10T21:54:43.861891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'6","reported_seq":124,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.380276+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:54:41.380276+0000","last_peered":"2024-09-10T21:54:41.380276+0000","last_clean":"2024-09-10T21:54:41.380276+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:54:41.380276+0000","last_undegraded":"2024-09-10T21:54:41.380276+0000","last_fullsized":"2024-09-10T21:54:41.380276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.546050+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:53:44.546050+0000","last_peered":"2024-09-10T21:53:44.546050+0000","last_clean":"2024-09-10T21:53:44.546050+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:53:44.546050+0000","last_undegraded":"2024-09-10T21:53:44.546050+0000","last_fullsized":"2024-09-10T21:53:44.546050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557192+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:44.557192+0000","last_peered":"2024-09-10T21:53:44.557192+0000","last_clean":"2024-09-10T21:53:44.557192+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:44.557192+0000","last_undegraded":"2024-09-10T21:53:44.557192+0000","last_fullsized":"2024-09-10T21:53:44.557192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539062+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:44.539062+0000","last_peered":"2024-09-10T21:53:44.539062+0000","last_clean":"2024-09-10T21:53:44.539062+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:44.539062+0000","last_undegraded":"2024-09-10T21:53:44.539062+0000","last_fullsized":"2024-09-10T21:53:44.539062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859089+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:54:43.859089+0000","last_peered":"2024-09-10T21:54:43.859089+0000","last_clean":"2024-09-10T21:54:43.859089+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:54:43.859089+0000","last_undegraded":"2024-09-10T21:54:43.859089+0000","last_fullsized":"2024-09-10T21:54:43.859089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545291+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:44.545291+0000","last_peered":"2024-09-10T21:53:44.545291+0000","last_clean":"2024-09-10T21:53:44.545291+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:44.545291+0000","last_undegraded":"2024-09-10T21:53:44.545291+0000","last_fullsized":"2024-09-10T21:53:44.545291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543281+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:53:44.543281+0000","last_peered":"2024-09-10T21:53:44.543281+0000","last_clean":"2024-09-10T21:53:44.543281+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:53:44.543281+0000","last_undegraded":"2024-09-10T21:53:44.543281+0000","last_fullsized":"2024-09-10T21:53:44.543281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'5","reported_seq":220,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.386425+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:54:46.386425+0000","last_peered":"2024-09-10T21:54:46.386425+0000","last_clean":"2024-09-10T21:54:46.386425+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:54:46.386425+0000","last_undegraded":"2024-09-10T21:54:46.386425+0000","last_fullsized":"2024-09-10T21:54:46.386425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873137+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:54:43.873137+0000","last_peered":"2024-09-10T21:54:43.873137+0000","last_clean":"2024-09-10T21:54:43.873137+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:54:43.873137+0000","last_undegraded":"2024-09-10T21:54:43.873137+0000","last_fullsized":"2024-09-10T21:54:43.873137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539991+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:44.539991+0000","last_peered":"2024-09-10T21:53:44.539991+0000","last_clean":"2024-09-10T21:53:44.539991+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:44.539991+0000","last_undegraded":"2024-09-10T21:53:44.539991+0000","last_fullsized":"2024-09-10T21:53:44.539991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555630+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:53:44.555630+0000","last_peered":"2024-09-10T21:53:44.555630+0000","last_clean":"2024-09-10T21:53:44.555630+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:53:44.555630+0000","last_undegraded":"2024-09-10T21:53:44.555630+0000","last_fullsized":"2024-09-10T21:53:44.555630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545577+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:44.545577+0000","last_peered":"2024-09-10T21:53:44.545577+0000","last_clean":"2024-09-10T21:53:44.545577+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:44.545577+0000","last_undegraded":"2024-09-10T21:53:44.545577+0000","last_fullsized":"2024-09-10T21:53:44.545577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.874096+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:54:43.874096+0000","last_peered":"2024-09-10T21:54:43.874096+0000","last_clean":"2024-09-10T21:54:43.874096+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:54:43.874096+0000","last_undegraded":"2024-09-10T21:54:43.874096+0000","last_fullsized":"2024-09-10T21:54:43.874096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'38","reported_seq":265,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.387154+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:54:46.387154+0000","last_peered":"2024-09-10T21:54:46.387154+0000","last_clean":"2024-09-10T21:54:46.387154+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:54:46.387154+0000","last_undegraded":"2024-09-10T21:54:46.387154+0000","last_fullsized":"2024-09-10T21:54:46.387154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67570,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":168,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856478+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:54:43.856478+0000","last_peered":"2024-09-10T21:54:43.856478+0000","last_clean":"2024-09-10T21:54:43.856478+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:54:43.856478+0000","last_undegraded":"2024-09-10T21:54:43.856478+0000","last_fullsized":"2024-09-10T21:54:43.856478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539851+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:44.539851+0000","last_peered":"2024-09-10T21:53:44.539851+0000","last_clean":"2024-09-10T21:53:44.539851+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:44.539851+0000","last_undegraded":"2024-09-10T21:53:44.539851+0000","last_fullsized":"2024-09-10T21:53:44.539851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856502+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:54:43.856502+0000","last_peered":"2024-09-10T21:54:43.856502+0000","last_clean":"2024-09-10T21:54:43.856502+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:54:43.856502+0000","last_undegraded":"2024-09-10T21:54:43.856502+0000","last_fullsized":"2024-09-10T21:54:43.856502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544851+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:44.544851+0000","last_peered":"2024-09-10T21:53:44.544851+0000","last_clean":"2024-09-10T21:53:44.544851+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:44.544851+0000","last_undegraded":"2024-09-10T21:53:44.544851+0000","last_fullsized":"2024-09-10T21:53:44.544851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"73'15","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866098+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:54:43.866098+0000","last_peered":"2024-09-10T21:54:43.866098+0000","last_clean":"2024-09-10T21:54:43.866098+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:54:43.866098+0000","last_undegraded":"2024-09-10T21:54:43.866098+0000","last_fullsized":"2024-09-10T21:54:43.866098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.379610+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:54:41.379610+0000","last_peered":"2024-09-10T21:54:41.379610+0000","last_clean":"2024-09-10T21:54:41.379610+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:54:41.379610+0000","last_undegraded":"2024-09-10T21:54:41.379610+0000","last_fullsized":"2024-09-10T21:54:41.379610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863183+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:54:43.863183+0000","last_peered":"2024-09-10T21:54:43.863183+0000","last_clean":"2024-09-10T21:54:43.863183+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:54:43.863183+0000","last_undegraded":"2024-09-10T21:54:43.863183+0000","last_fullsized":"2024-09-10T21:54:43.863183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542191+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:44.542191+0000","last_peered":"2024-09-10T21:53:44.542191+0000","last_clean":"2024-09-10T21:53:44.542191+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:44.542191+0000","last_undegraded":"2024-09-10T21:53:44.542191+0000","last_fullsized":"2024-09-10T21:53:44.542191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545688+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:53:44.545688+0000","last_peered":"2024-09-10T21:53:44.545688+0000","last_clean":"2024-09-10T21:53:44.545688+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:53:44.545688+0000","last_undegraded":"2024-09-10T21:53:44.545688+0000","last_fullsized":"2024-09-10T21:53:44.545688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542756+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:44.542756+0000","last_peered":"2024-09-10T21:53:44.542756+0000","last_clean":"2024-09-10T21:53:44.542756+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:44.542756+0000","last_undegraded":"2024-09-10T21:53:44.542756+0000","last_fullsized":"2024-09-10T21:53:44.542756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.558295+0000","last_change":"2024-09-10T21:53:44.558208+0000","last_active":"2024-09-10T21:53:44.558295+0000","last_peered":"2024-09-10T21:53:44.558295+0000","last_clean":"2024-09-10T21:53:44.558295+0000","last_became_active":"2024-09-10T21:53:44.557786+0000","last_became_peered":"2024-09-10T21:53:44.557786+0000","last_unstale":"2024-09-10T21:53:44.558295+0000","last_undegraded":"2024-09-10T21:53:44.558295+0000","last_fullsized":"2024-09-10T21:53:44.558295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:35.278172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539468+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:44.539468+0000","last_peered":"2024-09-10T21:53:44.539468+0000","last_clean":"2024-09-10T21:53:44.539468+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:44.539468+0000","last_undegraded":"2024-09-10T21:53:44.539468+0000","last_fullsized":"2024-09-10T21:53:44.539468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857279+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:54:43.857279+0000","last_peered":"2024-09-10T21:54:43.857279+0000","last_clean":"2024-09-10T21:54:43.857279+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:54:43.857279+0000","last_undegraded":"2024-09-10T21:54:43.857279+0000","last_fullsized":"2024-09-10T21:54:43.857279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545708+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:44.545708+0000","last_peered":"2024-09-10T21:53:44.545708+0000","last_clean":"2024-09-10T21:53:44.545708+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:44.545708+0000","last_undegraded":"2024-09-10T21:53:44.545708+0000","last_fullsized":"2024-09-10T21:53:44.545708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858977+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:54:43.858977+0000","last_peered":"2024-09-10T21:54:43.858977+0000","last_clean":"2024-09-10T21:54:43.858977+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:54:43.858977+0000","last_undegraded":"2024-09-10T21:54:43.858977+0000","last_fullsized":"2024-09-10T21:54:43.858977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.380145+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:54:41.380145+0000","last_peered":"2024-09-10T21:54:41.380145+0000","last_clean":"2024-09-10T21:54:41.380145+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:54:41.380145+0000","last_undegraded":"2024-09-10T21:54:41.380145+0000","last_fullsized":"2024-09-10T21:54:41.380145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.870982+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:54:43.870982+0000","last_peered":"2024-09-10T21:54:43.870982+0000","last_clean":"2024-09-10T21:54:43.870982+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:54:43.870982+0000","last_undegraded":"2024-09-10T21:54:43.870982+0000","last_fullsized":"2024-09-10T21:54:43.870982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539769+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:44.539769+0000","last_peered":"2024-09-10T21:53:44.539769+0000","last_clean":"2024-09-10T21:53:44.539769+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:44.539769+0000","last_undegraded":"2024-09-10T21:53:44.539769+0000","last_fullsized":"2024-09-10T21:53:44.539769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866759+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:54:43.866759+0000","last_peered":"2024-09-10T21:54:43.866759+0000","last_clean":"2024-09-10T21:54:43.866759+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:54:43.866759+0000","last_undegraded":"2024-09-10T21:54:43.866759+0000","last_fullsized":"2024-09-10T21:54:43.866759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539673+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:44.539673+0000","last_peered":"2024-09-10T21:53:44.539673+0000","last_clean":"2024-09-10T21:53:44.539673+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:44.539673+0000","last_undegraded":"2024-09-10T21:53:44.539673+0000","last_fullsized":"2024-09-10T21:53:44.539673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'5","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858804+0000","last_change":"2024-09-10T21:53:44.544497+0000","last_active":"2024-09-10T21:54:43.858804+0000","last_peered":"2024-09-10T21:54:43.858804+0000","last_clean":"2024-09-10T21:54:43.858804+0000","last_became_active":"2024-09-10T21:53:44.544086+0000","last_became_peered":"2024-09-10T21:53:44.544086+0000","last_unstale":"2024-09-10T21:54:43.858804+0000","last_undegraded":"2024-09-10T21:54:43.858804+0000","last_fullsized":"2024-09-10T21:54:43.858804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:42.547771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.382061+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:54:43.382061+0000","last_peered":"2024-09-10T21:54:43.382061+0000","last_clean":"2024-09-10T21:54:43.382061+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:54:43.382061+0000","last_undegraded":"2024-09-10T21:54:43.382061+0000","last_fullsized":"2024-09-10T21:54:43.382061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545100+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:53:44.545100+0000","last_peered":"2024-09-10T21:53:44.545100+0000","last_clean":"2024-09-10T21:53:44.545100+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:53:44.545100+0000","last_undegraded":"2024-09-10T21:53:44.545100+0000","last_fullsized":"2024-09-10T21:53:44.545100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":125,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:45.388324+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:54:45.388324+0000","last_peered":"2024-09-10T21:54:45.388324+0000","last_clean":"2024-09-10T21:54:45.388324+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:54:45.388324+0000","last_undegraded":"2024-09-10T21:54:45.388324+0000","last_fullsized":"2024-09-10T21:54:45.388324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863028+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:54:43.863028+0000","last_peered":"2024-09-10T21:54:43.863028+0000","last_clean":"2024-09-10T21:54:43.863028+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:54:43.863028+0000","last_undegraded":"2024-09-10T21:54:43.863028+0000","last_fullsized":"2024-09-10T21:54:43.863028+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543424+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:44.543424+0000","last_peered":"2024-09-10T21:53:44.543424+0000","last_clean":"2024-09-10T21:53:44.543424+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:44.543424+0000","last_undegraded":"2024-09-10T21:53:44.543424+0000","last_fullsized":"2024-09-10T21:53:44.543424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.854707+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:54:43.854707+0000","last_peered":"2024-09-10T21:54:43.854707+0000","last_clean":"2024-09-10T21:54:43.854707+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:54:43.854707+0000","last_undegraded":"2024-09-10T21:54:43.854707+0000","last_fullsized":"2024-09-10T21:54:43.854707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543551+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:44.543551+0000","last_peered":"2024-09-10T21:53:44.543551+0000","last_clean":"2024-09-10T21:53:44.543551+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:44.543551+0000","last_undegraded":"2024-09-10T21:53:44.543551+0000","last_fullsized":"2024-09-10T21:53:44.543551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858910+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:54:43.858910+0000","last_peered":"2024-09-10T21:54:43.858910+0000","last_clean":"2024-09-10T21:54:43.858910+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:54:43.858910+0000","last_undegraded":"2024-09-10T21:54:43.858910+0000","last_fullsized":"2024-09-10T21:54:43.858910+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'14","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543451+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:53:44.543451+0000","last_peered":"2024-09-10T21:53:44.543451+0000","last_clean":"2024-09-10T21:53:44.543451+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:53:44.543451+0000","last_undegraded":"2024-09-10T21:53:44.543451+0000","last_fullsized":"2024-09-10T21:53:44.543451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.860205+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:54:43.860205+0000","last_peered":"2024-09-10T21:54:43.860205+0000","last_clean":"2024-09-10T21:54:43.860205+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:54:43.860205+0000","last_undegraded":"2024-09-10T21:54:43.860205+0000","last_fullsized":"2024-09-10T21:54:43.860205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556856+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:44.556856+0000","last_peered":"2024-09-10T21:53:44.556856+0000","last_clean":"2024-09-10T21:53:44.556856+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:44.556856+0000","last_undegraded":"2024-09-10T21:53:44.556856+0000","last_fullsized":"2024-09-10T21:53:44.556856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555472+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:53:44.555472+0000","last_peered":"2024-09-10T21:53:44.555472+0000","last_clean":"2024-09-10T21:53:44.555472+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:53:44.555472+0000","last_undegraded":"2024-09-10T21:53:44.555472+0000","last_fullsized":"2024-09-10T21:53:44.555472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543821+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:44.543821+0000","last_peered":"2024-09-10T21:53:44.543821+0000","last_clean":"2024-09-10T21:53:44.543821+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:44.543821+0000","last_undegraded":"2024-09-10T21:53:44.543821+0000","last_fullsized":"2024-09-10T21:53:44.543821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.822745+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:54:43.822745+0000","last_peered":"2024-09-10T21:54:43.822745+0000","last_clean":"2024-09-10T21:54:43.822745+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:54:43.822745+0000","last_undegraded":"2024-09-10T21:54:43.822745+0000","last_fullsized":"2024-09-10T21:54:43.822745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544539+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:44.544539+0000","last_peered":"2024-09-10T21:53:44.544539+0000","last_clean":"2024-09-10T21:53:44.544539+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:44.544539+0000","last_undegraded":"2024-09-10T21:53:44.544539+0000","last_fullsized":"2024-09-10T21:53:44.544539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.541458+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:53:44.541458+0000","last_peered":"2024-09-10T21:53:44.541458+0000","last_clean":"2024-09-10T21:53:44.541458+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:53:44.541458+0000","last_undegraded":"2024-09-10T21:53:44.541458+0000","last_fullsized":"2024-09-10T21:53:44.541458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.551887+0000","last_change":"2024-09-10T21:53:44.551320+0000","last_active":"2024-09-10T21:53:44.551887+0000","last_peered":"2024-09-10T21:53:44.551887+0000","last_clean":"2024-09-10T21:53:44.551887+0000","last_became_active":"2024-09-10T21:53:44.546446+0000","last_became_peered":"2024-09-10T21:53:44.546446+0000","last_unstale":"2024-09-10T21:53:44.551887+0000","last_undegraded":"2024-09-10T21:53:44.551887+0000","last_fullsized":"2024-09-10T21:53:44.551887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:19.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.869015+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:54:43.869015+0000","last_peered":"2024-09-10T21:54:43.869015+0000","last_clean":"2024-09-10T21:54:43.869015+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:54:43.869015+0000","last_undegraded":"2024-09-10T21:54:43.869015+0000","last_fullsized":"2024-09-10T21:54:43.869015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542660+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:44.542660+0000","last_peered":"2024-09-10T21:53:44.542660+0000","last_clean":"2024-09-10T21:53:44.542660+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:44.542660+0000","last_undegraded":"2024-09-10T21:53:44.542660+0000","last_fullsized":"2024-09-10T21:53:44.542660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871320+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:54:43.871320+0000","last_peered":"2024-09-10T21:54:43.871320+0000","last_clean":"2024-09-10T21:54:43.871320+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:54:43.871320+0000","last_undegraded":"2024-09-10T21:54:43.871320+0000","last_fullsized":"2024-09-10T21:54:43.871320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.548275+0000","last_change":"2024-09-10T21:53:44.548188+0000","last_active":"2024-09-10T21:53:44.548275+0000","last_peered":"2024-09-10T21:53:44.548275+0000","last_clean":"2024-09-10T21:53:44.548275+0000","last_became_active":"2024-09-10T21:53:44.547897+0000","last_became_peered":"2024-09-10T21:53:44.547897+0000","last_unstale":"2024-09-10T21:53:44.548275+0000","last_undegraded":"2024-09-10T21:53:44.548275+0000","last_fullsized":"2024-09-10T21:53:44.548275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:21.351072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557183+0000","last_change":"2024-09-10T21:53:44.556670+0000","last_active":"2024-09-10T21:53:44.557183+0000","last_peered":"2024-09-10T21:53:44.557183+0000","last_clean":"2024-09-10T21:53:44.557183+0000","last_became_active":"2024-09-10T21:53:44.546758+0000","last_became_peered":"2024-09-10T21:53:44.546758+0000","last_unstale":"2024-09-10T21:53:44.557183+0000","last_undegraded":"2024-09-10T21:53:44.557183+0000","last_fullsized":"2024-09-10T21:53:44.557183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:02.292116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873786+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:54:43.873786+0000","last_peered":"2024-09-10T21:54:43.873786+0000","last_clean":"2024-09-10T21:54:43.873786+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:54:43.873786+0000","last_undegraded":"2024-09-10T21:54:43.873786+0000","last_fullsized":"2024-09-10T21:54:43.873786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.568857+0000","last_change":"2024-09-10T21:53:44.568775+0000","last_active":"2024-09-10T21:53:44.568857+0000","last_peered":"2024-09-10T21:53:44.568857+0000","last_clean":"2024-09-10T21:53:44.568857+0000","last_became_active":"2024-09-10T21:53:44.558126+0000","last_became_peered":"2024-09-10T21:53:44.558126+0000","last_unstale":"2024-09-10T21:53:44.568857+0000","last_undegraded":"2024-09-10T21:53:44.568857+0000","last_fullsized":"2024-09-10T21:53:44.568857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:00.789948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.555627+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:53:44.555627+0000","last_peered":"2024-09-10T21:53:44.555627+0000","last_clean":"2024-09-10T21:53:44.555627+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:53:44.555627+0000","last_undegraded":"2024-09-10T21:53:44.555627+0000","last_fullsized":"2024-09-10T21:53:44.555627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544324+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:44.544324+0000","last_peered":"2024-09-10T21:53:44.544324+0000","last_clean":"2024-09-10T21:53:44.544324+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:44.544324+0000","last_undegraded":"2024-09-10T21:53:44.544324+0000","last_fullsized":"2024-09-10T21:53:44.544324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863774+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:54:43.863774+0000","last_peered":"2024-09-10T21:54:43.863774+0000","last_clean":"2024-09-10T21:54:43.863774+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:54:43.863774+0000","last_undegraded":"2024-09-10T21:54:43.863774+0000","last_fullsized":"2024-09-10T21:54:43.863774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":129,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:41.382933+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:54:41.382933+0000","last_peered":"2024-09-10T21:54:41.382933+0000","last_clean":"2024-09-10T21:54:41.382933+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:54:41.382933+0000","last_undegraded":"2024-09-10T21:54:41.382933+0000","last_fullsized":"2024-09-10T21:54:41.382933+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74383,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":984,"num_read_kb":576,"num_write":250,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":218727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874275,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":798720,"data_stored":388106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037799,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1041418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201324,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":387454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":387250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593782,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":981190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724603,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":387171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":980028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":387032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":386996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":451003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":455654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":823296,"data_stored":388510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:54:49.404 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T21:54:49.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 -- 172.21.15.39:0/1524658827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6054102a00 msgr2=0x7f6054102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 --2- 172.21.15.39:0/1524658827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6054102a00 0x7f6054102e80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f603c009890 tx=0x7f603c02a380 comp rx=0 tx=0).stop 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 -- 172.21.15.39:0/1524658827 shutdown_connections 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 --2- 172.21.15.39:0/1524658827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f6054109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 --2- 172.21.15.39:0/1524658827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6054102a00 0x7f6054102e80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 --2- 172.21.15.39:0/1524658827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60541018b0 0x7f6054101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 -- 172.21.15.39:0/1524658827 >> 172.21.15.39:0/1524658827 conn(0x7f60540fd190 msgr2=0x7f60540ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 -- 172.21.15.39:0/1524658827 shutdown_connections 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.543+0000 7f6058edd640 1 -- 172.21.15.39:0/1524658827 wait complete. 2024-09-10T21:54:49.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 Processor -- start 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 -- start start 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6054102a00 0x7f6054199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f605419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d520 con 0x7f60541018b0 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d3a0 con 0x7f60541033c0 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f6058edd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d6a0 con 0x7f6054102a00 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.544+0000 7f605259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34492/0 (socket says 172.21.15.39:34492) 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 -- 172.21.15.39:0/2984931923 learned_addr learned my addr 172.21.15.39:0/2984931923 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f6052d9d640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f605419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 -- 172.21.15.39:0/2984931923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6054102a00 msgr2=0x7f6054199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f604bfff640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6054102a00 0x7f6054199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6054102a00 0x7f6054199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 -- 172.21.15.39:0/2984931923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 msgr2=0x7f605419a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f605419a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 -- 172.21.15.39:0/2984931923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605419a930 con 0x7f60541018b0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f6052d9d640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f605419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f605259c640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f604400e9f0 tx=0x7f604400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604400cd80 con 0x7f60541018b0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60440054d0 con 0x7f60541018b0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044010690 con 0x7f60541018b0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605419ac20 con 0x7f60541018b0 2024-09-10T21:54:49.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.545+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60541a12f0 con 0x7f60541018b0 2024-09-10T21:54:49.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.546+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60541a14c0 con 0x7f60541018b0 2024-09-10T21:54:49.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.548+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f6044004e30 con 0x7f60541018b0 2024-09-10T21:54:49.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.548+0000 7f604b7fe640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 0x7f60400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:49.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.549+0000 7f604bfff640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 0x7f60400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:49.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.549+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f60440e64c0 con 0x7f60541018b0 2024-09-10T21:54:49.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.549+0000 7f604bfff640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 0x7f60400b7830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f603c0304b0 tx=0x7f603c030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:49.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.551+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6044056220 con 0x7f60541018b0 2024-09-10T21:54:49.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:49 smithi039 ceph-mon[30872]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.733+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 --> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60540ff360 con 0x7f60400b5370 2024-09-10T21:54:49.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.738+0000 7f604b7fe640 1 -- 172.21.15.39:0/2984931923 <== mgr.14150 v2:172.21.15.39:6800/423421889 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259021 (secure 0 0 0) 0x7f60540ff360 con 0x7f60400b5370 2024-09-10T21:54:49.741 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:49.742 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 msgr2=0x7f60400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 0x7f60400b7830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f603c0304b0 tx=0x7f603c030340 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 msgr2=0x7f6054198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f604400e9f0 tx=0x7f604400edf0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 shutdown_connections 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60400b5370 0x7f60400b7830 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60541033c0 0x7f605419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6054102a00 0x7f6054199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 --2- 172.21.15.39:0/2984931923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60541018b0 0x7f6054198df0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 >> 172.21.15.39:0/2984931923 conn(0x7f60540fd190 msgr2=0x7f60540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:49.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 shutdown_connections 2024-09-10T21:54:49.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:49.741+0000 7f6058edd640 1 -- 172.21.15.39:0/2984931923 wait complete. 2024-09-10T21:54:49.753 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-10T21:54:49.479372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665825,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1083,"num_read_kb":648,"num_write":388,"num_write_kb":2306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952422,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369072,"kb_used_data":11504,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572752,"statfs":{"total":1151940427776,"available":1151562498048,"internally_reserved":0,"allocated":11780096,"data_stored":6628754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6102,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":65,"num_write":20,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002890"},"pg_stats":[{"pgid":"3.3f","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.870422+0000","last_change":"2024-09-10T21:53:00.021445+0000","last_active":"2024-09-10T21:54:43.870422+0000","last_peered":"2024-09-10T21:54:43.870422+0000","last_clean":"2024-09-10T21:54:43.870422+0000","last_became_active":"2024-09-10T21:53:00.021149+0000","last_became_peered":"2024-09-10T21:53:00.021149+0000","last_unstale":"2024-09-10T21:54:43.870422+0000","last_undegraded":"2024-09-10T21:54:43.870422+0000","last_fullsized":"2024-09-10T21:54:43.870422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.929860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866780+0000","last_change":"2024-09-10T21:53:00.011460+0000","last_active":"2024-09-10T21:54:43.866780+0000","last_peered":"2024-09-10T21:54:43.866780+0000","last_clean":"2024-09-10T21:54:43.866780+0000","last_became_active":"2024-09-10T21:53:00.011162+0000","last_became_peered":"2024-09-10T21:53:00.011162+0000","last_unstale":"2024-09-10T21:54:43.866780+0000","last_undegraded":"2024-09-10T21:54:43.866780+0000","last_fullsized":"2024-09-10T21:54:43.866780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:41.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.869707+0000","last_change":"2024-09-10T21:53:00.018710+0000","last_active":"2024-09-10T21:54:43.869707+0000","last_peered":"2024-09-10T21:54:43.869707+0000","last_clean":"2024-09-10T21:54:43.869707+0000","last_became_active":"2024-09-10T21:53:00.018353+0000","last_became_peered":"2024-09-10T21:53:00.018353+0000","last_unstale":"2024-09-10T21:54:43.869707+0000","last_undegraded":"2024-09-10T21:54:43.869707+0000","last_fullsized":"2024-09-10T21:54:43.869707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:51.482419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863862+0000","last_change":"2024-09-10T21:53:00.006576+0000","last_active":"2024-09-10T21:54:43.863862+0000","last_peered":"2024-09-10T21:54:43.863862+0000","last_clean":"2024-09-10T21:54:43.863862+0000","last_became_active":"2024-09-10T21:53:00.006183+0000","last_became_peered":"2024-09-10T21:53:00.006183+0000","last_unstale":"2024-09-10T21:54:43.863862+0000","last_undegraded":"2024-09-10T21:54:43.863862+0000","last_fullsized":"2024-09-10T21:54:43.863862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.785648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.850062+0000","last_change":"2024-09-10T21:53:00.015662+0000","last_active":"2024-09-10T21:54:43.850062+0000","last_peered":"2024-09-10T21:54:43.850062+0000","last_clean":"2024-09-10T21:54:43.850062+0000","last_became_active":"2024-09-10T21:53:00.015337+0000","last_became_peered":"2024-09-10T21:53:00.015337+0000","last_unstale":"2024-09-10T21:54:43.850062+0000","last_undegraded":"2024-09-10T21:54:43.850062+0000","last_fullsized":"2024-09-10T21:54:43.850062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:58.734851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863510+0000","last_change":"2024-09-10T21:53:00.023203+0000","last_active":"2024-09-10T21:54:43.863510+0000","last_peered":"2024-09-10T21:54:43.863510+0000","last_clean":"2024-09-10T21:54:43.863510+0000","last_became_active":"2024-09-10T21:53:00.022282+0000","last_became_peered":"2024-09-10T21:53:00.022282+0000","last_unstale":"2024-09-10T21:54:43.863510+0000","last_undegraded":"2024-09-10T21:54:43.863510+0000","last_fullsized":"2024-09-10T21:54:43.863510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:26.950655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859187+0000","last_change":"2024-09-10T21:53:00.008706+0000","last_active":"2024-09-10T21:54:43.859187+0000","last_peered":"2024-09-10T21:54:43.859187+0000","last_clean":"2024-09-10T21:54:43.859187+0000","last_became_active":"2024-09-10T21:53:00.008397+0000","last_became_peered":"2024-09-10T21:53:00.008397+0000","last_unstale":"2024-09-10T21:54:43.859187+0000","last_undegraded":"2024-09-10T21:54:43.859187+0000","last_fullsized":"2024-09-10T21:54:43.859187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:24.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"73'9","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864591+0000","last_change":"2024-09-10T21:53:44.558293+0000","last_active":"2024-09-10T21:54:43.864591+0000","last_peered":"2024-09-10T21:54:43.864591+0000","last_clean":"2024-09-10T21:54:43.864591+0000","last_became_active":"2024-09-10T21:53:44.557902+0000","last_became_peered":"2024-09-10T21:53:44.557902+0000","last_unstale":"2024-09-10T21:54:43.864591+0000","last_undegraded":"2024-09-10T21:54:43.864591+0000","last_fullsized":"2024-09-10T21:54:43.864591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:01.123834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872826+0000","last_change":"2024-09-10T21:53:00.026579+0000","last_active":"2024-09-10T21:54:43.872826+0000","last_peered":"2024-09-10T21:54:43.872826+0000","last_clean":"2024-09-10T21:54:43.872826+0000","last_became_active":"2024-09-10T21:53:00.025776+0000","last_became_peered":"2024-09-10T21:53:00.025776+0000","last_unstale":"2024-09-10T21:54:43.872826+0000","last_undegraded":"2024-09-10T21:54:43.872826+0000","last_fullsized":"2024-09-10T21:54:43.872826+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.501496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"73'16","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864304+0000","last_change":"2024-09-10T21:53:00.024035+0000","last_active":"2024-09-10T21:54:43.864304+0000","last_peered":"2024-09-10T21:54:43.864304+0000","last_clean":"2024-09-10T21:54:43.864304+0000","last_became_active":"2024-09-10T21:53:00.023706+0000","last_became_peered":"2024-09-10T21:53:00.023706+0000","last_unstale":"2024-09-10T21:54:43.864304+0000","last_undegraded":"2024-09-10T21:54:43.864304+0000","last_fullsized":"2024-09-10T21:54:43.864304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:33.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871022+0000","last_change":"2024-09-10T21:53:00.023912+0000","last_active":"2024-09-10T21:54:43.871022+0000","last_peered":"2024-09-10T21:54:43.871022+0000","last_clean":"2024-09-10T21:54:43.871022+0000","last_became_active":"2024-09-10T21:53:00.020594+0000","last_became_peered":"2024-09-10T21:53:00.020594+0000","last_unstale":"2024-09-10T21:54:43.871022+0000","last_undegraded":"2024-09-10T21:54:43.871022+0000","last_fullsized":"2024-09-10T21:54:43.871022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.685155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.868235+0000","last_change":"2024-09-10T21:53:00.013072+0000","last_active":"2024-09-10T21:54:43.868235+0000","last_peered":"2024-09-10T21:54:43.868235+0000","last_clean":"2024-09-10T21:54:43.868235+0000","last_became_active":"2024-09-10T21:53:00.011003+0000","last_became_peered":"2024-09-10T21:53:00.011003+0000","last_unstale":"2024-09-10T21:54:43.868235+0000","last_undegraded":"2024-09-10T21:54:43.868235+0000","last_fullsized":"2024-09-10T21:54:43.868235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:37.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857674+0000","last_change":"2024-09-10T21:53:00.013285+0000","last_active":"2024-09-10T21:54:43.857674+0000","last_peered":"2024-09-10T21:54:43.857674+0000","last_clean":"2024-09-10T21:54:43.857674+0000","last_became_active":"2024-09-10T21:53:00.012022+0000","last_became_peered":"2024-09-10T21:53:00.012022+0000","last_unstale":"2024-09-10T21:54:43.857674+0000","last_undegraded":"2024-09-10T21:54:43.857674+0000","last_fullsized":"2024-09-10T21:54:43.857674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:22.641108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864434+0000","last_change":"2024-09-10T21:53:00.019986+0000","last_active":"2024-09-10T21:54:43.864434+0000","last_peered":"2024-09-10T21:54:43.864434+0000","last_clean":"2024-09-10T21:54:43.864434+0000","last_became_active":"2024-09-10T21:53:00.019674+0000","last_became_peered":"2024-09-10T21:53:00.019674+0000","last_unstale":"2024-09-10T21:54:43.864434+0000","last_undegraded":"2024-09-10T21:54:43.864434+0000","last_fullsized":"2024-09-10T21:54:43.864434+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:55.839445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.862920+0000","last_change":"2024-09-10T21:53:00.015656+0000","last_active":"2024-09-10T21:54:43.862920+0000","last_peered":"2024-09-10T21:54:43.862920+0000","last_clean":"2024-09-10T21:54:43.862920+0000","last_became_active":"2024-09-10T21:53:00.014558+0000","last_became_peered":"2024-09-10T21:53:00.014558+0000","last_unstale":"2024-09-10T21:54:43.862920+0000","last_undegraded":"2024-09-10T21:54:43.862920+0000","last_fullsized":"2024-09-10T21:54:43.862920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:56.379506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872658+0000","last_change":"2024-09-10T21:53:00.024519+0000","last_active":"2024-09-10T21:54:43.872658+0000","last_peered":"2024-09-10T21:54:43.872658+0000","last_clean":"2024-09-10T21:54:43.872658+0000","last_became_active":"2024-09-10T21:53:00.021996+0000","last_became_peered":"2024-09-10T21:53:00.021996+0000","last_unstale":"2024-09-10T21:54:43.872658+0000","last_undegraded":"2024-09-10T21:54:43.872658+0000","last_fullsized":"2024-09-10T21:54:43.872658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:08.760141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871066+0000","last_change":"2024-09-10T21:53:00.022940+0000","last_active":"2024-09-10T21:54:43.871066+0000","last_peered":"2024-09-10T21:54:43.871066+0000","last_clean":"2024-09-10T21:54:43.871066+0000","last_became_active":"2024-09-10T21:53:00.022631+0000","last_became_peered":"2024-09-10T21:53:00.022631+0000","last_unstale":"2024-09-10T21:54:43.871066+0000","last_undegraded":"2024-09-10T21:54:43.871066+0000","last_fullsized":"2024-09-10T21:54:43.871066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.209594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.865179+0000","last_change":"2024-09-10T21:53:00.011729+0000","last_active":"2024-09-10T21:54:43.865179+0000","last_peered":"2024-09-10T21:54:43.865179+0000","last_clean":"2024-09-10T21:54:43.865179+0000","last_became_active":"2024-09-10T21:53:00.011433+0000","last_became_peered":"2024-09-10T21:53:00.011433+0000","last_unstale":"2024-09-10T21:54:43.865179+0000","last_undegraded":"2024-09-10T21:54:43.865179+0000","last_fullsized":"2024-09-10T21:54:43.865179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:23.249514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857737+0000","last_change":"2024-09-10T21:53:00.018054+0000","last_active":"2024-09-10T21:54:43.857737+0000","last_peered":"2024-09-10T21:54:43.857737+0000","last_clean":"2024-09-10T21:54:43.857737+0000","last_became_active":"2024-09-10T21:53:00.016236+0000","last_became_peered":"2024-09-10T21:53:00.016236+0000","last_unstale":"2024-09-10T21:54:43.857737+0000","last_undegraded":"2024-09-10T21:54:43.857737+0000","last_fullsized":"2024-09-10T21:54:43.857737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:12.406260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858707+0000","last_change":"2024-09-10T21:53:00.016045+0000","last_active":"2024-09-10T21:54:43.858707+0000","last_peered":"2024-09-10T21:54:43.858707+0000","last_clean":"2024-09-10T21:54:43.858707+0000","last_became_active":"2024-09-10T21:53:00.015726+0000","last_became_peered":"2024-09-10T21:53:00.015726+0000","last_unstale":"2024-09-10T21:54:43.858707+0000","last_undegraded":"2024-09-10T21:54:43.858707+0000","last_fullsized":"2024-09-10T21:54:43.858707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:08.988875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.868551+0000","last_change":"2024-09-10T21:53:00.014039+0000","last_active":"2024-09-10T21:54:43.868551+0000","last_peered":"2024-09-10T21:54:43.868551+0000","last_clean":"2024-09-10T21:54:43.868551+0000","last_became_active":"2024-09-10T21:53:00.013686+0000","last_became_peered":"2024-09-10T21:53:00.013686+0000","last_unstale":"2024-09-10T21:54:43.868551+0000","last_undegraded":"2024-09-10T21:54:43.868551+0000","last_fullsized":"2024-09-10T21:54:43.868551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:34.381011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.872964+0000","last_change":"2024-09-10T21:53:00.025097+0000","last_active":"2024-09-10T21:54:43.872964+0000","last_peered":"2024-09-10T21:54:43.872964+0000","last_clean":"2024-09-10T21:54:43.872964+0000","last_became_active":"2024-09-10T21:53:00.024810+0000","last_became_peered":"2024-09-10T21:53:00.024810+0000","last_unstale":"2024-09-10T21:54:43.872964+0000","last_undegraded":"2024-09-10T21:54:43.872964+0000","last_fullsized":"2024-09-10T21:54:43.872964+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:25.724682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857062+0000","last_change":"2024-09-10T21:53:00.012443+0000","last_active":"2024-09-10T21:54:43.857062+0000","last_peered":"2024-09-10T21:54:43.857062+0000","last_clean":"2024-09-10T21:54:43.857062+0000","last_became_active":"2024-09-10T21:53:00.012015+0000","last_became_peered":"2024-09-10T21:53:00.012015+0000","last_unstale":"2024-09-10T21:54:43.857062+0000","last_undegraded":"2024-09-10T21:54:43.857062+0000","last_fullsized":"2024-09-10T21:54:43.857062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:39.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.860576+0000","last_change":"2024-09-10T21:53:00.022547+0000","last_active":"2024-09-10T21:54:43.860576+0000","last_peered":"2024-09-10T21:54:43.860576+0000","last_clean":"2024-09-10T21:54:43.860576+0000","last_became_active":"2024-09-10T21:53:00.021911+0000","last_became_peered":"2024-09-10T21:53:00.021911+0000","last_unstale":"2024-09-10T21:54:43.860576+0000","last_undegraded":"2024-09-10T21:54:43.860576+0000","last_fullsized":"2024-09-10T21:54:43.860576+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:37.204742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.852219+0000","last_change":"2024-09-10T21:53:00.021203+0000","last_active":"2024-09-10T21:54:43.852219+0000","last_peered":"2024-09-10T21:54:43.852219+0000","last_clean":"2024-09-10T21:54:43.852219+0000","last_became_active":"2024-09-10T21:53:00.020921+0000","last_became_peered":"2024-09-10T21:53:00.020921+0000","last_unstale":"2024-09-10T21:54:43.852219+0000","last_undegraded":"2024-09-10T21:54:43.852219+0000","last_fullsized":"2024-09-10T21:54:43.852219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:16.663917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'15","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.869012+0000","last_change":"2024-09-10T21:53:00.011985+0000","last_active":"2024-09-10T21:54:43.869012+0000","last_peered":"2024-09-10T21:54:43.869012+0000","last_clean":"2024-09-10T21:54:43.869012+0000","last_became_active":"2024-09-10T21:53:00.011662+0000","last_became_peered":"2024-09-10T21:53:00.011662+0000","last_unstale":"2024-09-10T21:54:43.869012+0000","last_undegraded":"2024-09-10T21:54:43.869012+0000","last_fullsized":"2024-09-10T21:54:43.869012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:46.472532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.855052+0000","last_change":"2024-09-10T21:53:00.014871+0000","last_active":"2024-09-10T21:54:43.855052+0000","last_peered":"2024-09-10T21:54:43.855052+0000","last_clean":"2024-09-10T21:54:43.855052+0000","last_became_active":"2024-09-10T21:53:00.013509+0000","last_became_peered":"2024-09-10T21:53:00.013509+0000","last_unstale":"2024-09-10T21:54:43.855052+0000","last_undegraded":"2024-09-10T21:54:43.855052+0000","last_fullsized":"2024-09-10T21:54:43.855052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:56.616937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"73'4","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.867698+0000","last_change":"2024-09-10T21:53:00.013189+0000","last_active":"2024-09-10T21:54:43.867698+0000","last_peered":"2024-09-10T21:54:43.867698+0000","last_clean":"2024-09-10T21:54:43.867698+0000","last_became_active":"2024-09-10T21:53:00.012882+0000","last_became_peered":"2024-09-10T21:53:00.012882+0000","last_unstale":"2024-09-10T21:54:43.867698+0000","last_undegraded":"2024-09-10T21:54:43.867698+0000","last_fullsized":"2024-09-10T21:54:43.867698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:54.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.865530+0000","last_change":"2024-09-10T21:53:00.014167+0000","last_active":"2024-09-10T21:54:43.865530+0000","last_peered":"2024-09-10T21:54:43.865530+0000","last_clean":"2024-09-10T21:54:43.865530+0000","last_became_active":"2024-09-10T21:53:00.013845+0000","last_became_peered":"2024-09-10T21:53:00.013845+0000","last_unstale":"2024-09-10T21:54:43.865530+0000","last_undegraded":"2024-09-10T21:54:43.865530+0000","last_fullsized":"2024-09-10T21:54:43.865530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.578349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859974+0000","last_change":"2024-09-10T21:53:00.018188+0000","last_active":"2024-09-10T21:54:43.859974+0000","last_peered":"2024-09-10T21:54:43.859974+0000","last_clean":"2024-09-10T21:54:43.859974+0000","last_became_active":"2024-09-10T21:53:00.016576+0000","last_became_peered":"2024-09-10T21:53:00.016576+0000","last_unstale":"2024-09-10T21:54:43.859974+0000","last_undegraded":"2024-09-10T21:54:43.859974+0000","last_fullsized":"2024-09-10T21:54:43.859974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:32.308449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"73'12","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863275+0000","last_change":"2024-09-10T21:53:44.547016+0000","last_active":"2024-09-10T21:54:43.863275+0000","last_peered":"2024-09-10T21:54:43.863275+0000","last_clean":"2024-09-10T21:54:43.863275+0000","last_became_active":"2024-09-10T21:53:44.546627+0000","last_became_peered":"2024-09-10T21:53:44.546627+0000","last_unstale":"2024-09-10T21:54:43.863275+0000","last_undegraded":"2024-09-10T21:54:43.863275+0000","last_fullsized":"2024-09-10T21:54:43.863275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:36.171351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.855585+0000","last_change":"2024-09-10T21:53:00.017498+0000","last_active":"2024-09-10T21:54:43.855585+0000","last_peered":"2024-09-10T21:54:43.855585+0000","last_clean":"2024-09-10T21:54:43.855585+0000","last_became_active":"2024-09-10T21:53:00.017184+0000","last_became_peered":"2024-09-10T21:53:00.017184+0000","last_unstale":"2024-09-10T21:54:43.855585+0000","last_undegraded":"2024-09-10T21:54:43.855585+0000","last_fullsized":"2024-09-10T21:54:43.855585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:57.333481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.861891+0000","last_change":"2024-09-10T21:53:00.011451+0000","last_active":"2024-09-10T21:54:43.861891+0000","last_peered":"2024-09-10T21:54:43.861891+0000","last_clean":"2024-09-10T21:54:43.861891+0000","last_became_active":"2024-09-10T21:53:00.011086+0000","last_became_peered":"2024-09-10T21:53:00.011086+0000","last_unstale":"2024-09-10T21:54:43.861891+0000","last_undegraded":"2024-09-10T21:54:43.861891+0000","last_fullsized":"2024-09-10T21:54:43.861891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:11.912408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'9","reported_seq":135,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.388546+0000","last_change":"2024-09-10T21:52:57.992503+0000","last_active":"2024-09-10T21:54:46.388546+0000","last_peered":"2024-09-10T21:54:46.388546+0000","last_clean":"2024-09-10T21:54:46.388546+0000","last_became_active":"2024-09-10T21:52:57.992162+0000","last_became_peered":"2024-09-10T21:52:57.992162+0000","last_unstale":"2024-09-10T21:54:46.388546+0000","last_undegraded":"2024-09-10T21:54:46.388546+0000","last_fullsized":"2024-09-10T21:54:46.388546+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:48.851113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.860903+0000","last_change":"2024-09-10T21:53:00.022343+0000","last_active":"2024-09-10T21:54:43.860903+0000","last_peered":"2024-09-10T21:54:43.860903+0000","last_clean":"2024-09-10T21:54:43.860903+0000","last_became_active":"2024-09-10T21:53:00.021610+0000","last_became_peered":"2024-09-10T21:53:00.021610+0000","last_unstale":"2024-09-10T21:54:43.860903+0000","last_undegraded":"2024-09-10T21:54:43.860903+0000","last_fullsized":"2024-09-10T21:54:43.860903+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:08.522759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557192+0000","last_change":"2024-09-10T21:52:57.988609+0000","last_active":"2024-09-10T21:53:44.557192+0000","last_peered":"2024-09-10T21:53:44.557192+0000","last_clean":"2024-09-10T21:53:44.557192+0000","last_became_active":"2024-09-10T21:52:57.988220+0000","last_became_peered":"2024-09-10T21:52:57.988220+0000","last_unstale":"2024-09-10T21:53:44.557192+0000","last_undegraded":"2024-09-10T21:53:44.557192+0000","last_fullsized":"2024-09-10T21:53:44.557192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:11.992577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539062+0000","last_change":"2024-09-10T21:52:57.990306+0000","last_active":"2024-09-10T21:53:44.539062+0000","last_peered":"2024-09-10T21:53:44.539062+0000","last_clean":"2024-09-10T21:53:44.539062+0000","last_became_active":"2024-09-10T21:52:57.989612+0000","last_became_peered":"2024-09-10T21:52:57.989612+0000","last_unstale":"2024-09-10T21:53:44.539062+0000","last_undegraded":"2024-09-10T21:53:44.539062+0000","last_fullsized":"2024-09-10T21:53:44.539062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:17.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.859089+0000","last_change":"2024-09-10T21:53:00.018019+0000","last_active":"2024-09-10T21:54:43.859089+0000","last_peered":"2024-09-10T21:54:43.859089+0000","last_clean":"2024-09-10T21:54:43.859089+0000","last_became_active":"2024-09-10T21:53:00.017035+0000","last_became_peered":"2024-09-10T21:53:00.017035+0000","last_unstale":"2024-09-10T21:54:43.859089+0000","last_undegraded":"2024-09-10T21:54:43.859089+0000","last_fullsized":"2024-09-10T21:54:43.859089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:26.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545291+0000","last_change":"2024-09-10T21:52:57.993648+0000","last_active":"2024-09-10T21:53:44.545291+0000","last_peered":"2024-09-10T21:53:44.545291+0000","last_clean":"2024-09-10T21:53:44.545291+0000","last_became_active":"2024-09-10T21:52:57.993362+0000","last_became_peered":"2024-09-10T21:52:57.993362+0000","last_unstale":"2024-09-10T21:53:44.545291+0000","last_undegraded":"2024-09-10T21:53:44.545291+0000","last_fullsized":"2024-09-10T21:53:44.545291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:11.914472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.864785+0000","last_change":"2024-09-10T21:53:00.015296+0000","last_active":"2024-09-10T21:54:43.864785+0000","last_peered":"2024-09-10T21:54:43.864785+0000","last_clean":"2024-09-10T21:54:43.864785+0000","last_became_active":"2024-09-10T21:53:00.014997+0000","last_became_peered":"2024-09-10T21:53:00.014997+0000","last_unstale":"2024-09-10T21:54:43.864785+0000","last_undegraded":"2024-09-10T21:54:43.864785+0000","last_fullsized":"2024-09-10T21:54:43.864785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:58.520382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'5","reported_seq":220,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.386425+0000","last_change":"2024-09-10T21:52:57.989679+0000","last_active":"2024-09-10T21:54:46.386425+0000","last_peered":"2024-09-10T21:54:46.386425+0000","last_clean":"2024-09-10T21:54:46.386425+0000","last_became_active":"2024-09-10T21:52:57.989342+0000","last_became_peered":"2024-09-10T21:52:57.989342+0000","last_unstale":"2024-09-10T21:54:46.386425+0000","last_undegraded":"2024-09-10T21:54:46.386425+0000","last_fullsized":"2024-09-10T21:54:46.386425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:32.460186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"73'10","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873137+0000","last_change":"2024-09-10T21:53:00.014784+0000","last_active":"2024-09-10T21:54:43.873137+0000","last_peered":"2024-09-10T21:54:43.873137+0000","last_clean":"2024-09-10T21:54:43.873137+0000","last_became_active":"2024-09-10T21:53:00.012405+0000","last_became_peered":"2024-09-10T21:53:00.012405+0000","last_unstale":"2024-09-10T21:54:43.873137+0000","last_undegraded":"2024-09-10T21:54:43.873137+0000","last_fullsized":"2024-09-10T21:54:43.873137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:22.395350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539991+0000","last_change":"2024-09-10T21:52:57.992090+0000","last_active":"2024-09-10T21:53:44.539991+0000","last_peered":"2024-09-10T21:53:44.539991+0000","last_clean":"2024-09-10T21:53:44.539991+0000","last_became_active":"2024-09-10T21:52:57.991753+0000","last_became_peered":"2024-09-10T21:52:57.991753+0000","last_unstale":"2024-09-10T21:53:44.539991+0000","last_undegraded":"2024-09-10T21:53:44.539991+0000","last_fullsized":"2024-09-10T21:53:44.539991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.602962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863675+0000","last_change":"2024-09-10T21:53:00.013028+0000","last_active":"2024-09-10T21:54:43.863675+0000","last_peered":"2024-09-10T21:54:43.863675+0000","last_clean":"2024-09-10T21:54:43.863675+0000","last_became_active":"2024-09-10T21:53:00.012716+0000","last_became_peered":"2024-09-10T21:53:00.012716+0000","last_unstale":"2024-09-10T21:54:43.863675+0000","last_undegraded":"2024-09-10T21:54:43.863675+0000","last_fullsized":"2024-09-10T21:54:43.863675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:57.173245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545577+0000","last_change":"2024-09-10T21:52:58.282788+0000","last_active":"2024-09-10T21:53:44.545577+0000","last_peered":"2024-09-10T21:53:44.545577+0000","last_clean":"2024-09-10T21:53:44.545577+0000","last_became_active":"2024-09-10T21:52:58.282452+0000","last_became_peered":"2024-09-10T21:52:58.282452+0000","last_unstale":"2024-09-10T21:53:44.545577+0000","last_undegraded":"2024-09-10T21:53:44.545577+0000","last_fullsized":"2024-09-10T21:53:44.545577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:53.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"73'11","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.874096+0000","last_change":"2024-09-10T21:53:00.024943+0000","last_active":"2024-09-10T21:54:43.874096+0000","last_peered":"2024-09-10T21:54:43.874096+0000","last_clean":"2024-09-10T21:54:43.874096+0000","last_became_active":"2024-09-10T21:53:00.024003+0000","last_became_peered":"2024-09-10T21:53:00.024003+0000","last_unstale":"2024-09-10T21:54:43.874096+0000","last_undegraded":"2024-09-10T21:54:43.874096+0000","last_fullsized":"2024-09-10T21:54:43.874096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:58.718948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'38","reported_seq":265,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.387154+0000","last_change":"2024-09-10T21:52:57.992796+0000","last_active":"2024-09-10T21:54:46.387154+0000","last_peered":"2024-09-10T21:54:46.387154+0000","last_clean":"2024-09-10T21:54:46.387154+0000","last_became_active":"2024-09-10T21:52:57.992473+0000","last_became_peered":"2024-09-10T21:52:57.992473+0000","last_unstale":"2024-09-10T21:54:46.387154+0000","last_undegraded":"2024-09-10T21:54:46.387154+0000","last_fullsized":"2024-09-10T21:54:46.387154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:40.792674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67570,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":168,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856478+0000","last_change":"2024-09-10T21:53:00.013698+0000","last_active":"2024-09-10T21:54:43.856478+0000","last_peered":"2024-09-10T21:54:43.856478+0000","last_clean":"2024-09-10T21:54:43.856478+0000","last_became_active":"2024-09-10T21:53:00.013399+0000","last_became_peered":"2024-09-10T21:53:00.013399+0000","last_unstale":"2024-09-10T21:54:43.856478+0000","last_undegraded":"2024-09-10T21:54:43.856478+0000","last_fullsized":"2024-09-10T21:54:43.856478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.087368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539851+0000","last_change":"2024-09-10T21:52:57.992600+0000","last_active":"2024-09-10T21:53:44.539851+0000","last_peered":"2024-09-10T21:53:44.539851+0000","last_clean":"2024-09-10T21:53:44.539851+0000","last_became_active":"2024-09-10T21:52:57.992282+0000","last_became_peered":"2024-09-10T21:52:57.992282+0000","last_unstale":"2024-09-10T21:53:44.539851+0000","last_undegraded":"2024-09-10T21:53:44.539851+0000","last_fullsized":"2024-09-10T21:53:44.539851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:11.454416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.856502+0000","last_change":"2024-09-10T21:53:00.017837+0000","last_active":"2024-09-10T21:54:43.856502+0000","last_peered":"2024-09-10T21:54:43.856502+0000","last_clean":"2024-09-10T21:54:43.856502+0000","last_became_active":"2024-09-10T21:53:00.017373+0000","last_became_peered":"2024-09-10T21:53:00.017373+0000","last_unstale":"2024-09-10T21:54:43.856502+0000","last_undegraded":"2024-09-10T21:54:43.856502+0000","last_fullsized":"2024-09-10T21:54:43.856502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:39.636717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544851+0000","last_change":"2024-09-10T21:52:57.990296+0000","last_active":"2024-09-10T21:53:44.544851+0000","last_peered":"2024-09-10T21:53:44.544851+0000","last_clean":"2024-09-10T21:53:44.544851+0000","last_became_active":"2024-09-10T21:52:57.989677+0000","last_became_peered":"2024-09-10T21:52:57.989677+0000","last_unstale":"2024-09-10T21:53:44.544851+0000","last_undegraded":"2024-09-10T21:53:44.544851+0000","last_fullsized":"2024-09-10T21:53:44.544851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:31.400666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"73'15","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866098+0000","last_change":"2024-09-10T21:53:00.024278+0000","last_active":"2024-09-10T21:54:43.866098+0000","last_peered":"2024-09-10T21:54:43.866098+0000","last_clean":"2024-09-10T21:54:43.866098+0000","last_became_active":"2024-09-10T21:53:00.022817+0000","last_became_peered":"2024-09-10T21:53:00.022817+0000","last_unstale":"2024-09-10T21:54:43.866098+0000","last_undegraded":"2024-09-10T21:54:43.866098+0000","last_fullsized":"2024-09-10T21:54:43.866098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:32.156591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'5","reported_seq":127,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.386551+0000","last_change":"2024-09-10T21:52:57.991672+0000","last_active":"2024-09-10T21:54:46.386551+0000","last_peered":"2024-09-10T21:54:46.386551+0000","last_clean":"2024-09-10T21:54:46.386551+0000","last_became_active":"2024-09-10T21:52:57.991281+0000","last_became_peered":"2024-09-10T21:52:57.991281+0000","last_unstale":"2024-09-10T21:54:46.386551+0000","last_undegraded":"2024-09-10T21:54:46.386551+0000","last_fullsized":"2024-09-10T21:54:46.386551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:53.327527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863183+0000","last_change":"2024-09-10T21:53:00.013595+0000","last_active":"2024-09-10T21:54:43.863183+0000","last_peered":"2024-09-10T21:54:43.863183+0000","last_clean":"2024-09-10T21:54:43.863183+0000","last_became_active":"2024-09-10T21:53:00.013244+0000","last_became_peered":"2024-09-10T21:53:00.013244+0000","last_unstale":"2024-09-10T21:54:43.863183+0000","last_undegraded":"2024-09-10T21:54:43.863183+0000","last_fullsized":"2024-09-10T21:54:43.863183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:46.941864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542191+0000","last_change":"2024-09-10T21:52:58.282860+0000","last_active":"2024-09-10T21:53:44.542191+0000","last_peered":"2024-09-10T21:53:44.542191+0000","last_clean":"2024-09-10T21:53:44.542191+0000","last_became_active":"2024-09-10T21:52:58.282354+0000","last_became_peered":"2024-09-10T21:52:58.282354+0000","last_unstale":"2024-09-10T21:53:44.542191+0000","last_undegraded":"2024-09-10T21:53:44.542191+0000","last_fullsized":"2024-09-10T21:53:44.542191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:51.143643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873477+0000","last_change":"2024-09-10T21:53:00.017418+0000","last_active":"2024-09-10T21:54:43.873477+0000","last_peered":"2024-09-10T21:54:43.873477+0000","last_clean":"2024-09-10T21:54:43.873477+0000","last_became_active":"2024-09-10T21:53:00.017102+0000","last_became_peered":"2024-09-10T21:53:00.017102+0000","last_unstale":"2024-09-10T21:54:43.873477+0000","last_undegraded":"2024-09-10T21:54:43.873477+0000","last_fullsized":"2024-09-10T21:54:43.873477+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:49.776155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542756+0000","last_change":"2024-09-10T21:52:57.989420+0000","last_active":"2024-09-10T21:53:44.542756+0000","last_peered":"2024-09-10T21:53:44.542756+0000","last_clean":"2024-09-10T21:53:44.542756+0000","last_became_active":"2024-09-10T21:52:57.989084+0000","last_became_peered":"2024-09-10T21:52:57.989084+0000","last_unstale":"2024-09-10T21:53:44.542756+0000","last_undegraded":"2024-09-10T21:53:44.542756+0000","last_fullsized":"2024-09-10T21:53:44.542756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:04.788096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"73'5","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.849995+0000","last_change":"2024-09-10T21:53:44.558208+0000","last_active":"2024-09-10T21:54:43.849995+0000","last_peered":"2024-09-10T21:54:43.849995+0000","last_clean":"2024-09-10T21:54:43.849995+0000","last_became_active":"2024-09-10T21:53:44.557786+0000","last_became_peered":"2024-09-10T21:53:44.557786+0000","last_unstale":"2024-09-10T21:54:43.849995+0000","last_undegraded":"2024-09-10T21:54:43.849995+0000","last_fullsized":"2024-09-10T21:54:43.849995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:35.278172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539468+0000","last_change":"2024-09-10T21:52:57.991127+0000","last_active":"2024-09-10T21:53:44.539468+0000","last_peered":"2024-09-10T21:53:44.539468+0000","last_clean":"2024-09-10T21:53:44.539468+0000","last_became_active":"2024-09-10T21:52:57.990797+0000","last_became_peered":"2024-09-10T21:52:57.990797+0000","last_unstale":"2024-09-10T21:53:44.539468+0000","last_undegraded":"2024-09-10T21:53:44.539468+0000","last_fullsized":"2024-09-10T21:53:44.539468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:00.009702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.857279+0000","last_change":"2024-09-10T21:53:00.016300+0000","last_active":"2024-09-10T21:54:43.857279+0000","last_peered":"2024-09-10T21:54:43.857279+0000","last_clean":"2024-09-10T21:54:43.857279+0000","last_became_active":"2024-09-10T21:53:00.015984+0000","last_became_peered":"2024-09-10T21:53:00.015984+0000","last_unstale":"2024-09-10T21:54:43.857279+0000","last_undegraded":"2024-09-10T21:54:43.857279+0000","last_fullsized":"2024-09-10T21:54:43.857279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:37.310180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.545708+0000","last_change":"2024-09-10T21:52:57.992937+0000","last_active":"2024-09-10T21:53:44.545708+0000","last_peered":"2024-09-10T21:53:44.545708+0000","last_clean":"2024-09-10T21:53:44.545708+0000","last_became_active":"2024-09-10T21:52:57.992644+0000","last_became_peered":"2024-09-10T21:52:57.992644+0000","last_unstale":"2024-09-10T21:53:44.545708+0000","last_undegraded":"2024-09-10T21:53:44.545708+0000","last_fullsized":"2024-09-10T21:53:44.545708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.561443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858977+0000","last_change":"2024-09-10T21:53:00.020703+0000","last_active":"2024-09-10T21:54:43.858977+0000","last_peered":"2024-09-10T21:54:43.858977+0000","last_clean":"2024-09-10T21:54:43.858977+0000","last_became_active":"2024-09-10T21:53:00.019809+0000","last_became_peered":"2024-09-10T21:53:00.019809+0000","last_unstale":"2024-09-10T21:54:43.858977+0000","last_undegraded":"2024-09-10T21:54:43.858977+0000","last_fullsized":"2024-09-10T21:54:43.858977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:23.275050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":127,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.387336+0000","last_change":"2024-09-10T21:52:58.683232+0000","last_active":"2024-09-10T21:54:46.387336+0000","last_peered":"2024-09-10T21:54:46.387336+0000","last_clean":"2024-09-10T21:54:46.387336+0000","last_became_active":"2024-09-10T21:52:58.682877+0000","last_became_peered":"2024-09-10T21:52:58.682877+0000","last_unstale":"2024-09-10T21:54:46.387336+0000","last_undegraded":"2024-09-10T21:54:46.387336+0000","last_fullsized":"2024-09-10T21:54:46.387336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:14.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.870982+0000","last_change":"2024-09-10T21:53:00.020470+0000","last_active":"2024-09-10T21:54:43.870982+0000","last_peered":"2024-09-10T21:54:43.870982+0000","last_clean":"2024-09-10T21:54:43.870982+0000","last_became_active":"2024-09-10T21:53:00.020095+0000","last_became_peered":"2024-09-10T21:53:00.020095+0000","last_unstale":"2024-09-10T21:54:43.870982+0000","last_undegraded":"2024-09-10T21:54:43.870982+0000","last_fullsized":"2024-09-10T21:54:43.870982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:29.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539769+0000","last_change":"2024-09-10T21:51:48.714615+0000","last_active":"2024-09-10T21:53:44.539769+0000","last_peered":"2024-09-10T21:53:44.539769+0000","last_clean":"2024-09-10T21:53:44.539769+0000","last_became_active":"2024-09-10T21:51:48.708927+0000","last_became_peered":"2024-09-10T21:51:48.708927+0000","last_unstale":"2024-09-10T21:53:44.539769+0000","last_undegraded":"2024-09-10T21:53:44.539769+0000","last_fullsized":"2024-09-10T21:53:44.539769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:48:27.900855+0000","last_clean_scrub_stamp":"2024-09-10T21:48:27.900855+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:18.068351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557040+0000","last_change":"2024-09-10T21:52:57.991513+0000","last_active":"2024-09-10T21:53:44.557040+0000","last_peered":"2024-09-10T21:53:44.557040+0000","last_clean":"2024-09-10T21:53:44.557040+0000","last_became_active":"2024-09-10T21:52:57.991124+0000","last_became_peered":"2024-09-10T21:52:57.991124+0000","last_unstale":"2024-09-10T21:53:44.557040+0000","last_undegraded":"2024-09-10T21:53:44.557040+0000","last_fullsized":"2024-09-10T21:53:44.557040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:58.656897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.866759+0000","last_change":"2024-09-10T21:53:00.014599+0000","last_active":"2024-09-10T21:54:43.866759+0000","last_peered":"2024-09-10T21:54:43.866759+0000","last_clean":"2024-09-10T21:54:43.866759+0000","last_became_active":"2024-09-10T21:53:00.014300+0000","last_became_peered":"2024-09-10T21:53:00.014300+0000","last_unstale":"2024-09-10T21:54:43.866759+0000","last_undegraded":"2024-09-10T21:54:43.866759+0000","last_fullsized":"2024-09-10T21:54:43.866759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:49.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.539673+0000","last_change":"2024-09-10T21:52:57.989917+0000","last_active":"2024-09-10T21:53:44.539673+0000","last_peered":"2024-09-10T21:53:44.539673+0000","last_clean":"2024-09-10T21:53:44.539673+0000","last_became_active":"2024-09-10T21:52:57.989561+0000","last_became_peered":"2024-09-10T21:52:57.989561+0000","last_unstale":"2024-09-10T21:53:44.539673+0000","last_undegraded":"2024-09-10T21:53:44.539673+0000","last_fullsized":"2024-09-10T21:53:44.539673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:41.986591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'5","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858804+0000","last_change":"2024-09-10T21:53:44.544497+0000","last_active":"2024-09-10T21:54:43.858804+0000","last_peered":"2024-09-10T21:54:43.858804+0000","last_clean":"2024-09-10T21:54:43.858804+0000","last_became_active":"2024-09-10T21:53:44.544086+0000","last_became_peered":"2024-09-10T21:53:44.544086+0000","last_unstale":"2024-09-10T21:54:43.858804+0000","last_undegraded":"2024-09-10T21:54:43.858804+0000","last_fullsized":"2024-09-10T21:54:43.858804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:42.547771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.382061+0000","last_change":"2024-09-10T21:52:58.281171+0000","last_active":"2024-09-10T21:54:43.382061+0000","last_peered":"2024-09-10T21:54:43.382061+0000","last_clean":"2024-09-10T21:54:43.382061+0000","last_became_active":"2024-09-10T21:52:58.280826+0000","last_became_peered":"2024-09-10T21:52:58.280826+0000","last_unstale":"2024-09-10T21:54:43.382061+0000","last_undegraded":"2024-09-10T21:54:43.382061+0000","last_fullsized":"2024-09-10T21:54:43.382061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:00.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.861884+0000","last_change":"2024-09-10T21:53:00.020561+0000","last_active":"2024-09-10T21:54:43.861884+0000","last_peered":"2024-09-10T21:54:43.861884+0000","last_clean":"2024-09-10T21:54:43.861884+0000","last_became_active":"2024-09-10T21:53:00.020214+0000","last_became_peered":"2024-09-10T21:53:00.020214+0000","last_unstale":"2024-09-10T21:54:43.861884+0000","last_undegraded":"2024-09-10T21:54:43.861884+0000","last_fullsized":"2024-09-10T21:54:43.861884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:04.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":125,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:45.388324+0000","last_change":"2024-09-10T21:52:57.990072+0000","last_active":"2024-09-10T21:54:45.388324+0000","last_peered":"2024-09-10T21:54:45.388324+0000","last_clean":"2024-09-10T21:54:45.388324+0000","last_became_active":"2024-09-10T21:52:57.989670+0000","last_became_peered":"2024-09-10T21:52:57.989670+0000","last_unstale":"2024-09-10T21:54:45.388324+0000","last_undegraded":"2024-09-10T21:54:45.388324+0000","last_fullsized":"2024-09-10T21:54:45.388324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:32.076134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863028+0000","last_change":"2024-09-10T21:53:00.022000+0000","last_active":"2024-09-10T21:54:43.863028+0000","last_peered":"2024-09-10T21:54:43.863028+0000","last_clean":"2024-09-10T21:54:43.863028+0000","last_became_active":"2024-09-10T21:53:00.021577+0000","last_became_peered":"2024-09-10T21:53:00.021577+0000","last_unstale":"2024-09-10T21:54:43.863028+0000","last_undegraded":"2024-09-10T21:54:43.863028+0000","last_fullsized":"2024-09-10T21:54:43.863028+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:47.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543424+0000","last_change":"2024-09-10T21:52:58.281275+0000","last_active":"2024-09-10T21:53:44.543424+0000","last_peered":"2024-09-10T21:53:44.543424+0000","last_clean":"2024-09-10T21:53:44.543424+0000","last_became_active":"2024-09-10T21:52:58.280893+0000","last_became_peered":"2024-09-10T21:52:58.280893+0000","last_unstale":"2024-09-10T21:53:44.543424+0000","last_undegraded":"2024-09-10T21:53:44.543424+0000","last_fullsized":"2024-09-10T21:53:44.543424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:14.725445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.854707+0000","last_change":"2024-09-10T21:53:00.019157+0000","last_active":"2024-09-10T21:54:43.854707+0000","last_peered":"2024-09-10T21:54:43.854707+0000","last_clean":"2024-09-10T21:54:43.854707+0000","last_became_active":"2024-09-10T21:53:00.018790+0000","last_became_peered":"2024-09-10T21:53:00.018790+0000","last_unstale":"2024-09-10T21:54:43.854707+0000","last_undegraded":"2024-09-10T21:54:43.854707+0000","last_fullsized":"2024-09-10T21:54:43.854707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:48.849153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543551+0000","last_change":"2024-09-10T21:52:58.281096+0000","last_active":"2024-09-10T21:53:44.543551+0000","last_peered":"2024-09-10T21:53:44.543551+0000","last_clean":"2024-09-10T21:53:44.543551+0000","last_became_active":"2024-09-10T21:52:58.280785+0000","last_became_peered":"2024-09-10T21:52:58.280785+0000","last_unstale":"2024-09-10T21:53:44.543551+0000","last_undegraded":"2024-09-10T21:53:44.543551+0000","last_fullsized":"2024-09-10T21:53:44.543551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:52.600649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.858910+0000","last_change":"2024-09-10T21:53:00.006763+0000","last_active":"2024-09-10T21:54:43.858910+0000","last_peered":"2024-09-10T21:54:43.858910+0000","last_clean":"2024-09-10T21:54:43.858910+0000","last_became_active":"2024-09-10T21:53:00.005770+0000","last_became_peered":"2024-09-10T21:53:00.005770+0000","last_unstale":"2024-09-10T21:54:43.858910+0000","last_undegraded":"2024-09-10T21:54:43.858910+0000","last_fullsized":"2024-09-10T21:54:43.858910+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:39.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'17","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:45.035818+0000","last_change":"2024-09-10T21:52:57.988636+0000","last_active":"2024-09-10T21:54:45.035818+0000","last_peered":"2024-09-10T21:54:45.035818+0000","last_clean":"2024-09-10T21:54:45.035818+0000","last_became_active":"2024-09-10T21:52:57.988376+0000","last_became_peered":"2024-09-10T21:52:57.988376+0000","last_unstale":"2024-09-10T21:54:45.035818+0000","last_undegraded":"2024-09-10T21:54:45.035818+0000","last_fullsized":"2024-09-10T21:54:45.035818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:31.928384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.860205+0000","last_change":"2024-09-10T21:53:00.017302+0000","last_active":"2024-09-10T21:54:43.860205+0000","last_peered":"2024-09-10T21:54:43.860205+0000","last_clean":"2024-09-10T21:54:43.860205+0000","last_became_active":"2024-09-10T21:53:00.016677+0000","last_became_peered":"2024-09-10T21:53:00.016677+0000","last_unstale":"2024-09-10T21:54:43.860205+0000","last_undegraded":"2024-09-10T21:54:43.860205+0000","last_fullsized":"2024-09-10T21:54:43.860205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:22.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.556856+0000","last_change":"2024-09-10T21:52:58.683528+0000","last_active":"2024-09-10T21:53:44.556856+0000","last_peered":"2024-09-10T21:53:44.556856+0000","last_clean":"2024-09-10T21:53:44.556856+0000","last_became_active":"2024-09-10T21:52:58.683194+0000","last_became_peered":"2024-09-10T21:52:58.683194+0000","last_unstale":"2024-09-10T21:53:44.556856+0000","last_undegraded":"2024-09-10T21:53:44.556856+0000","last_fullsized":"2024-09-10T21:53:44.556856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:42.406212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'7","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.867495+0000","last_change":"2024-09-10T21:53:00.019221+0000","last_active":"2024-09-10T21:54:43.867495+0000","last_peered":"2024-09-10T21:54:43.867495+0000","last_clean":"2024-09-10T21:54:43.867495+0000","last_became_active":"2024-09-10T21:53:00.018900+0000","last_became_peered":"2024-09-10T21:53:00.018900+0000","last_unstale":"2024-09-10T21:54:43.867495+0000","last_undegraded":"2024-09-10T21:54:43.867495+0000","last_fullsized":"2024-09-10T21:54:43.867495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:30.464130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.543821+0000","last_change":"2024-09-10T21:52:58.282604+0000","last_active":"2024-09-10T21:53:44.543821+0000","last_peered":"2024-09-10T21:53:44.543821+0000","last_clean":"2024-09-10T21:53:44.543821+0000","last_became_active":"2024-09-10T21:52:58.282280+0000","last_became_peered":"2024-09-10T21:52:58.282280+0000","last_unstale":"2024-09-10T21:53:44.543821+0000","last_undegraded":"2024-09-10T21:53:44.543821+0000","last_fullsized":"2024-09-10T21:53:44.543821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:14.890223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"73'2","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.822745+0000","last_change":"2024-09-10T21:53:00.011849+0000","last_active":"2024-09-10T21:54:43.822745+0000","last_peered":"2024-09-10T21:54:43.822745+0000","last_clean":"2024-09-10T21:54:43.822745+0000","last_became_active":"2024-09-10T21:53:00.011444+0000","last_became_peered":"2024-09-10T21:53:00.011444+0000","last_unstale":"2024-09-10T21:54:43.822745+0000","last_undegraded":"2024-09-10T21:54:43.822745+0000","last_fullsized":"2024-09-10T21:54:43.822745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:21.654559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544539+0000","last_change":"2024-09-10T21:52:57.989860+0000","last_active":"2024-09-10T21:53:44.544539+0000","last_peered":"2024-09-10T21:53:44.544539+0000","last_clean":"2024-09-10T21:53:44.544539+0000","last_became_active":"2024-09-10T21:52:57.989511+0000","last_became_peered":"2024-09-10T21:52:57.989511+0000","last_unstale":"2024-09-10T21:53:44.544539+0000","last_undegraded":"2024-09-10T21:53:44.544539+0000","last_fullsized":"2024-09-10T21:53:44.544539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:30.282045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.868667+0000","last_change":"2024-09-10T21:53:00.018570+0000","last_active":"2024-09-10T21:54:43.868667+0000","last_peered":"2024-09-10T21:54:43.868667+0000","last_clean":"2024-09-10T21:54:43.868667+0000","last_became_active":"2024-09-10T21:53:00.018241+0000","last_became_peered":"2024-09-10T21:53:00.018241+0000","last_unstale":"2024-09-10T21:54:43.868667+0000","last_undegraded":"2024-09-10T21:54:43.868667+0000","last_fullsized":"2024-09-10T21:54:43.868667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:42.976577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:45.087484+0000","last_change":"2024-09-10T21:53:44.551320+0000","last_active":"2024-09-10T21:54:45.087484+0000","last_peered":"2024-09-10T21:54:45.087484+0000","last_clean":"2024-09-10T21:54:45.087484+0000","last_became_active":"2024-09-10T21:53:44.546446+0000","last_became_peered":"2024-09-10T21:53:44.546446+0000","last_unstale":"2024-09-10T21:54:45.087484+0000","last_undegraded":"2024-09-10T21:54:45.087484+0000","last_fullsized":"2024-09-10T21:54:45.087484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:19.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"73'8","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.869015+0000","last_change":"2024-09-10T21:53:00.019928+0000","last_active":"2024-09-10T21:54:43.869015+0000","last_peered":"2024-09-10T21:54:43.869015+0000","last_clean":"2024-09-10T21:54:43.869015+0000","last_became_active":"2024-09-10T21:53:00.019624+0000","last_became_peered":"2024-09-10T21:53:00.019624+0000","last_unstale":"2024-09-10T21:54:43.869015+0000","last_undegraded":"2024-09-10T21:54:43.869015+0000","last_fullsized":"2024-09-10T21:54:43.869015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:33.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.542660+0000","last_change":"2024-09-10T21:52:57.990733+0000","last_active":"2024-09-10T21:53:44.542660+0000","last_peered":"2024-09-10T21:53:44.542660+0000","last_clean":"2024-09-10T21:53:44.542660+0000","last_became_active":"2024-09-10T21:52:57.990428+0000","last_became_peered":"2024-09-10T21:52:57.990428+0000","last_unstale":"2024-09-10T21:53:44.542660+0000","last_undegraded":"2024-09-10T21:53:44.542660+0000","last_fullsized":"2024-09-10T21:53:44.542660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:38.369153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.871320+0000","last_change":"2024-09-10T21:53:00.020934+0000","last_active":"2024-09-10T21:54:43.871320+0000","last_peered":"2024-09-10T21:54:43.871320+0000","last_clean":"2024-09-10T21:54:43.871320+0000","last_became_active":"2024-09-10T21:53:00.019483+0000","last_became_peered":"2024-09-10T21:53:00.019483+0000","last_unstale":"2024-09-10T21:54:43.871320+0000","last_undegraded":"2024-09-10T21:54:43.871320+0000","last_fullsized":"2024-09-10T21:54:43.871320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:33.263619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"73'15","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873780+0000","last_change":"2024-09-10T21:53:44.548188+0000","last_active":"2024-09-10T21:54:43.873780+0000","last_peered":"2024-09-10T21:54:43.873780+0000","last_clean":"2024-09-10T21:54:43.873780+0000","last_became_active":"2024-09-10T21:53:44.547897+0000","last_became_peered":"2024-09-10T21:53:44.547897+0000","last_unstale":"2024-09-10T21:54:43.873780+0000","last_undegraded":"2024-09-10T21:54:43.873780+0000","last_fullsized":"2024-09-10T21:54:43.873780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:21.351072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.557183+0000","last_change":"2024-09-10T21:53:44.556670+0000","last_active":"2024-09-10T21:53:44.557183+0000","last_peered":"2024-09-10T21:53:44.557183+0000","last_clean":"2024-09-10T21:53:44.557183+0000","last_became_active":"2024-09-10T21:53:44.546758+0000","last_became_peered":"2024-09-10T21:53:44.546758+0000","last_unstale":"2024-09-10T21:53:44.557183+0000","last_undegraded":"2024-09-10T21:53:44.557183+0000","last_fullsized":"2024-09-10T21:53:44.557183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:02.292116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"73'9","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873786+0000","last_change":"2024-09-10T21:53:00.021113+0000","last_active":"2024-09-10T21:54:43.873786+0000","last_peered":"2024-09-10T21:54:43.873786+0000","last_clean":"2024-09-10T21:54:43.873786+0000","last_became_active":"2024-09-10T21:53:00.020782+0000","last_became_peered":"2024-09-10T21:53:00.020782+0000","last_unstale":"2024-09-10T21:54:43.873786+0000","last_undegraded":"2024-09-10T21:54:43.873786+0000","last_fullsized":"2024-09-10T21:54:43.873786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:36.252781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.568857+0000","last_change":"2024-09-10T21:53:44.568775+0000","last_active":"2024-09-10T21:53:44.568857+0000","last_peered":"2024-09-10T21:53:44.568857+0000","last_clean":"2024-09-10T21:53:44.568857+0000","last_became_active":"2024-09-10T21:53:44.558126+0000","last_became_peered":"2024-09-10T21:53:44.558126+0000","last_unstale":"2024-09-10T21:53:44.568857+0000","last_undegraded":"2024-09-10T21:53:44.568857+0000","last_fullsized":"2024-09-10T21:53:44.568857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:00.789948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"73'6","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.873407+0000","last_change":"2024-09-10T21:53:00.015895+0000","last_active":"2024-09-10T21:54:43.873407+0000","last_peered":"2024-09-10T21:54:43.873407+0000","last_clean":"2024-09-10T21:54:43.873407+0000","last_became_active":"2024-09-10T21:53:00.014715+0000","last_became_peered":"2024-09-10T21:53:00.014715+0000","last_unstale":"2024-09-10T21:54:43.873407+0000","last_undegraded":"2024-09-10T21:54:43.873407+0000","last_fullsized":"2024-09-10T21:54:43.873407+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:49.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:53:44.544324+0000","last_change":"2024-09-10T21:52:58.282895+0000","last_active":"2024-09-10T21:53:44.544324+0000","last_peered":"2024-09-10T21:53:44.544324+0000","last_clean":"2024-09-10T21:53:44.544324+0000","last_became_active":"2024-09-10T21:52:58.282454+0000","last_became_peered":"2024-09-10T21:52:58.282454+0000","last_unstale":"2024-09-10T21:53:44.544324+0000","last_undegraded":"2024-09-10T21:53:44.544324+0000","last_fullsized":"2024-09-10T21:53:44.544324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:24.356173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'5","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:43.863774+0000","last_change":"2024-09-10T21:53:00.020661+0000","last_active":"2024-09-10T21:54:43.863774+0000","last_peered":"2024-09-10T21:54:43.863774+0000","last_clean":"2024-09-10T21:54:43.863774+0000","last_became_active":"2024-09-10T21:53:00.020332+0000","last_became_peered":"2024-09-10T21:53:00.020332+0000","last_unstale":"2024-09-10T21:54:43.863774+0000","last_undegraded":"2024-09-10T21:54:43.863774+0000","last_fullsized":"2024-09-10T21:54:43.863774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:58.980850+0000","last_clean_scrub_stamp":"2024-09-10T21:52:58.980850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:34.303101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":134,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:54:46.388971+0000","last_change":"2024-09-10T21:52:57.988852+0000","last_active":"2024-09-10T21:54:46.388971+0000","last_peered":"2024-09-10T21:54:46.388971+0000","last_clean":"2024-09-10T21:54:46.388971+0000","last_became_active":"2024-09-10T21:52:57.988529+0000","last_became_peered":"2024-09-10T21:52:57.988529+0000","last_unstale":"2024-09-10T21:54:46.388971+0000","last_undegraded":"2024-09-10T21:54:46.388971+0000","last_fullsized":"2024-09-10T21:54:46.388971+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:52:56.969339+0000","last_clean_scrub_stamp":"2024-09-10T21:52:56.969339+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:27.380533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75223,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1007,"num_read_kb":584,"num_write":263,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":225669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":798720,"data_stored":388106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037799,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1041418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201325,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":387454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":387250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593782,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":981190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724603,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":387171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":980868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":387032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":386996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":457105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":455654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":388510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:54:49.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:54:49.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:49 smithi070 ceph-mon[34909]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:49.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:49 smithi173 ceph-mon[35294]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.050 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:50.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.484+0000 7f8059aac640 1 -- 172.21.15.39:0/1821624136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 msgr2=0x7f805410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.484+0000 7f8059aac640 1 --2- 172.21.15.39:0/1821624136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f805410f950 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f804c009ca0 tx=0x7f804c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 -- 172.21.15.39:0/1821624136 shutdown_connections 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 --2- 172.21.15.39:0/1821624136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f805410f950 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 --2- 172.21.15.39:0/1821624136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f8054108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 --2- 172.21.15.39:0/1821624136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 0x7f80541031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 -- 172.21.15.39:0/1821624136 >> 172.21.15.39:0/1821624136 conn(0x7f80540fe830 msgr2=0x7f8054100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 -- 172.21.15.39:0/1821624136 shutdown_connections 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 -- 172.21.15.39:0/1821624136 wait complete. 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 Processor -- start 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 -- start start 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 0x7f80540754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:50.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.485+0000 7f8059aac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f80540759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8054112e10 con 0x7f8054109150 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8054112c90 con 0x7f80541087d0 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8054112f90 con 0x7f8054102dc0 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42676/0 (socket says 172.21.15.39:42676) 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 -- 172.21.15.39:0/1956984181 learned_addr learned my addr 172.21.15.39:0/1956984181 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f80537fe640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 0x7f80540754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f804bfff640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f80540759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 -- 172.21.15.39:0/1956984181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 msgr2=0x7f80540754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 0x7f80540754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 -- 172.21.15.39:0/1956984181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 msgr2=0x7f80540759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f80540759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 -- 172.21.15.39:0/1956984181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80541a7600 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f804bfff640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f80540759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8053fff640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f804c005cc0 tx=0x7f804c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c003bf0 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f804c003d90 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80541a7890 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c02fbc0 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.486+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80541a7dd0 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.487+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80541031a0 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.489+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f804c004610 con 0x7f8054109150 2024-09-10T21:54:50.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.490+0000 7f80517fa640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 0x7f80400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:50.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.490+0000 7f80537fe640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 0x7f80400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:50.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.490+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f804c107480 con 0x7f8054109150 2024-09-10T21:54:50.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.490+0000 7f80537fe640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 0x7f80400b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8044005fd0 tx=0x7f8044005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:50.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.492+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f804c0ce1f0 con 0x7f8054109150 2024-09-10T21:54:50.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.714+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80541a8150 con 0x7f8054109150 2024-09-10T21:54:50.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.715+0000 7f80517fa640 1 -- 172.21.15.39:0/1956984181 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f804c0098b0 con 0x7f8054109150 2024-09-10T21:54:50.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-10T21:54:45:540351+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:54:45.490131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24550,24563,24562,24583,24590]},"id":1}]} 2024-09-10T21:54:50.717 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-10T21:54:50.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 msgr2=0x7f80400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:50.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 0x7f80400b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8044005fd0 tx=0x7f8044005850 comp rx=0 tx=0).stop 2024-09-10T21:54:50.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 msgr2=0x7f8054075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:50.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f804c005cc0 tx=0x7f804c02f380 comp rx=0 tx=0).stop 2024-09-10T21:54:50.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 shutdown_connections 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f80400b5370 0x7f80400b7830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8054109150 0x7f8054075f20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80541087d0 0x7f80540759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 --2- 172.21.15.39:0/1956984181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8054102dc0 0x7f80540754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.717+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 >> 172.21.15.39:0/1956984181 conn(0x7f80540fe830 msgr2=0x7f8054101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.718+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 shutdown_connections 2024-09-10T21:54:50.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:50.718+0000 7f8059aac640 1 -- 172.21.15.39:0/1956984181 wait complete. 2024-09-10T21:54:50.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:50 smithi070 ceph-mon[34909]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:50 smithi070 ceph-mon[34909]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T21:54:50.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:50 smithi070 ceph-mon[34909]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:50 smithi039 ceph-mon[30872]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:50 smithi039 ceph-mon[30872]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T21:54:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:50 smithi039 ceph-mon[30872]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:50 smithi173 ceph-mon[35294]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:50 smithi173 ceph-mon[35294]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T21:54:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:50 smithi173 ceph-mon[35294]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:54:51.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:54:51.587 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:51.826 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:51 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1956984181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:51.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:51 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1956984181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:51.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:51 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1956984181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 -- 172.21.15.39:0/1973173558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8109120 msgr2=0x7fddd810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 --2- 172.21.15.39:0/1973173558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8109120 0x7fddd810f920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009ca0 tx=0x7fddd002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 -- 172.21.15.39:0/1973173558 shutdown_connections 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 --2- 172.21.15.39:0/1973173558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8109120 0x7fddd810f920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 --2- 172.21.15.39:0/1973173558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd81087a0 0x7fddd8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 --2- 172.21.15.39:0/1973173558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd8102d90 0x7fddd8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 -- 172.21.15.39:0/1973173558 >> 172.21.15.39:0/1973173558 conn(0x7fddd80fe820 msgr2=0x7fddd8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 -- 172.21.15.39:0/1973173558 shutdown_connections 2024-09-10T21:54:52.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.019+0000 7fdddf78c640 1 -- 172.21.15.39:0/1973173558 wait complete. 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.020+0000 7fdddf78c640 1 Processor -- start 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.020+0000 7fdddf78c640 1 -- start start 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.020+0000 7fdddf78c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42692/0 (socket says 172.21.15.39:42692) 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 -- 172.21.15.39:0/783544162 learned_addr learned my addr 172.21.15.39:0/783544162 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81087a0 0x7fddd80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 0x7fddd8075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8112de0 con 0x7fddd8102d90 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8112c60 con 0x7fddd8109120 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8112f60 con 0x7fddd81087a0 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddcd27640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81087a0 0x7fddd80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fddddd29640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 0x7fddd8075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 -- 172.21.15.39:0/783544162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81087a0 msgr2=0x7fddd80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81087a0 0x7fddd80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 -- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 msgr2=0x7fddd8075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 0x7fddd8075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd81abb30 con 0x7fddd8102d90 2024-09-10T21:54:52.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fddddd29640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 0x7fddd8075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.021+0000 7fdddd528640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e9f0 tx=0x7fddd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.022+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd400cd80 con 0x7fddd8102d90 2024-09-10T21:54:52.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.022+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddd40108e0 con 0x7fddd8102d90 2024-09-10T21:54:52.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.022+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd81abd00 con 0x7fddd8102d90 2024-09-10T21:54:52.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.022+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4018980 con 0x7fddd8102d90 2024-09-10T21:54:52.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.022+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81ac1c0 con 0x7fddd8102d90 2024-09-10T21:54:52.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.023+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd8104040 con 0x7fddd8102d90 2024-09-10T21:54:52.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.025+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fddd4010430 con 0x7fddd8102d90 2024-09-10T21:54:52.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.026+0000 7fddce7fc640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 0x7fddc40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:52.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.026+0000 7fdddcd27640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 0x7fddc40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:52.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.026+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fddd40e6610 con 0x7fddd8102d90 2024-09-10T21:54:52.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.027+0000 7fdddcd27640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 0x7fddc40b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fddd819d0a0 tx=0x7fddc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:52.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.029+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fddd40ad380 con 0x7fddd8102d90 2024-09-10T21:54:52.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.220+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddd80767a0 con 0x7fddd8102d90 2024-09-10T21:54:52.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.221+0000 7fddce7fc640 1 -- 172.21.15.39:0/783544162 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22652 (secure 0 0 0) 0x7fddd40acc80 con 0x7fddd8102d90 2024-09-10T21:54:52.223 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:54:52.223 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T21:53:44.535601+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 msgr2=0x7fddc40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 0x7fddc40b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fddd819d0a0 tx=0x7fddc8005f90 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 msgr2=0x7fddd8076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e9f0 tx=0x7fddd400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 shutdown_connections 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fddc40b5370 0x7fddc40b7830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd8109120 0x7fddd8075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81087a0 0x7fddd80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 --2- 172.21.15.39:0/783544162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddd8102d90 0x7fddd8076f50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 >> 172.21.15.39:0/783544162 conn(0x7fddd80fe820 msgr2=0x7fddd8100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:52.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 shutdown_connections 2024-09-10T21:54:52.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:52.224+0000 7fdddf78c640 1 -- 172.21.15.39:0/783544162 wait complete. 2024-09-10T21:54:52.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:52 smithi039 ceph-mon[30872]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:54:52.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/783544162' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:52.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:52 smithi070 ceph-mon[34909]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:54:52.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/783544162' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:52.931 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T21:54:52.931 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T21:54:52.945 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T21:54:52.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T21:54:52.946 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T21:54:52.946 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:54:52.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:54:52.948 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T21:54:52.971 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:54:52.972 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T21:54:52.972 INFO:tasks.workunit:timeout=3h 2024-09-10T21:54:52.972 INFO:tasks.workunit:cleanup=True 2024-09-10T21:54:52.972 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T21:54:52.989 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-10 21:53:18.509380104 +0000 2024-09-10T21:54:52.990 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-10 21:53:18.509380104 +0000 2024-09-10T21:54:52.990 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-10 21:54:44.794798373 +0000 2024-09-10T21:54:52.990 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-10 21:53:18.509380104 +0000 2024-09-10T21:54:52.990 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T21:54:52.990 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T21:54:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:52 smithi173 ceph-mon[35294]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:54:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/783544162' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:54:53.064 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:54:53.121 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T21:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 -- 172.21.15.39:0/182005448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 msgr2=0x7f74d8102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 --2- 172.21.15.39:0/182005448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d8102090 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009900 tx=0x7f74d402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 -- 172.21.15.39:0/182005448 shutdown_connections 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 --2- 172.21.15.39:0/182005448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 --2- 172.21.15.39:0/182005448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 0x7f74d8107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 --2- 172.21.15.39:0/182005448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d8102090 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 -- 172.21.15.39:0/182005448 >> 172.21.15.39:0/182005448 conn(0x7f74d80fd700 msgr2=0x7f74d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 -- 172.21.15.39:0/182005448 shutdown_connections 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.639+0000 7f74dff0b640 1 -- 172.21.15.39:0/182005448 wait complete. 2024-09-10T21:54:53.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 Processor -- start 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 -- start start 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 0x7f74d819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d81a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8112de0 con 0x7f74d8101cb0 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8112c60 con 0x7f74d81076c0 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dff0b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8112f60 con 0x7f74d8108040 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74ddca7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74ddca7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42716/0 (socket says 172.21.15.39:42716) 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74ddca7640 1 -- 172.21.15.39:0/3282043927 learned_addr learned my addr 172.21.15.39:0/3282043927 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.640+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 0x7f74d819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74de4a8640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d81a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 -- 172.21.15.39:0/3282043927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 msgr2=0x7f74d81a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d81a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 -- 172.21.15.39:0/3282043927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 msgr2=0x7f74d819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 0x7f74d819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 -- 172.21.15.39:0/3282043927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d81a1550 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74de4a8640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ddca7640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74d4005940 tx=0x7f74d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ceffd640 1 -- 172.21.15.39:0/3282043927 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d403f030 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ceffd640 1 -- 172.21.15.39:0/3282043927 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d4003aa0 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81a17e0 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74ceffd640 1 -- 172.21.15.39:0/3282043927 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4035070 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.641+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d81a7f00 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.644+0000 7f74e22e0740 1 Processor -- start 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74ceffd640 1 -- 172.21.15.39:0/3282043927 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f74d403bca0 con 0x7f74d8101cb0 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 -- start start 2024-09-10T21:54:53.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e3800 0x55d5266ef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266ef790 0x55d5266f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d526659e60 con 0x55d5266e2ee0 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d526649290 con 0x55d5266ef790 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74e22e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d52664d0a0 con 0x55d5266e3800 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42730/0 (socket says 172.21.15.39:42730) 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 -- 172.21.15.39:0/1966674093 learned_addr learned my addr 172.21.15.39:0/1966674093 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74ddca7640 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e3800 0x55d5266ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266ef790 0x55d5266f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 -- 172.21.15.39:0/1966674093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e3800 msgr2=0x55d5266ef250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e3800 0x55d5266ef250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 -- 172.21.15.39:0/1966674093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266ef790 msgr2=0x55d5266f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266ef790 0x55d5266f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.645+0000 7f74de4a8640 1 -- 172.21.15.39:0/1966674093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5263a7930 con 0x55d5266e2ee0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74ceffd640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 0x7f74c40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009f40 tx=0x7f74d000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545f2c45172b7816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74ddca7640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 0x7f74c40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74ceffd640 1 -- 172.21.15.39:0/3282043927 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f74d4106630 con 0x7f74d8101cb0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74c3fff640 1 -- 172.21.15.39:0/1966674093 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003b70 con 0x55d5266e2ee0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74c3fff640 1 -- 172.21.15.39:0/1966674093 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d0003d10 con 0x55d5266e2ee0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.646+0000 7f74c3fff640 1 -- 172.21.15.39:0/1966674093 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0011a40 con 0x55d5266e2ee0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 -- 172.21.15.39:0/1966674093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 msgr2=0x55d5266e32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74ddca7640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 0x7f74c40b78b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d5266e6060 tx=0x7f74d4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009f40 tx=0x7f74d000f7f0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 -- 172.21.15.39:0/1966674093 shutdown_connections 2024-09-10T21:54:53.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266ef790 0x55d5266f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e3800 0x55d5266ef250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1966674093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266e32c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 -- 172.21.15.39:0/1966674093 >> 172.21.15.39:0/1966674093 conn(0x55d5266e0d10 msgr2=0x55d5266e1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 -- 172.21.15.39:0/1966674093 shutdown_connections 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.647+0000 7f74e22e0740 1 -- 172.21.15.39:0/1966674093 wait complete. 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 -- start start 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 Processor -- start 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d5264aa890 con 0x55d5266e2ee0 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d5265e3d40 con 0x55d5266e3800 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d5266f2440 con 0x55d5266ef790 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74e22e0740 10 client.0 _ll_register_callbacks cb 0x55d526647c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:53.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42738/0 (socket says 172.21.15.39:42738) 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.648+0000 7f74de4a8640 1 -- 172.21.15.39:0/2491634680 learned_addr learned my addr 172.21.15.39:0/2491634680 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 -- 172.21.15.39:0/2491634680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 msgr2=0x55d5266ed1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266ed1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 -- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 msgr2=0x55d5266ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 -- 172.21.15.39:0/2491634680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5266fb820 con 0x55d5266e2ee0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74de4a8640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f74d0003ba0 tx=0x7f74d0003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc6580bda645a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0004c50 con 0x55d5266e2ee0 2024-09-10T21:54:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f74d0004df0 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.649+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d0003d10 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74d0011780 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 10 client.15399 fetch_fsmap learned FSMap version 27 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d5266fe1d0 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d0003d10 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74d00042f0 con 0x55d5266e2ee0 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 10 client.15399 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 20 client.15399 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d5266ff580 0x55d526701970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 4 client.15399 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d52665bdb0 con 0x55d5266ff580 2024-09-10T21:54:53.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.650+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d5266ff580 0x55d526701970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.651+0000 7f74c17fa640 10 client.15399 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.651+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d5266ff580 0x55d526701970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ad02d8a47b870 server_cookie=8fbe07fc4b06e37a in_seq=0 out_seq=0 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74c17fa640 1 -- 172.21.15.39:0/2491634680 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d52665bdb0 con 0x55d5266ff580 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74c17fa640 10 client.15399 handle_command_reply: tid=0 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 client.15399 shutdown 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 msgr2=0x55d5266ec720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f74d0003ba0 tx=0x7f74d0003bd0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 shutdown_connections 2024-09-10T21:54:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d5266ff580 0x55d526701970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74c17fa640 0 client.15399 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 --2- 172.21.15.39:0/2491634680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266ec720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 >> 172.21.15.39:0/2491634680 conn(0x55d5266e0d10 msgr2=0x55d5266dff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 shutdown_connections 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 1 -- 172.21.15.39:0/2491634680 wait complete. 2024-09-10T21:54:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.652+0000 7f74e22e0740 20 client.15399 trim_cache size 0 max 16384 2024-09-10T21:54:53.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 Processor -- start 2024-09-10T21:54:53.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 -- start start 2024-09-10T21:54:53.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266e9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81b05b0 con 0x55d5266e2ee0 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81b20f0 con 0x55d5266e3800 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74e22e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81b0c80 con 0x55d5266ef790 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42744/0 (socket says 172.21.15.39:42744) 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 -- 172.21.15.39:0/1851259700 learned_addr learned my addr 172.21.15.39:0/1851259700 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:53.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 -- 172.21.15.39:0/1851259700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 msgr2=0x55d5266e9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 -- 172.21.15.39:0/1851259700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 msgr2=0x55d5266e9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 -- 172.21.15.39:0/1851259700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5266e1790 con 0x55d5266e2ee0 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.671+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f74d000f830 tx=0x7f74d00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c48e4a0ba2be62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74c37fe640 1 -- 172.21.15.39:0/1851259700 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0009b60 con 0x55d5266e2ee0 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74c37fe640 1 -- 172.21.15.39:0/1851259700 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d0005930 con 0x55d5266e2ee0 2024-09-10T21:54:53.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74c37fe640 1 -- 172.21.15.39:0/1851259700 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0004eb0 con 0x55d5266e2ee0 2024-09-10T21:54:53.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 -- 172.21.15.39:0/1851259700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 msgr2=0x55d5266fada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f74d000f830 tx=0x7f74d00098e0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 -- 172.21.15.39:0/1851259700 shutdown_connections 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266ef790 0x55d5266e9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1851259700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266e2ee0 0x55d5266fada0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 -- 172.21.15.39:0/1851259700 >> 172.21.15.39:0/1851259700 conn(0x55d5266e0d10 msgr2=0x55d5266fa690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 -- 172.21.15.39:0/1851259700 shutdown_connections 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.672+0000 7f74e22e0740 1 -- 172.21.15.39:0/1851259700 wait complete. 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 -- start start 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 Processor -- start 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e2ee0 0x55d5266f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81b1a20 con 0x55d5266ef790 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81b1350 con 0x55d5266e3800 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f74d81ae590 con 0x55d5266e2ee0 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74e22e0740 10 client.0 _ll_register_callbacks cb 0x7f74d0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74de4a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42748/0 (socket says 172.21.15.39:42748) 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.673+0000 7f74de4a8640 1 -- 172.21.15.39:0/1612976522 learned_addr learned my addr 172.21.15.39:0/1612976522 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e2ee0 0x55d5266f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 -- 172.21.15.39:0/1612976522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e2ee0 msgr2=0x55d5266f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e2ee0 0x55d5266f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 -- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 msgr2=0x55d5266f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 -- 172.21.15.39:0/1612976522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52676c210 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74de4a8640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f74d0004830 tx=0x7f74d0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe082f819ec6e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0011b30 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f74d0005480 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d0005930 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74d0005680 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74e22e0740 10 client.15405 fetch_fsmap learned FSMap version 27 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.674+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d52676d4a0 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d0005930 con 0x55d5266ef790 2024-09-10T21:54:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74d0039030 con 0x55d5266ef790 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 20 client.15405 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d52676db60 0x55d52676ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 4 client.15405 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d526657860 con 0x55d52676db60 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d52676db60 0x55d52676ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74c17fa640 10 client.15405 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.675+0000 7f74dd4a6640 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d52676db60 0x55d52676ff80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8bbc9e77e9ff39 server_cookie=aa1191c626af30df in_seq=0 out_seq=0 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74c17fa640 1 -- 172.21.15.39:0/1612976522 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d526657860 con 0x55d52676db60 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74c17fa640 10 client.15405 handle_command_reply: tid=0 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 client.15405 shutdown 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 msgr2=0x55d5266f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f74d0004830 tx=0x7f74d0013040 comp rx=0 tx=0).stop 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 shutdown_connections 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55d52676db60 0x55d52676ff80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5266ef790 0x55d5266f4d10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d5266e3800 0x55d5266f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 --2- 172.21.15.39:0/1612976522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d5266e2ee0 0x55d5266f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74c17fa640 0 client.15405 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 >> 172.21.15.39:0/1612976522 conn(0x55d5266e0d10 msgr2=0x55d5266ee570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.677+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 shutdown_connections 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74e22e0740 1 -- 172.21.15.39:0/1612976522 wait complete. 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74e22e0740 20 client.15405 trim_cache size 0 max 16384 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "916b7da7-e8ca-4525-bb53-e5deafacaea3", 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:54:53.685 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:53.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 msgr2=0x7f74c40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 0x7f74c40b78b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d5266e6060 tx=0x7f74d4005b50 comp rx=0 tx=0).stop 2024-09-10T21:54:53.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 msgr2=0x7f74d819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74d4005940 tx=0x7f74d4004270 comp rx=0 tx=0).stop 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 shutdown_connections 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74c40b53f0 0x7f74c40b78b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74d8108040 0x7f74d81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74d81076c0 0x7f74d819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 --2- 172.21.15.39:0/3282043927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d8101cb0 0x7f74d819b4a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 >> 172.21.15.39:0/3282043927 conn(0x7f74d80fd700 msgr2=0x7f74d8103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 shutdown_connections 2024-09-10T21:54:53.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:53.678+0000 7f74dff0b640 1 -- 172.21.15.39:0/3282043927 wait complete. 2024-09-10T21:54:54.360 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:54:54.659 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:54:54.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:54 smithi039 ceph-mon[30872]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-10T21:54:54.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:54 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:54:54.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:54 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:54.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:54 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:54:54.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:54 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:54.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:54 smithi070 ceph-mon[34909]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-10T21:54:54.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:54 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:54:54.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:54 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:54.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:54 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:54:54.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:54 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:54 smithi173 ceph-mon[35294]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-10T21:54:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:54 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:54:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:54 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:54 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:54:54.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:54 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.068+0000 7f32b887d640 1 -- 172.21.15.39:0/1381544922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4102dc0 msgr2=0x7f32b41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.068+0000 7f32b887d640 1 --2- 172.21.15.39:0/1381544922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4102dc0 0x7f32b41031a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009900 tx=0x7f32a402a410 comp rx=0 tx=0).stop 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 -- 172.21.15.39:0/1381544922 shutdown_connections 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 --2- 172.21.15.39:0/1381544922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4109150 0x7f32b410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 --2- 172.21.15.39:0/1381544922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 0x7f32b4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 --2- 172.21.15.39:0/1381544922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4102dc0 0x7f32b41031a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 -- 172.21.15.39:0/1381544922 >> 172.21.15.39:0/1381544922 conn(0x7f32b40fe830 msgr2=0x7f32b4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 -- 172.21.15.39:0/1381544922 shutdown_connections 2024-09-10T21:54:55.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 -- 172.21.15.39:0/1381544922 wait complete. 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 Processor -- start 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.069+0000 7f32b887d640 1 -- start start 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4102dc0 0x7f32b4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 0x7f32b4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112e60 con 0x7f32b4109150 2024-09-10T21:54:55.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112ce0 con 0x7f32b41087d0 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b887d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112fe0 con 0x7f32b4102dc0 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42758/0 (socket says 172.21.15.39:42758) 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 -- 172.21.15.39:0/293551227 learned_addr learned my addr 172.21.15.39:0/293551227 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 0x7f32b4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b259c640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4102dc0 0x7f32b4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 -- 172.21.15.39:0/293551227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4102dc0 msgr2=0x7f32b4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4102dc0 0x7f32b4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 -- 172.21.15.39:0/293551227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 msgr2=0x7f32b4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 0x7f32b4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 -- 172.21.15.39:0/293551227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b419f400 con 0x7f32b4109150 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.070+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00cad0 tx=0x7f32ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.071+0000 7f32a37fe640 1 -- 172.21.15.39:0/293551227 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00ae20 con 0x7f32b4109150 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.071+0000 7f32a37fe640 1 -- 172.21.15.39:0/293551227 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32ac005020 con 0x7f32b4109150 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.071+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b419f6f0 con 0x7f32b4109150 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.071+0000 7f32a37fe640 1 -- 172.21.15.39:0/293551227 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00f6b0 con 0x7f32b4109150 2024-09-10T21:54:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.071+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41a5db0 con 0x7f32b4109150 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.073+0000 7f32bac52740 1 Processor -- start 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.073+0000 7f32a37fe640 1 -- 172.21.15.39:0/293551227 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f32ac0054f0 con 0x7f32b4109150 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 -- start start 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991a480 0x5564b991a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 0x5564b992d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5564b9890e50 con 0x5564b991ada0 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5564b9880280 con 0x5564b992b140 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32bac52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5564b9884090 con 0x5564b991a480 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42774/0 (socket says 172.21.15.39:42774) 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 -- 172.21.15.39:0/762521273 learned_addr learned my addr 172.21.15.39:0/762521273 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991a480 0x5564b991a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 0x5564b992d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 -- 172.21.15.39:0/762521273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991a480 msgr2=0x5564b991a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991a480 0x5564b991a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 -- 172.21.15.39:0/762521273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 msgr2=0x5564b992d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 0x5564b992d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b259c640 1 -- 172.21.15.39:0/762521273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b95de650 con 0x5564b991ada0 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.074+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 0x5564b992d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:55.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32a37fe640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 0x7f329c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 0x7f329c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32b259c640 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009900 tx=0x7f32a4004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ae71526a93352 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32a37fe640 1 -- 172.21.15.39:0/293551227 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f32ac0e5cb0 con 0x7f32b4109150 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32a0ff9640 1 -- 172.21.15.39:0/762521273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403f070 con 0x5564b991ada0 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32a0ff9640 1 -- 172.21.15.39:0/762521273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32a40046c0 con 0x5564b991ada0 2024-09-10T21:54:55.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.075+0000 7f32a0ff9640 1 -- 172.21.15.39:0/762521273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4035070 con 0x5564b991ada0 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- 172.21.15.39:0/762521273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 msgr2=0x5564b992ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009900 tx=0x7f32a4004390 comp rx=0 tx=0).stop 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 0x7f329c0b7830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5564b991a430 tx=0x7f32a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- 172.21.15.39:0/762521273 shutdown_connections 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b992b140 0x5564b992d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991ada0 0x5564b992ac00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 --2- 172.21.15.39:0/762521273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991a480 0x5564b991a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- 172.21.15.39:0/762521273 >> 172.21.15.39:0/762521273 conn(0x5564b99182b0 msgr2=0x5564b9919450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- 172.21.15.39:0/762521273 shutdown_connections 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- 172.21.15.39:0/762521273 wait complete. 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 -- start start 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.076+0000 7f32bac52740 1 Processor -- start 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 0x5564b9927e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b992b140 0x5564b9928450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5564b96e1700 con 0x5564b991a480 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5564b981b110 con 0x5564b991ada0 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5564b992dd90 con 0x5564b992b140 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32bac52740 10 client.0 _ll_register_callbacks cb 0x5564b9834990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42778/0 (socket says 172.21.15.39:42778) 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 -- 172.21.15.39:0/736292052 learned_addr learned my addr 172.21.15.39:0/736292052 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b992b140 0x5564b9928450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 0x5564b9927e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 -- 172.21.15.39:0/736292052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b992b140 msgr2=0x5564b9928450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b992b140 0x5564b9928450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 -- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 msgr2=0x5564b9927e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 0x5564b9927e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 -- 172.21.15.39:0/736292052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b9848c40 con 0x5564b991a480 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 0x5564b9927e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f32b259c640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f32a4006010 tx=0x7f32a4005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ff5074c9fb9abd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f3299ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.077+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403f030 con 0x5564b991a480 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f32a40316a0 con 0x5564b991a480 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32a40046c0 con 0x5564b991a480 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32a4035040 con 0x5564b991a480 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 10 client.15417 fetch_fsmap learned FSMap version 27 2024-09-10T21:54:55.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5564b9939680 con 0x5564b991a480 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32a40046c0 con 0x5564b991a480 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f32a4044610 con 0x5564b991a480 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 10 client.15417 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 20 client.15417 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b993a9d0 0x5564b993cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 4 client.15417 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:54:55.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.078+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b9892da0 con 0x5564b993a9d0 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.079+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b993a9d0 0x5564b993cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.079+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b993a9d0 0x5564b993cdc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe25666a9a3c32c2 server_cookie=eebf84518415bb17 in_seq=0 out_seq=0 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.079+0000 7f3299ffb640 10 client.15417 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f3299ffb640 1 -- 172.21.15.39:0/736292052 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564b9892da0 con 0x5564b993a9d0 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f3299ffb640 10 client.15417 handle_command_reply: tid=0 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 client.15417 shutdown 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 msgr2=0x5564b992a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f32a4006010 tx=0x7f32a4005280 comp rx=0 tx=0).stop 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 shutdown_connections 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b993a9d0 0x5564b993cdc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b992b140 0x5564b9928450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991ada0 0x5564b9927e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 --2- 172.21.15.39:0/736292052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b991a480 0x5564b992a9f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 >> 172.21.15.39:0/736292052 conn(0x5564b99182b0 msgr2=0x5564b99173d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f3299ffb640 0 client.15417 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:55.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 shutdown_connections 2024-09-10T21:54:55.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 1 -- 172.21.15.39:0/736292052 wait complete. 2024-09-10T21:54:55.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.080+0000 7f32bac52740 20 client.15417 trim_cache size 0 max 16384 2024-09-10T21:54:55.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 Processor -- start 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 -- start start 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b992d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41ac240 con 0x5564b992b140 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41add80 con 0x5564b991a480 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32bac52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41ac910 con 0x5564b991ada0 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42782/0 (socket says 172.21.15.39:42782) 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 -- 172.21.15.39:0/592649273 learned_addr learned my addr 172.21.15.39:0/592649273 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b259c640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b992d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 -- 172.21.15.39:0/592649273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 msgr2=0x5564b993fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 -- 172.21.15.39:0/592649273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 msgr2=0x5564b992d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.098+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b992d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32b2d9d640 1 -- 172.21.15.39:0/592649273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b9918d30 con 0x5564b992b140 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0a88f0 tx=0x7f32ac0abe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952c54da4e3ebb38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f329bfff640 1 -- 172.21.15.39:0/592649273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac01d040 con 0x5564b992b140 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f329bfff640 1 -- 172.21.15.39:0/592649273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32ac0b5040 con 0x5564b992b140 2024-09-10T21:54:55.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f329bfff640 1 -- 172.21.15.39:0/592649273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0cf2d0 con 0x5564b992b140 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 -- 172.21.15.39:0/592649273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 msgr2=0x5564b993ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0a88f0 tx=0x7f32ac0abe30 comp rx=0 tx=0).stop 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 -- 172.21.15.39:0/592649273 shutdown_connections 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993ff40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 --2- 172.21.15.39:0/592649273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b992d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.099+0000 7f32bac52740 1 -- 172.21.15.39:0/592649273 >> 172.21.15.39:0/592649273 conn(0x5564b99182b0 msgr2=0x5564b992cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- 172.21.15.39:0/592649273 shutdown_connections 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- 172.21.15.39:0/592649273 wait complete. 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- start start 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 Processor -- start 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b99400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41ad6b0 con 0x5564b992b140 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41acfe0 con 0x5564b991a480 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41aa220 con 0x5564b991ada0 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32bac52740 10 client.0 _ll_register_callbacks cb 0x7f32a800ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32b2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42794/0 (socket says 172.21.15.39:42794) 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32b2d9d640 1 -- 172.21.15.39:0/2878025972 learned_addr learned my addr 172.21.15.39:0/2878025972 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32b1d9b640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.100+0000 7f32b259c640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b99400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 -- 172.21.15.39:0/2878025972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 msgr2=0x5564b993e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 -- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 msgr2=0x5564b99400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b99400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 -- 172.21.15.39:0/2878025972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b99205e0 con 0x5564b992b140 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32b2d9d640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0ac020 tx=0x7f32ac005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d2b83b993173c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f3299ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac01d030 con 0x5564b992b140 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f32ac0cf050 con 0x5564b992b140 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ac0b5040 con 0x5564b992b140 2024-09-10T21:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32ac0b0e00 con 0x5564b992b140 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32bac52740 10 client.15423 fetch_fsmap learned FSMap version 27 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5564b99a8310 con 0x5564b992b140 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.101+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32ac0b5040 con 0x5564b992b140 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f32ac093ab0 con 0x5564b992b140 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 10 client.15423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 20 client.15423 populate_metadata read hostname 'smithi039' 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b99a8a80 0x5564b99aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 4 client.15423 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5564b988e850 con 0x5564b99a8a80 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32b259c640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b99a8a80 0x5564b99aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f3299ffb640 10 client.15423 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f32b259c640 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b99a8a80 0x5564b99aaea0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e74328f6377c586 server_cookie=7bd8dd3345e312ab in_seq=0 out_seq=0 2024-09-10T21:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f3299ffb640 1 -- 172.21.15.39:0/2878025972 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5564b988e850 con 0x5564b99a8a80 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.102+0000 7f3299ffb640 10 client.15423 handle_command_reply: tid=0 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 client.15423 shutdown 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 msgr2=0x5564b993eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0ac020 tx=0x7f32ac005890 comp rx=0 tx=0).stop 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 shutdown_connections 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5564b99a8a80 0x5564b99aaea0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5564b992b140 0x5564b993eb20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b991ada0 0x5564b993e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f3299ffb640 0 client.15423 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 --2- 172.21.15.39:0/2878025972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5564b991a480 0x5564b99400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 >> 172.21.15.39:0/2878025972 conn(0x5564b99182b0 msgr2=0x5564b991f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 shutdown_connections 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 1 -- 172.21.15.39:0/2878025972 wait complete. 2024-09-10T21:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32bac52740 20 client.15423 trim_cache size 0 max 16384 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "916b7da7-e8ca-4525-bb53-e5deafacaea3", 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:54:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:54:55.111 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 msgr2=0x7f329c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 0x7f329c0b7830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5564b991a430 tx=0x7f32a800b390 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 msgr2=0x7f32b419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00cad0 tx=0x7f32ac00cf90 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 shutdown_connections 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f329c0b5370 0x7f329c0b7830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b4109150 0x7f32b419ec30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b41087d0 0x7f32b4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.103+0000 7f32b887d640 1 --2- 172.21.15.39:0/293551227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b4102dc0 0x7f32b4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.104+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 >> 172.21.15.39:0/293551227 conn(0x7f32b40fe830 msgr2=0x7f32b4106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:54:55.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.104+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 shutdown_connections 2024-09-10T21:54:55.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:54:55.104+0000 7f32b887d640 1 -- 172.21.15.39:0/293551227 wait complete. 2024-09-10T21:54:55.852 INFO:tasks.cephfs.filesystem:scrub status for tag:916b7da7-e8ca-4525-bb53-e5deafacaea3 - {'path': '/', 'tag': '916b7da7-e8ca-4525-bb53-e5deafacaea3', 'options': 'recursive,force'} 2024-09-10T21:54:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:56 smithi070 ceph-mon[34909]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T21:54:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:56 smithi039 ceph-mon[30872]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T21:54:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:56 smithi173 ceph-mon[35294]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T21:54:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:54:58 smithi070 ceph-mon[34909]: pgmap v340: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-10T21:54:58.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:54:58 smithi039 ceph-mon[30872]: pgmap v340: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-10T21:54:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:54:58 smithi173 ceph-mon[35294]: pgmap v340: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-10T21:55:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:00 smithi070 ceph-mon[34909]: pgmap v341: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:00 smithi039 ceph-mon[30872]: pgmap v341: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:00 smithi173 ceph-mon[35294]: pgmap v341: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:02 smithi070 ceph-mon[34909]: pgmap v342: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:55:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:02 smithi039 ceph-mon[30872]: pgmap v342: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:55:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:02 smithi173 ceph-mon[35294]: pgmap v342: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T21:55:04.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:04 smithi070 ceph-mon[34909]: pgmap v343: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-10T21:55:04.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:04 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:55:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:04 smithi039 ceph-mon[30872]: pgmap v343: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-10T21:55:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:55:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:04 smithi173 ceph-mon[35294]: pgmap v343: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-10T21:55:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:04 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:55:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 -- 172.21.15.39:0/2635054729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c103370 msgr2=0x7f3a6c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 --2- 172.21.15.39:0/2635054729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c103370 0x7f3a6c109cf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009cd0 tx=0x7f3a6402a8e0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 -- 172.21.15.39:0/2635054729 shutdown_connections 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 --2- 172.21.15.39:0/2635054729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c103370 0x7f3a6c109cf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 --2- 172.21.15.39:0/2635054729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 --2- 172.21.15.39:0/2635054729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 0x7f3a6c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 -- 172.21.15.39:0/2635054729 >> 172.21.15.39:0/2635054729 conn(0x7f3a6c0fd140 msgr2=0x7f3a6c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 -- 172.21.15.39:0/2635054729 shutdown_connections 2024-09-10T21:55:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.085+0000 7f3a736ef640 1 -- 172.21.15.39:0/2635054729 wait complete. 2024-09-10T21:55:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 Processor -- start 2024-09-10T21:55:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 -- start start 2024-09-10T21:55:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 0x7f3a6c105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 0x7f3a6c1043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c10d4b0 con 0x7f3a6c1029b0 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c10d330 con 0x7f3a6c103370 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.086+0000 7f3a736ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c10d630 con 0x7f3a6c101860 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42354/0 (socket says 172.21.15.39:42354) 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 -- 172.21.15.39:0/4142746052 learned_addr learned my addr 172.21.15.39:0/4142746052 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 0x7f3a6c1043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a7148b640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 0x7f3a6c105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 -- 172.21.15.39:0/4142746052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 msgr2=0x7f3a6c105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 0x7f3a6c105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 -- 172.21.15.39:0/4142746052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 msgr2=0x7f3a6c1043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 0x7f3a6c1043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 -- 172.21.15.39:0/4142746052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c104c30 con 0x7f3a6c1029b0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 0x7f3a6c1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00e9f0 tx=0x7f3a5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a627fc640 1 -- 172.21.15.39:0/4142746052 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00cd80 con 0x7f3a6c1029b0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a627fc640 1 -- 172.21.15.39:0/4142746052 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a5c0108e0 con 0x7f3a6c1029b0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c1a2df0 con 0x7f3a6c1029b0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.087+0000 7f3a627fc640 1 -- 172.21.15.39:0/4142746052 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c018980 con 0x7f3a6c1029b0 2024-09-10T21:55:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.088+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a32b0 con 0x7f3a6c1029b0 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.090+0000 7f3a764be740 1 Processor -- start 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.090+0000 7f3a764be740 1 -- start start 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa3f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555cfa9ac6f0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555cfa99bb20 con 0x555cfaa3d190 2024-09-10T21:55:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a764be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555cfa99f930 con 0x555cfaa3a860 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36594/0 (socket says 172.21.15.39:36594) 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 -- 172.21.15.39:0/1268013084 learned_addr learned my addr 172.21.15.39:0/1268013084 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a7148b640 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa3f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 -- 172.21.15.39:0/1268013084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 msgr2=0x555cfaa3f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa3f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 -- 172.21.15.39:0/1268013084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 msgr2=0x555cfaa42090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa42090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a71c8c640 1 -- 172.21.15.39:0/1268013084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cfa961530 con 0x555cfaa3a860 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.091+0000 7f3a627fc640 1 -- 172.21.15.39:0/4142746052 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f3a5c010430 con 0x7f3a6c1029b0 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009cd0 tx=0x7f3a64009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f0538e803cc4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a577fe640 1 -- 172.21.15.39:0/1268013084 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64031430 con 0x555cfaa3a860 2024-09-10T21:55:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a577fe640 1 -- 172.21.15.39:0/1268013084 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036040 con 0x555cfaa3a860 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a577fe640 1 -- 172.21.15.39:0/1268013084 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64004830 con 0x555cfaa3a860 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a627fc640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 0x7f3a580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a7148b640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 0x7f3a580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.092+0000 7f3a627fc640 1 -- 172.21.15.39:0/4142746052 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3a5c0e60a0 con 0x7f3a6c1029b0 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- 172.21.15.39:0/1268013084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 msgr2=0x555cfaa3cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a7148b640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 0x7f3a580b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a68004610 tx=0x7f3a6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009cd0 tx=0x7f3a64009a20 comp rx=0 tx=0).stop 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- 172.21.15.39:0/1268013084 shutdown_connections 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa42090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa3f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 --2- 172.21.15.39:0/1268013084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa3cc50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- 172.21.15.39:0/1268013084 >> 172.21.15.39:0/1268013084 conn(0x555cfaa359b0 msgr2=0x555cfaa36740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- 172.21.15.39:0/1268013084 shutdown_connections 2024-09-10T21:55:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- 172.21.15.39:0/1268013084 wait complete. 2024-09-10T21:55:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 -- start start 2024-09-10T21:55:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.093+0000 7f3a764be740 1 Processor -- start 2024-09-10T21:55:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa43e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555cfa8d3ab0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555cfa941730 con 0x555cfaa3d190 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555cfaa42af0 con 0x555cfaa3a860 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42370/0 (socket says 172.21.15.39:42370) 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 -- 172.21.15.39:0/3327006006 learned_addr learned my addr 172.21.15.39:0/3327006006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a7148b640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa43e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a764be740 10 client.0 _ll_register_callbacks cb 0x555cfa9956b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 -- 172.21.15.39:0/3327006006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 msgr2=0x555cfaa43e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa43e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.094+0000 7f3a71c8c640 1 -- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 msgr2=0x555cfaa444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a71c8c640 1 -- 172.21.15.39:0/3327006006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cfa6fd790 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006010 tx=0x7f3a64009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1983c14dcc01eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64052020 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a64036040 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3a64003d40 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a64003f40 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a764be740 10 client.15432 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cfa776620 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.095+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036040 con 0x555cfaa3fbd0 2024-09-10T21:55:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3a64030070 con 0x555cfaa3fbd0 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 10 client.15432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 20 client.15432 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaa4f290 0x555cfaa51680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 4 client.15432 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cfa9ae640 con 0x555cfaa4f290 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a7148b640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaa4f290 0x555cfaa51680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a54ff9640 10 client.15432 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.096+0000 7f3a7148b640 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaa4f290 0x555cfaa51680 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe616d6d638122 server_cookie=6ea227f57553e731 in_seq=0 out_seq=0 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a54ff9640 1 -- 172.21.15.39:0/3327006006 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cfa9ae640 con 0x555cfaa4f290 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a54ff9640 10 client.15432 handle_command_reply: tid=0 2024-09-10T21:55:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 client.15432 shutdown 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 msgr2=0x555cfaa450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006010 tx=0x7f3a64009880 comp rx=0 tx=0).stop 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 shutdown_connections 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaa4f290 0x555cfaa51680 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa450a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a54ff9640 0 client.15432 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3d190 0x555cfaa444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 --2- 172.21.15.39:0/3327006006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa43e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 >> 172.21.15.39:0/3327006006 conn(0x555cfaa359b0 msgr2=0x555cfaa34bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 shutdown_connections 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.097+0000 7f3a764be740 1 -- 172.21.15.39:0/3327006006 wait complete. 2024-09-10T21:55:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.098+0000 7f3a764be740 20 client.15432 trim_cache size 0 max 16384 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 Processor -- start 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 -- start start 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa39cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3fbd0 0x555cfaa3a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ac060 con 0x555cfaa3d190 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1adba0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a764be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ac730 con 0x555cfaa3a860 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42376/0 (socket says 172.21.15.39:42376) 2024-09-10T21:55:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 -- 172.21.15.39:0/3954858904 learned_addr learned my addr 172.21.15.39:0/3954858904 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a7148b640 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa39cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3fbd0 0x555cfaa3a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 -- 172.21.15.39:0/3954858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 msgr2=0x555cfaa39cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa39cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 -- 172.21.15.39:0/3954858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3fbd0 msgr2=0x555cfaa3a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3fbd0 0x555cfaa3a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.128+0000 7f3a70c8a640 1 -- 172.21.15.39:0/3954858904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cfaa519f0 con 0x555cfaa3d190 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.129+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097b0 tx=0x7f3a5c0ac1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddd388815e1fa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.129+0000 7f3a56ffd640 1 -- 172.21.15.39:0/3954858904 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b11f0 con 0x555cfaa3d190 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.129+0000 7f3a56ffd640 1 -- 172.21.15.39:0/3954858904 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a5c0b5ca0 con 0x555cfaa3d190 2024-09-10T21:55:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.129+0000 7f3a56ffd640 1 -- 172.21.15.39:0/3954858904 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0ab490 con 0x555cfaa3d190 2024-09-10T21:55:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- 172.21.15.39:0/3954858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 msgr2=0x555cfaa4c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097b0 tx=0x7f3a5c0ac1d0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- 172.21.15.39:0/3954858904 shutdown_connections 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3fbd0 0x555cfaa3a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3d190 0x555cfaa4c0e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- 172.21.15.39:0/3954858904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3a860 0x555cfaa39cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- 172.21.15.39:0/3954858904 >> 172.21.15.39:0/3954858904 conn(0x555cfaa359b0 msgr2=0x555cfaa43070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- 172.21.15.39:0/3954858904 shutdown_connections 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- 172.21.15.39:0/3954858904 wait complete. 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- start start 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 Processor -- start 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 0x555cfaa4b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3d190 0x555cfaa4c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ad4d0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ace00 con 0x555cfaa3a860 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.130+0000 7f3a764be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1aa040 con 0x555cfaa3d190 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a764be740 10 client.0 _ll_register_callbacks cb 0x7f3a6800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42378/0 (socket says 172.21.15.39:42378) 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 -- 172.21.15.39:0/699117848 learned_addr learned my addr 172.21.15.39:0/699117848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a7148b640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 0x555cfaa4b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a70c8a640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3d190 0x555cfaa4c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 -- 172.21.15.39:0/699117848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3d190 msgr2=0x555cfaa4c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3d190 0x555cfaa4c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 -- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 msgr2=0x555cfaa4b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 0x555cfaa4b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 -- 172.21.15.39:0/699117848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cfaa4af70 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a7148b640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 0x555cfaa4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a71c8c640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a640444b0 tx=0x7f3a64004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ec39d7f9e3ee27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64052070 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a5c0b5ca0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3a64004d50 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a640305a0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a764be740 10 client.15438 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.131+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cfaa49f60 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a5c0b5ca0 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3a64030040 con 0x555cfaa3fbd0 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 10 client.15438 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 20 client.15438 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaabc700 0x555cfaabeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 4 client.15438 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cfa9aa0f0 con 0x555cfaabc700 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.132+0000 7f3a7148b640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaabc700 0x555cfaabeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.133+0000 7f3a54ff9640 10 client.15438 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.133+0000 7f3a7148b640 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaabc700 0x555cfaabeb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b91f8a6aa7bc0b server_cookie=a02ee0684a64c78f in_seq=0 out_seq=0 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.141+0000 7f3a54ff9640 1 -- 172.21.15.39:0/699117848 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cfa9aa0f0 con 0x555cfaabc700 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.141+0000 7f3a54ff9640 10 client.15438 handle_command_reply: tid=0 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.141+0000 7f3a764be740 1 client.15438 shutdown 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.141+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 msgr2=0x555cfaa4a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a640444b0 tx=0x7f3a64004390 comp rx=0 tx=0).stop 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 shutdown_connections 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x555cfaabc700 0x555cfaabeb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfaa3fbd0 0x555cfaa4a770 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cfaa3d190 0x555cfaa4c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 --2- 172.21.15.39:0/699117848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555cfaa3a860 0x555cfaa4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 >> 172.21.15.39:0/699117848 conn(0x555cfaa359b0 msgr2=0x555cfaa38a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a54ff9640 0 client.15438 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 shutdown_connections 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 1 -- 172.21.15.39:0/699117848 wait complete. 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a764be740 20 client.15438 trim_cache size 0 max 16384 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:55:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 msgr2=0x7f3a580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 0x7f3a580b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a68004610 tx=0x7f3a6800b390 comp rx=0 tx=0).stop 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 msgr2=0x7f3a6c103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.142+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00e9f0 tx=0x7f3a5c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 shutdown_connections 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3a580b5370 0x7f3a580b7830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c103370 0x7f3a6c1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a6c1029b0 0x7f3a6c103e80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 --2- 172.21.15.39:0/4142746052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c101860 0x7f3a6c105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 >> 172.21.15.39:0/4142746052 conn(0x7f3a6c0fd140 msgr2=0x7f3a6c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 shutdown_connections 2024-09-10T21:55:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:06.143+0000 7f3a736ef640 1 -- 172.21.15.39:0/4142746052 wait complete. 2024-09-10T21:55:06.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:06 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:55:06.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:55:06.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:55:06.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:06 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:55:06.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:55:06.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:06 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:55:07.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:07 smithi070 ceph-mon[34909]: pgmap v344: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T21:55:07.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:07 smithi039 ceph-mon[30872]: pgmap v344: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T21:55:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:07 smithi173 ceph-mon[35294]: pgmap v344: 97 pgs: 97 active+clean; 658 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T21:55:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:09 smithi070 ceph-mon[34909]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-10T21:55:09.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:09 smithi039 ceph-mon[30872]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-10T21:55:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:09 smithi173 ceph-mon[35294]: pgmap v345: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-10T21:55:11.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:11 smithi070 ceph-mon[34909]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-10T21:55:11.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:11 smithi039 ceph-mon[30872]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-10T21:55:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:11 smithi173 ceph-mon[35294]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-10T21:55:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:13 smithi070 ceph-mon[34909]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:13.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:13 smithi039 ceph-mon[30872]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:13 smithi173 ceph-mon[35294]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:15.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:15 smithi070 ceph-mon[34909]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-09-10T21:55:15.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:15 smithi039 ceph-mon[30872]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-09-10T21:55:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:15 smithi173 ceph-mon[35294]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-09-10T21:55:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:17 smithi070 ceph-mon[34909]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:17 smithi039 ceph-mon[30872]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:17 smithi173 ceph-mon[35294]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 -- 172.21.15.39:0/2837354353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 msgr2=0x7f4020103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 --2- 172.21.15.39:0/2837354353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020103f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f400c009860 tx=0x7f400c02a340 comp rx=0 tx=0).stop 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 -- 172.21.15.39:0/2837354353 shutdown_connections 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 --2- 172.21.15.39:0/2837354353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020104490 0x7f402010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 --2- 172.21.15.39:0/2837354353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020103f50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 --2- 172.21.15.39:0/2837354353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4020102980 0x7f4020102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 -- 172.21.15.39:0/2837354353 >> 172.21.15.39:0/2837354353 conn(0x7f40200fe240 msgr2=0x7f4020100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.279+0000 7f4026e60640 1 -- 172.21.15.39:0/2837354353 shutdown_connections 2024-09-10T21:55:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.280+0000 7f4026e60640 1 -- 172.21.15.39:0/2837354353 wait complete. 2024-09-10T21:55:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.280+0000 7f4026e60640 1 Processor -- start 2024-09-10T21:55:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.280+0000 7f4026e60640 1 -- start start 2024-09-10T21:55:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4020104490 0x7f4020075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f402010e5d0 con 0x7f4020102980 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f402010e450 con 0x7f4020103ad0 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4026e60640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f402010e750 con 0x7f4020104490 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53096/0 (socket says 172.21.15.39:53096) 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4024bfc640 1 -- 172.21.15.39:0/1650097454 learned_addr learned my addr 172.21.15.39:0/1650097454 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 -- 172.21.15.39:0/1650097454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4020104490 msgr2=0x7f4020075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4020104490 0x7f4020075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 -- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 msgr2=0x7f4020076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f401ffff640 1 -- 172.21.15.39:0/1650097454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40200762f0 con 0x7f4020103ad0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.281+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.282+0000 7f401ffff640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020075540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f400c02a860 tx=0x7f400c030df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.282+0000 7f401dffb640 1 -- 172.21.15.39:0/1650097454 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c037040 con 0x7f4020103ad0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.282+0000 7f401dffb640 1 -- 172.21.15.39:0/1650097454 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c041070 con 0x7f4020103ad0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.282+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40201a2c60 con 0x7f4020103ad0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.283+0000 7f401dffb640 1 -- 172.21.15.39:0/1650097454 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c0039f0 con 0x7f4020103ad0 2024-09-10T21:55:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.283+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40201a3060 con 0x7f4020103ad0 2024-09-10T21:55:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.285+0000 7f401dffb640 1 -- 172.21.15.39:0/1650097454 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f400c003bb0 con 0x7f4020103ad0 2024-09-10T21:55:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 Processor -- start 2024-09-10T21:55:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 -- start start 2024-09-10T21:55:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 0x55eea34f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eea34646f0 con 0x55eea34f2860 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eea3453b20 con 0x55eea34f5190 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.286+0000 7f4029c2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eea3457930 con 0x55eea34f7bd0 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53100/0 (socket says 172.21.15.39:53100) 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 -- 172.21.15.39:0/2072749189 learned_addr learned my addr 172.21.15.39:0/2072749189 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 0x55eea34f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f401ffff640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 -- 172.21.15.39:0/2072749189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 msgr2=0x55eea34fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 -- 172.21.15.39:0/2072749189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 msgr2=0x55eea34f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 0x55eea34f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f40253fd640 1 -- 172.21.15.39:0/2072749189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eea3419530 con 0x55eea34f2860 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.287+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 0x55eea34f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f40253fd640 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4018005c40 tx=0x7f401800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969f5e0797316ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f401dffb640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 0x7f40100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f400affd640 1 -- 172.21.15.39:0/2072749189 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018003b70 con 0x55eea34f2860 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f400affd640 1 -- 172.21.15.39:0/2072749189 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4018003d10 con 0x55eea34f2860 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f400affd640 1 -- 172.21.15.39:0/2072749189 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800cbf0 con 0x55eea34f2860 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 0x7f40100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.288+0000 7f401dffb640 1 -- 172.21.15.39:0/1650097454 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f400c105dd0 con 0x7f4020103ad0 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- 172.21.15.39:0/2072749189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 msgr2=0x55eea34f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 0x7f40100b78b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4014005fd0 tx=0x7f401400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4018005c40 tx=0x7f401800e7c0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- 172.21.15.39:0/2072749189 shutdown_connections 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f5190 0x55eea34f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2072749189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f2860 0x55eea34f4c50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- 172.21.15.39:0/2072749189 >> 172.21.15.39:0/2072749189 conn(0x55eea34ed9b0 msgr2=0x55eea34ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- 172.21.15.39:0/2072749189 shutdown_connections 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- 172.21.15.39:0/2072749189 wait complete. 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.289+0000 7f4029c2e740 1 -- start start 2024-09-10T21:55:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 Processor -- start 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea34fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea34fd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eea338bab0 con 0x55eea34f5190 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eea33f9730 con 0x55eea34f7bd0 2024-09-10T21:55:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eea34fabb0 con 0x55eea34f2860 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4029c2e740 10 client.0 _ll_register_callbacks cb 0x55eea344d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea34fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea34fbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:37682/0 (socket says 172.21.15.39:37682) 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f401ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f4024bfc640 1 -- 172.21.15.39:0/2309062020 learned_addr learned my addr 172.21.15.39:0/2309062020 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.290+0000 7f40253fd640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea34fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 -- 172.21.15.39:0/2309062020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 msgr2=0x55eea34fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea34fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 -- 172.21.15.39:0/2309062020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 msgr2=0x55eea34fc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34fc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 -- 172.21.15.39:0/2309062020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eea31b5790 con 0x55eea34f7bd0 2024-09-10T21:55:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f401ffff640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f40253fd640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea34fd190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4018006010 tx=0x7f401800c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd3c410888ddbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f3ffffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800caf0 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.291+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4018003d10 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f401800cc90 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f401802f050 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f4029c2e740 10 client.25070 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eea322e620 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4018003d10 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f401800b040 con 0x55eea34f7bd0 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f4029c2e740 10 client.25070 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f4029c2e740 10 client.25070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.292+0000 7f4029c2e740 20 client.25070 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea3509af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f4029c2e740 4 client.25070 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eea3466640 con 0x55eea3507700 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea3509af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea3509af0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e9ca52961e779e server_cookie=acc1cf2c1d0c251d in_seq=0 out_seq=0 2024-09-10T21:55:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.293+0000 7f3ffffff640 10 client.25070 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f3ffffff640 1 -- 172.21.15.39:0/2309062020 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eea3466640 con 0x55eea3507700 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f3ffffff640 10 client.25070 handle_command_reply: tid=0 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 client.25070 shutdown 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 msgr2=0x55eea34fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea34fd190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4018006010 tx=0x7f401800c610 comp rx=0 tx=0).stop 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 shutdown_connections 2024-09-10T21:55:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea3509af0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea34fd190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f3ffffff640 0 client.25070 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.294+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.295+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2309062020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea34fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.295+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 >> 172.21.15.39:0/2309062020 conn(0x55eea34ed9b0 msgr2=0x55eea34ecbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.295+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 shutdown_connections 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.295+0000 7f4029c2e740 1 -- 172.21.15.39:0/2309062020 wait complete. 2024-09-10T21:55:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.295+0000 7f4029c2e740 20 client.25070 trim_cache size 0 max 16384 2024-09-10T21:55:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.324+0000 7f4029c2e740 1 Processor -- start 2024-09-10T21:55:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.324+0000 7f4029c2e740 1 -- start start 2024-09-10T21:55:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 0x55eea34fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f401ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f401ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53112/0 (socket says 172.21.15.39:53112) 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f401ffff640 1 -- 172.21.15.39:0/2697957635 learned_addr learned my addr 172.21.15.39:0/2697957635 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 0x55eea34fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34ee750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ac060 con 0x55eea34f5190 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40201adba0 con 0x55eea34f2860 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ac730 con 0x55eea34f7bd0 2024-09-10T21:55:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f40253fd640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 -- 172.21.15.39:0/2697957635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 msgr2=0x55eea34ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34ee750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 -- 172.21.15.39:0/2697957635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 msgr2=0x55eea34ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f4024bfc640 1 -- 172.21.15.39:0/2697957635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eea350a100 con 0x55eea34f2860 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.325+0000 7f401ffff640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.326+0000 7f4024bfc640 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 0x55eea34fd170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4014010800 tx=0x7f4014019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=716a12481005dd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.326+0000 7f400a7fc640 1 -- 172.21.15.39:0/2697957635 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401401e9b0 con 0x55eea34f2860 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.326+0000 7f400a7fc640 1 -- 172.21.15.39:0/2697957635 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4014005020 con 0x55eea34f2860 2024-09-10T21:55:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.326+0000 7f400a7fc640 1 -- 172.21.15.39:0/2697957635 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014004ad0 con 0x55eea34f2860 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 msgr2=0x55eea34fd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 0x55eea34fd170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4014010800 tx=0x7f4014019000 comp rx=0 tx=0).stop 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 shutdown_connections 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f7bd0 0x55eea34ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea34ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 --2- 172.21.15.39:0/2697957635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f2860 0x55eea34fd170 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 >> 172.21.15.39:0/2697957635 conn(0x55eea34ed9b0 msgr2=0x55eea34f1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 shutdown_connections 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- 172.21.15.39:0/2697957635 wait complete. 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.327+0000 7f4029c2e740 1 -- start start 2024-09-10T21:55:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.328+0000 7f4029c2e740 1 Processor -- start 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.328+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.328+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea3501500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.328+0000 7f4029c2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea35020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.328+0000 7f4029c2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ad4d0 con 0x55eea34f5190 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4029c2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40201ace00 con 0x55eea34f7bd0 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4029c2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40201aa040 con 0x55eea34f2860 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f401ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea3501500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:37696/0 (socket says 172.21.15.39:37696) 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 -- 172.21.15.39:0/1709201324 learned_addr learned my addr 172.21.15.39:0/1709201324 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f40253fd640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea35020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4029c2e740 10 client.0 _ll_register_callbacks cb 0x7f401400bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 -- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 msgr2=0x55eea35020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea35020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 -- 172.21.15.39:0/1709201324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 msgr2=0x55eea3501500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea3501500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 -- 172.21.15.39:0/1709201324 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eea3502900 con 0x55eea34f2860 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f401ffff640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea3501500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f4024bfc640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4014010be0 tx=0x7f4014010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db06020062c646cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.329+0000 7f3ffffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014040060 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4014005020 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f401401ebb0 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f401401edb0 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 10 client.25108 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eea3503c30 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4014005020 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f401402a780 con 0x55eea34f2860 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 10 client.25108 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 10 client.25108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 20 client.25108 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea35768d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 4 client.25108 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:55:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.330+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eea34620f0 con 0x55eea3507700 2024-09-10T21:55:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.331+0000 7f401ffff640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea35768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.331+0000 7f3ffffff640 10 client.25108 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.331+0000 7f401ffff640 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea35768d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ae6ce0ee2567b1 server_cookie=455621721e044eac in_seq=0 out_seq=0 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f3ffffff640 1 -- 172.21.15.39:0/1709201324 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eea34620f0 con 0x55eea3507700 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f3ffffff640 10 client.25108 handle_command_reply: tid=0 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 client.25108 shutdown 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 msgr2=0x55eea3500e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4014010be0 tx=0x7f4014010c10 comp rx=0 tx=0).stop 2024-09-10T21:55:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 shutdown_connections 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eea3507700 0x55eea35768d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eea34f7bd0 0x55eea35020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f3ffffff640 0 client.25108 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eea34f5190 0x55eea3501500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 --2- 172.21.15.39:0/1709201324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eea34f2860 0x55eea3500e60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 >> 172.21.15.39:0/1709201324 conn(0x55eea34ed9b0 msgr2=0x55eea34f1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 shutdown_connections 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 1 -- 172.21.15.39:0/1709201324 wait complete. 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.335+0000 7f4029c2e740 20 client.25108 trim_cache size 0 max 16384 2024-09-10T21:55:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:55:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:55:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:55:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:55:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 msgr2=0x7f40100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 0x7f40100b78b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4014005fd0 tx=0x7f401400b4a0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 msgr2=0x7f4020075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020075540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f400c02a860 tx=0x7f400c030df0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 shutdown_connections 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40100b53f0 0x7f40100b78b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4020104490 0x7f4020075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4020103ad0 0x7f4020075540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 --2- 172.21.15.39:0/1650097454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4020102980 0x7f4020076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 >> 172.21.15.39:0/1650097454 conn(0x7f40200fe240 msgr2=0x7f4020106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 shutdown_connections 2024-09-10T21:55:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:19.336+0000 7f4026e60640 1 -- 172.21.15.39:0/1650097454 wait complete. 2024-09-10T21:55:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:19 smithi070 ceph-mon[34909]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T21:55:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:19 smithi039 ceph-mon[30872]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T21:55:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:19 smithi173 ceph-mon[35294]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-10T21:55:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:21 smithi039 ceph-mon[30872]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-10T21:55:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:21 smithi173 ceph-mon[35294]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-10T21:55:21.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:21 smithi070 ceph-mon[34909]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-10T21:55:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:23 smithi039 ceph-mon[30872]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:55:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:23 smithi173 ceph-mon[35294]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:55:23.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:23 smithi070 ceph-mon[34909]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:55:24.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:24 smithi173 ceph-mon[35294]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-10T21:55:24.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:24 smithi070 ceph-mon[34909]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-10T21:55:24.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:24 smithi039 ceph-mon[30872]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-10T21:55:25.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:55:26.152 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.620+0000 7f203af24640 1 -- 172.21.15.39:0/3273387518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20341045c0 msgr2=0x7f203410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.620+0000 7f203af24640 1 --2- 172.21.15.39:0/3273387518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20341045c0 0x7f203410cab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2020009900 tx=0x7f202002a410 comp rx=0 tx=0).stop 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 -- 172.21.15.39:0/3273387518 shutdown_connections 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 --2- 172.21.15.39:0/3273387518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f203410d100 0x7f203410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 --2- 172.21.15.39:0/3273387518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20341045c0 0x7f203410cab0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 --2- 172.21.15.39:0/3273387518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2034103ca0 0x7f2034104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 -- 172.21.15.39:0/3273387518 >> 172.21.15.39:0/3273387518 conn(0x7f20340fd700 msgr2=0x7f20340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 -- 172.21.15.39:0/3273387518 shutdown_connections 2024-09-10T21:55:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.621+0000 7f203af24640 1 -- 172.21.15.39:0/3273387518 wait complete. 2024-09-10T21:55:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.623+0000 7f203af24640 1 Processor -- start 2024-09-10T21:55:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.623+0000 7f203af24640 1 -- start start 2024-09-10T21:55:26.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.623+0000 7f203af24640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f203af24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20341045c0 0x7f20341997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58778/0 (socket says 172.21.15.39:58778) 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f2038cc0640 1 -- 172.21.15.39:0/3049558957 learned_addr learned my addr 172.21.15.39:0/3049558957 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 0x7f203419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2034112d70 con 0x7f2034103ca0 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2034112bf0 con 0x7f203410d100 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f2033fff640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20341045c0 0x7f20341997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2034112ef0 con 0x7f20341045c0 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.624+0000 7f20394c1640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 0x7f203419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 -- 172.21.15.39:0/3049558957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20341045c0 msgr2=0x7f20341997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20341045c0 0x7f20341997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 -- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 msgr2=0x7f203419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 0x7f203419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203419f350 con 0x7f2034103ca0 2024-09-10T21:55:26.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f20394c1640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 0x7f203419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:26.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2038cc0640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2028009c20 tx=0x7f202800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2031ffb640 1 -- 172.21.15.39:0/3049558957 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202801e070 con 0x7f2034103ca0 2024-09-10T21:55:26.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f2031ffb640 1 -- 172.21.15.39:0/3049558957 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20280198c0 con 0x7f2034103ca0 2024-09-10T21:55:26.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.625+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203419f640 con 0x7f2034103ca0 2024-09-10T21:55:26.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.626+0000 7f2031ffb640 1 -- 172.21.15.39:0/3049558957 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280187d0 con 0x7f2034103ca0 2024-09-10T21:55:26.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.626+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2034101a00 con 0x7f2034103ca0 2024-09-10T21:55:26.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.629+0000 7f2031ffb640 1 -- 172.21.15.39:0/3049558957 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f2028019410 con 0x7f2034103ca0 2024-09-10T21:55:26.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.630+0000 7f2031ffb640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 0x7f20240b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.630+0000 7f2033fff640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 0x7f20240b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.630+0000 7f203d2f9740 1 Processor -- start 2024-09-10T21:55:26.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 -- start start 2024-09-10T21:55:26.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f2031ffb640 1 -- 172.21.15.39:0/3049558957 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f20280e9810 con 0x7f2034103ca0 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f2033fff640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 0x7f20240b78b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2020000c00 tx=0x7f2020031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3dfda0 0x55c36f3eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f3ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c36f355e50 con 0x55c36f3df480 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c36f345280 con 0x55c36f3ebd30 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f203d2f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c36f349090 con 0x55c36f3dfda0 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58790/0 (socket says 172.21.15.39:58790) 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.631+0000 7f2038cc0640 1 -- 172.21.15.39:0/2797868435 learned_addr learned my addr 172.21.15.39:0/2797868435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 -- 172.21.15.39:0/2797868435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3dfda0 msgr2=0x55c36f3eb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3dfda0 0x55c36f3eb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 -- 172.21.15.39:0/2797868435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 msgr2=0x55c36f3ee120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:55:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f3ee120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 -- 172.21.15.39:0/2797868435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36f0a3650 con 0x55c36f3df480 2024-09-10T21:55:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20280109a0 tx=0x7f20280ac6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd7808bbb139141 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f201effd640 1 -- 172.21.15.39:0/2797868435 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b9410 con 0x55c36f3df480 2024-09-10T21:55:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.632+0000 7f201effd640 1 -- 172.21.15.39:0/2797868435 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2028019a70 con 0x55c36f3df480 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.633+0000 7f203d2f9740 1 -- 172.21.15.39:0/2797868435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 msgr2=0x55c36f3df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.633+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20280109a0 tx=0x7f20280ac6b0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 -- 172.21.15.39:0/2797868435 shutdown_connections 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f3ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3dfda0 0x55c36f3eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2797868435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3df480 0x55c36f3df860 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 -- 172.21.15.39:0/2797868435 >> 172.21.15.39:0/2797868435 conn(0x55c36f3dd2b0 msgr2=0x55c36f3de450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 -- 172.21.15.39:0/2797868435 shutdown_connections 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 -- 172.21.15.39:0/2797868435 wait complete. 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.634+0000 7f203d2f9740 1 -- start start 2024-09-10T21:55:26.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 Processor -- start 2024-09-10T21:55:26.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3dfda0 0x55c36f3e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 0x55c36f3e9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c36f1a6700 con 0x55c36f3ebd30 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c36f2e0110 con 0x55c36f3dfda0 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c36f3ee9f0 con 0x55c36f3df480 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.635+0000 7f203d2f9740 10 client.0 _ll_register_callbacks cb 0x55c36f2f9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41262/0 (socket says 172.21.15.39:41262) 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 -- 172.21.15.39:0/2208233142 learned_addr learned my addr 172.21.15.39:0/2208233142 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f20394c1640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 0x55c36f3e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2033fff640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3dfda0 0x55c36f3e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 -- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3dfda0 msgr2=0x55c36f3e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3dfda0 0x55c36f3e8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 -- 172.21.15.39:0/2208233142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 msgr2=0x55c36f3e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 0x55c36f3e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 -- 172.21.15.39:0/2208233142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36f30dc40 con 0x55c36f3df480 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f20394c1640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 0x55c36f3e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2028000c00 tx=0x7f202800bd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d4062b30738775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.636+0000 7f2013fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b9410 con 0x55c36f3df480 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f202809b220 con 0x55c36f3df480 2024-09-10T21:55:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2028019a70 con 0x55c36f3df480 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20280abae0 con 0x55c36f3df480 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 10 client.25117 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c36f402bc0 con 0x55c36f3df480 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2028019a70 con 0x55c36f3df480 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f20280b7ce0 con 0x55c36f3df480 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 10 client.25117 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 10 client.25117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 20 client.25117 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f404070 0x55c36f406490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 4 client.25117 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.637+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c36f357da0 con 0x55c36f404070 2024-09-10T21:55:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.638+0000 7f2033fff640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f404070 0x55c36f406490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.638+0000 7f2033fff640 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f404070 0x55c36f406490 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e98126089931de server_cookie=2cc633065d68065 in_seq=0 out_seq=0 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.638+0000 7f2013fff640 10 client.25117 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.639+0000 7f2013fff640 1 -- 172.21.15.39:0/2208233142 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c36f357da0 con 0x55c36f404070 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.639+0000 7f2013fff640 10 client.25117 handle_command_reply: tid=0 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.639+0000 7f203d2f9740 1 client.25117 shutdown 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 msgr2=0x55c36f3eb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2028000c00 tx=0x7f202800bd40 comp rx=0 tx=0).stop 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 shutdown_connections 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f404070 0x55c36f406490 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3ebd30 0x55c36f3e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3dfda0 0x55c36f3e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2208233142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3eb660 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 >> 172.21.15.39:0/2208233142 conn(0x55c36f3dd2b0 msgr2=0x55c36f3e2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f2013fff640 0 client.25117 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 shutdown_connections 2024-09-10T21:55:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 1 -- 172.21.15.39:0/2208233142 wait complete. 2024-09-10T21:55:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.640+0000 7f203d2f9740 20 client.25117 trim_cache size 0 max 16384 2024-09-10T21:55:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 Processor -- start 2024-09-10T21:55:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 -- start start 2024-09-10T21:55:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f3ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3ebd30 0x55c36f3ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20341ac1f0 con 0x55c36f3dfda0 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f203d2f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20341add30 con 0x55c36f3df480 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.676+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:59766/0 (socket says 172.21.15.39:59766) 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 -- 172.21.15.39:0/2596369220 learned_addr learned my addr 172.21.15.39:0/2596369220 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f20394c1640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3ebd30 0x55c36f3ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20341ac8c0 con 0x55c36f3ebd30 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2033fff640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f3ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 -- 172.21.15.39:0/2596369220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3ebd30 msgr2=0x55c36f3ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3ebd30 0x55c36f3ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 -- 172.21.15.39:0/2596369220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 msgr2=0x55c36f3ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f3ea7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 -- 172.21.15.39:0/2596369220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36f406af0 con 0x55c36f3df480 2024-09-10T21:55:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2033fff640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f3ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.677+0000 7f2038cc0640 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20280109a0 tx=0x7f20280e7630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d8d2eb729ef1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.678+0000 7f201e7fc640 1 -- 172.21.15.39:0/2596369220 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b9410 con 0x55c36f3df480 2024-09-10T21:55:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.678+0000 7f201e7fc640 1 -- 172.21.15.39:0/2596369220 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202809b070 con 0x55c36f3df480 2024-09-10T21:55:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.678+0000 7f201e7fc640 1 -- 172.21.15.39:0/2596369220 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280aec00 con 0x55c36f3df480 2024-09-10T21:55:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 msgr2=0x55c36f3dcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20280109a0 tx=0x7f20280e7630 comp rx=0 tx=0).stop 2024-09-10T21:55:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 shutdown_connections 2024-09-10T21:55:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3ebd30 0x55c36f3ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f3ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 --2- 172.21.15.39:0/2596369220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3df480 0x55c36f3dcbc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 >> 172.21.15.39:0/2596369220 conn(0x55c36f3dd2b0 msgr2=0x55c36f3ea0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 shutdown_connections 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.679+0000 7f203d2f9740 1 -- 172.21.15.39:0/2596369220 wait complete. 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.680+0000 7f203d2f9740 1 -- start start 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.680+0000 7f203d2f9740 1 Processor -- start 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f40bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f40c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20341ad660 con 0x55c36f3dfda0 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20341acf90 con 0x55c36f3ebd30 2024-09-10T21:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f2038cc0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41272/0 (socket says 172.21.15.39:41272) 2024-09-10T21:55:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f2038cc0640 1 -- 172.21.15.39:0/3610536932 learned_addr learned my addr 172.21.15.39:0/3610536932 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20341aa1f0 con 0x55c36f3df480 2024-09-10T21:55:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.681+0000 7f20394c1640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f40c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f2033fff640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f40bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f203d2f9740 10 client.0 _ll_register_callbacks cb 0x7f20280af910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 -- 172.21.15.39:0/3610536932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 msgr2=0x55c36f3fceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3fceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 -- 172.21.15.39:0/3610536932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 msgr2=0x55c36f40bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f40bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 -- 172.21.15.39:0/3610536932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36f3fbb10 con 0x55c36f3ebd30 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f2033fff640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f40bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f20394c1640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f40c2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f202c011c90 tx=0x7f202c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd3f2d3ca8919b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.682+0000 7f2013fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c020060 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f202c01b5f0 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202809b070 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f202c01b7f0 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f203d2f9740 10 client.25091 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.683+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c36f4711f0 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f202c01be40 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f202c01a070 con 0x55c36f3ebd30 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 10 client.25091 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 10 client.25091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 20 client.25091 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f471980 0x55c36f473da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 4 client.25091 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:55:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f202809b070 con 0x55c36f471980 2024-09-10T21:55:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.684+0000 7f2038cc0640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f471980 0x55c36f473da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.685+0000 7f2013fff640 10 client.25091 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.685+0000 7f2038cc0640 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f471980 0x55c36f473da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde4117b98e35869 server_cookie=8bad7879a4cd5a70 in_seq=0 out_seq=0 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f2013fff640 1 -- 172.21.15.39:0/3610536932 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f202809b070 con 0x55c36f471980 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f2013fff640 10 client.25091 handle_command_reply: tid=0 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 client.25091 shutdown 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 msgr2=0x55c36f40c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f40c2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f202c011c90 tx=0x7f202c010800 comp rx=0 tx=0).stop 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 shutdown_connections 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c36f471980 0x55c36f473da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f2013fff640 0 client.25091 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c36f3ebd30 0x55c36f40c2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c36f3dfda0 0x55c36f40bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 --2- 172.21.15.39:0/3610536932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c36f3df480 0x55c36f3fceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 >> 172.21.15.39:0/3610536932 conn(0x55c36f3dd2b0 msgr2=0x55c36f3ea900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 shutdown_connections 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 1 -- 172.21.15.39:0/3610536932 wait complete. 2024-09-10T21:55:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.686+0000 7f203d2f9740 20 client.25091 trim_cache size 0 max 16384 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:55:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 msgr2=0x7f20240b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 0x7f20240b78b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2020000c00 tx=0x7f2020031400 comp rx=0 tx=0).stop 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 msgr2=0x7f20341992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2028009c20 tx=0x7f202800b690 comp rx=0 tx=0).stop 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 shutdown_connections 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f20240b53f0 0x7f20240b78b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f203410d100 0x7f203419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20341045c0 0x7f20341997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 --2- 172.21.15.39:0/3049558957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2034103ca0 0x7f20341992a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.687+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 >> 172.21.15.39:0/3049558957 conn(0x7f20340fd700 msgr2=0x7f20340fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.688+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 shutdown_connections 2024-09-10T21:55:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:26.688+0000 7f203af24640 1 -- 172.21.15.39:0/3049558957 wait complete. 2024-09-10T21:55:26.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:26 smithi070 ceph-mon[34909]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:26.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:26 smithi039 ceph-mon[30872]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:26 smithi173 ceph-mon[35294]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:27.504 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:55:27.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:55:27.783 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:28.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 -- 172.21.15.39:0/1507415765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 msgr2=0x7ff350108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 --2- 172.21.15.39:0/1507415765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff350108c30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff338009900 tx=0x7ff33802a410 comp rx=0 tx=0).stop 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 -- 172.21.15.39:0/1507415765 shutdown_connections 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 --2- 172.21.15.39:0/1507415765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350109170 0x7ff35010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 --2- 172.21.15.39:0/1507415765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff350108c30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 --2- 172.21.15.39:0/1507415765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350102de0 0x7ff3501031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 -- 172.21.15.39:0/1507415765 >> 172.21.15.39:0/1507415765 conn(0x7ff3500fe830 msgr2=0x7ff350100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 -- 172.21.15.39:0/1507415765 shutdown_connections 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.269+0000 7ff3557a7640 1 -- 172.21.15.39:0/1507415765 wait complete. 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.270+0000 7ff3557a7640 1 Processor -- start 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.270+0000 7ff3557a7640 1 -- start start 2024-09-10T21:55:28.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 0x7ff350199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350109170 0x7ff35019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff350112e40 con 0x7ff3501087f0 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff350112cc0 con 0x7ff350109170 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff3557a7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff350112fc0 con 0x7ff350102de0 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff347fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 0x7ff350199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff347fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58838/0 (socket says 172.21.15.39:58838) 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff347fff640 1 -- 172.21.15.39:0/327061709 learned_addr learned my addr 172.21.15.39:0/327061709 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34f7fe640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350109170 0x7ff35019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 -- 172.21.15.39:0/327061709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350109170 msgr2=0x7ff35019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:28.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350109170 0x7ff35019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 -- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 msgr2=0x7ff3501997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff34effd640 1 -- 172.21.15.39:0/327061709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35019f340 con 0x7ff350102de0 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.271+0000 7ff347fff640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff34effd640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 0x7ff350199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3400099c0 tx=0x7ff340009e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400078c0 con 0x7ff350102de0 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35019f630 con 0x7ff350102de0 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff350075550 con 0x7ff350102de0 2024-09-10T21:55:28.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff340005020 con 0x7ff350102de0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.272+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340004cd0 con 0x7ff350102de0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.273+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3300052c0 con 0x7ff350102de0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.275+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7ff340007a60 con 0x7ff350102de0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.276+0000 7ff34cff9640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 0x7ff33c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.276+0000 7ff347fff640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 0x7ff33c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.277+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff3400e8fc0 con 0x7ff350102de0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.277+0000 7ff347fff640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 0x7ff33c0b7830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff350102080 tx=0x7ff338005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.280+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3400af6e0 con 0x7ff350102de0 2024-09-10T21:55:28.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.598+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff330005880 con 0x7ff350102de0 2024-09-10T21:55:28.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.599+0000 7ff34cff9640 1 -- 172.21.15.39:0/327061709 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7ff3400c8ee0 con 0x7ff350102de0 2024-09-10T21:55:28.601 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:55:28.601 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-10T21:54:45:540351+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:54:45.490131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24550,24563,24562,24583,24590]},"id":1}]} 2024-09-10T21:55:28.601 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 msgr2=0x7ff33c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 0x7ff33c0b7830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff350102080 tx=0x7ff338005a20 comp rx=0 tx=0).stop 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 msgr2=0x7ff350199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 0x7ff350199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3400099c0 tx=0x7ff340009e80 comp rx=0 tx=0).stop 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 shutdown_connections 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff33c0b5370 0x7ff33c0b7830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff350109170 0x7ff35019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3501087f0 0x7ff3501997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 --2- 172.21.15.39:0/327061709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff350102de0 0x7ff350199290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:28.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.602+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 >> 172.21.15.39:0/327061709 conn(0x7ff3500fe830 msgr2=0x7ff350100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:28.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.603+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 shutdown_connections 2024-09-10T21:55:28.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:28.603+0000 7ff3557a7640 1 -- 172.21.15.39:0/327061709 wait complete. 2024-09-10T21:55:28.908 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:28 smithi070 ceph-mon[34909]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:28 smithi039 ceph-mon[30872]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:28 smithi173 ceph-mon[35294]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:29.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:55:29.505 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:29.815 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:29 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/327061709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:55:29.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:29 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/327061709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:55:29.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:29 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/327061709' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:55:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 -- 172.21.15.39:0/1875175138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc102dc0 msgr2=0x7f26dc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 --2- 172.21.15.39:0/1875175138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc102dc0 0x7f26dc1031a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009900 tx=0x7f26d802a3f0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 -- 172.21.15.39:0/1875175138 shutdown_connections 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 --2- 172.21.15.39:0/1875175138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 --2- 172.21.15.39:0/1875175138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc1087d0 0x7f26dc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 --2- 172.21.15.39:0/1875175138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc102dc0 0x7f26dc1031a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.053+0000 7f26e37fd640 1 -- 172.21.15.39:0/1875175138 >> 172.21.15.39:0/1875175138 conn(0x7f26dc0fe830 msgr2=0x7f26dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.054+0000 7f26e37fd640 1 -- 172.21.15.39:0/1875175138 shutdown_connections 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.054+0000 7f26e37fd640 1 -- 172.21.15.39:0/1875175138 wait complete. 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 Processor -- start 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 -- start start 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc102dc0 0x7f26dc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 0x7f26dc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc112dd0 con 0x7f26dc1087d0 2024-09-10T21:55:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc112c50 con 0x7f26dc109150 2024-09-10T21:55:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e37fd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc112f50 con 0x7f26dc102dc0 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 0x7f26dc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.055+0000 7f26e1599640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc102dc0 0x7f26dc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:54484/0 (socket says 172.21.15.39:54484) 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 -- 172.21.15.39:0/67363646 learned_addr learned my addr 172.21.15.39:0/67363646 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 0x7f26dc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50986/0 (socket says 172.21.15.39:50986) 2024-09-10T21:55:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 -- 172.21.15.39:0/67363646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc102dc0 msgr2=0x7f26dc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc102dc0 0x7f26dc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 -- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 msgr2=0x7f26dc1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 0x7f26dc1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 -- 172.21.15.39:0/67363646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc19f330 con 0x7f26dc109150 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26e1d9a640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26d400eb10 tx=0x7f26d400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26d27fc640 1 -- 172.21.15.39:0/67363646 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4004b20 con 0x7f26dc109150 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.056+0000 7f26d27fc640 1 -- 172.21.15.39:0/67363646 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d4004cc0 con 0x7f26dc109150 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.057+0000 7f26d27fc640 1 -- 172.21.15.39:0/67363646 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4010670 con 0x7f26dc109150 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.057+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc19f620 con 0x7f26dc109150 2024-09-10T21:55:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.057+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc1a5ce0 con 0x7f26dc109150 2024-09-10T21:55:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26d27fc640 1 -- 172.21.15.39:0/67363646 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f26d4005020 con 0x7f26dc109150 2024-09-10T21:55:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 Processor -- start 2024-09-10T21:55:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 -- start start 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada569c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56aad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ada5612ea0 con 0x55ada569ca10 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ada56022d0 con 0x55ada56a89a0 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.060+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ada56060e0 con 0x55ada569c0f0 2024-09-10T21:55:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26d27fc640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 0x7f26c80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26d27fc640 1 -- 172.21.15.39:0/67363646 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26d40e62f0 con 0x7f26dc109150 2024-09-10T21:55:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1d9a640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 0x7f26c80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50988/0 (socket says 172.21.15.39:50988) 2024-09-10T21:55:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 -- 172.21.15.39:0/1657074304 learned_addr learned my addr 172.21.15.39:0/1657074304 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e0d98640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e0d98640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada569c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 -- 172.21.15.39:0/1657074304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 msgr2=0x55ada569c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada569c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1d9a640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 0x7f26c80b78b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f26d40a9b70 tx=0x7f26d4097f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 -- 172.21.15.39:0/1657074304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 msgr2=0x55ada56aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e1599640 1 -- 172.21.15.39:0/1657074304 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada5360650 con 0x55ada569ca10 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.061+0000 7f26e0d98640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.062+0000 7f26e1599640 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009900 tx=0x7f26d8032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f108d9ad3488aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.062+0000 7f26c77fe640 1 -- 172.21.15.39:0/1657074304 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8040070 con 0x55ada569ca10 2024-09-10T21:55:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.062+0000 7f26c77fe640 1 -- 172.21.15.39:0/1657074304 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d8004030 con 0x55ada569ca10 2024-09-10T21:55:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.062+0000 7f26c77fe640 1 -- 172.21.15.39:0/1657074304 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8035040 con 0x55ada569ca10 2024-09-10T21:55:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 -- 172.21.15.39:0/1657074304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 msgr2=0x55ada56a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009900 tx=0x7f26d8032b20 comp rx=0 tx=0).stop 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 -- 172.21.15.39:0/1657074304 shutdown_connections 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a8460 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/1657074304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada569c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.063+0000 7f26e5bd2740 1 -- 172.21.15.39:0/1657074304 >> 172.21.15.39:0/1657074304 conn(0x55ada5699f20 msgr2=0x55ada569b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.064+0000 7f26e5bd2740 1 -- 172.21.15.39:0/1657074304 shutdown_connections 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.064+0000 7f26e5bd2740 1 -- 172.21.15.39:0/1657074304 wait complete. 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.064+0000 7f26e5bd2740 1 -- start start 2024-09-10T21:55:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.064+0000 7f26e5bd2740 1 Processor -- start 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.065+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada56a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.065+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e1599640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e1599640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51000/0 (socket says 172.21.15.39:51000) 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada56a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada56a8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41440/0 (socket says 172.21.15.39:41440) 2024-09-10T21:55:30.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e1599640 1 -- 172.21.15.39:0/136090110 learned_addr learned my addr 172.21.15.39:0/136090110 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ada5463700 con 0x55ada569ca10 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ada559d160 con 0x55ada56a89a0 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ada56ab5c0 con 0x55ada569c0f0 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.066+0000 7f26e5bd2740 10 client.0 _ll_register_callbacks cb 0x55ada55b69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e0d98640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 -- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 msgr2=0x55ada56a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada56a8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 -- 172.21.15.39:0/136090110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 msgr2=0x55ada56a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada55cac90 con 0x55ada569ca10 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26e1599640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009650 tx=0x7f26d8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b62ba9a900a408 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.067+0000 7f26c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8040070 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26d8005430 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26d8004030 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26d8035040 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26e5bd2740 10 client.15492 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ada56b6ec0 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.068+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d8004030 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f26d8004cf0 con 0x55ada569ca10 2024-09-10T21:55:30.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 10 client.15492 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 10 client.15492 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 20 client.15492 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada56b8210 0x55ada56ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 4 client.15492 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ada5614df0 con 0x55ada56b8210 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.069+0000 7f26e0d98640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada56b8210 0x55ada56ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.070+0000 7f26c4ff9640 10 client.15492 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:55:30.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.070+0000 7f26e0d98640 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada56b8210 0x55ada56ba600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c5e13bdd74c101fe server_cookie=a9083ec894857a08 in_seq=0 out_seq=0 2024-09-10T21:55:30.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26c4ff9640 1 -- 172.21.15.39:0/136090110 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ada5614df0 con 0x55ada56b8210 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26c4ff9640 10 client.15492 handle_command_reply: tid=0 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 client.15492 shutdown 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 msgr2=0x55ada56a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009650 tx=0x7f26d8031400 comp rx=0 tx=0).stop 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 shutdown_connections 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada56b8210 0x55ada56ba600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26c4ff9640 0 client.15492 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569ca10 0x55ada56a5780 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/136090110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada569c0f0 0x55ada56a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.071+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 >> 172.21.15.39:0/136090110 conn(0x55ada5699f20 msgr2=0x55ada569fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.072+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 shutdown_connections 2024-09-10T21:55:30.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.072+0000 7f26e5bd2740 1 -- 172.21.15.39:0/136090110 wait complete. 2024-09-10T21:55:30.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.072+0000 7f26e5bd2740 20 client.15492 trim_cache size 0 max 16384 2024-09-10T21:55:30.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 Processor -- start 2024-09-10T21:55:30.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 -- start start 2024-09-10T21:55:30.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada569c0f0 0x55ada5699760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 0x55ada56a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1ac100 con 0x55ada56b8210 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1adc40 con 0x55ada569c0f0 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.098+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1ac7d0 con 0x55ada56a89a0 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51010/0 (socket says 172.21.15.39:51010) 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 -- 172.21.15.39:0/3752115219 learned_addr learned my addr 172.21.15.39:0/3752115219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:30.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada569c0f0 0x55ada5699760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 -- 172.21.15.39:0/3752115219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 msgr2=0x55ada56a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e1599640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 0x55ada56a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 0x55ada56a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 -- 172.21.15.39:0/3752115219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada569c0f0 msgr2=0x55ada5699760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada569c0f0 0x55ada5699760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 -- 172.21.15.39:0/3752115219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada56a61c0 con 0x55ada56b8210 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e1599640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 0x55ada56a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f26cc01a7f0 tx=0x7f26cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9887d3db9981c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.099+0000 7f26c6ffd640 1 -- 172.21.15.39:0/3752115219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc011940 con 0x55ada56b8210 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.100+0000 7f26c6ffd640 1 -- 172.21.15.39:0/3752115219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26cc02a070 con 0x55ada56b8210 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.100+0000 7f26c6ffd640 1 -- 172.21.15.39:0/3752115219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc02ed90 con 0x55ada56b8210 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3752115219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 msgr2=0x55ada56aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f26cc01a7f0 tx=0x7f26cc004730 comp rx=0 tx=0).stop 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3752115219 shutdown_connections 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada56b8210 0x55ada56aa2d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56a89a0 0x55ada56a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3752115219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada569c0f0 0x55ada5699760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3752115219 >> 172.21.15.39:0/3752115219 conn(0x55ada5699f20 msgr2=0x55ada56a09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3752115219 shutdown_connections 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3752115219 wait complete. 2024-09-10T21:55:30.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 -- start start 2024-09-10T21:55:30.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.101+0000 7f26e5bd2740 1 Processor -- start 2024-09-10T21:55:30.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56b8210 0x55ada56a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1ad570 con 0x55ada569c0f0 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1acea0 con 0x55ada56a89a0 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1aa0e0 con 0x55ada56b8210 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e5bd2740 10 client.0 _ll_register_callbacks cb 0x7f26cc0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e0d98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51024/0 (socket says 172.21.15.39:51024) 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.102+0000 7f26e0d98640 1 -- 172.21.15.39:0/3042229300 learned_addr learned my addr 172.21.15.39:0/3042229300 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 -- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56b8210 msgr2=0x55ada56a19a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56b8210 0x55ada56a19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 -- 172.21.15.39:0/3042229300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 msgr2=0x55ada56b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e1599640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 -- 172.21.15.39:0/3042229300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada56a1ee0 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26e0d98640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009d90 tx=0x7f26cc01a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b502a8ccaf27f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.103+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc02ead0 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26cc02ec70 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26cc02a070 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26cc004030 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 10 client.15498 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ada56a30f0 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26cc02a070 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f26cc027050 con 0x55ada569c0f0 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 10 client.15498 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 20 client.15498 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:30.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.104+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada5725db0 0x55ada57281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:30.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26e5bd2740 4 client.15498 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:55:30.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ada56108a0 con 0x55ada5725db0 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26e1599640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada5725db0 0x55ada57281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26e1599640 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada5725db0 0x55ada57281a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28d614e15a91d939 server_cookie=a616de793676f188 in_seq=0 out_seq=0 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26c4ff9640 10 client.15498 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26c4ff9640 1 -- 172.21.15.39:0/3042229300 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ada56108a0 con 0x55ada5725db0 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.105+0000 7f26c4ff9640 10 client.15498 handle_command_reply: tid=0 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 client.15498 shutdown 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 msgr2=0x55ada56b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009d90 tx=0x7f26cc01a560 comp rx=0 tx=0).stop 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 shutdown_connections 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55ada5725db0 0x55ada57281a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada56b8210 0x55ada56a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ada56a89a0 0x55ada56b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26c4ff9640 0 client.15498 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 --2- 172.21.15.39:0/3042229300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ada569c0f0 0x55ada56b0850 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 >> 172.21.15.39:0/3042229300 conn(0x55ada5699f20 msgr2=0x55ada56a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 shutdown_connections 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 1 -- 172.21.15.39:0/3042229300 wait complete. 2024-09-10T21:55:30.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.106+0000 7f26e5bd2740 20 client.15498 trim_cache size 0 max 16384 2024-09-10T21:55:30.112 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:55:30.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 msgr2=0x7f26c80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 0x7f26c80b78b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f26d40a9b70 tx=0x7f26d4097f90 comp rx=0 tx=0).stop 2024-09-10T21:55:30.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 msgr2=0x7f26dc19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26d400eb10 tx=0x7f26d400c2d0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 shutdown_connections 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26c80b53f0 0x7f26c80b78b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc109150 0x7f26dc19eb60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26dc1087d0 0x7f26dc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 --2- 172.21.15.39:0/67363646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26dc102dc0 0x7f26dc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.107+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 >> 172.21.15.39:0/67363646 conn(0x7f26dc0fe830 msgr2=0x7f26dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.108+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 shutdown_connections 2024-09-10T21:55:30.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:30.108+0000 7f26e37fd640 1 -- 172.21.15.39:0/67363646 wait complete. 2024-09-10T21:55:30.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:55:30.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:30 smithi070 ceph-mon[34909]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:30.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:30 smithi039 ceph-mon[30872]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:30.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:30 smithi173 ceph-mon[35294]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:55:31.133 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.737+0000 7f7ac807c640 1 -- 172.21.15.39:0/3974780500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0108020 msgr2=0x7f7ac010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.737+0000 7f7ac807c640 1 --2- 172.21.15.39:0/3974780500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0108020 0x7f7ac010e820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ca0 tx=0x7f7ab802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 -- 172.21.15.39:0/3974780500 shutdown_connections 2024-09-10T21:55:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 --2- 172.21.15.39:0/3974780500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0108020 0x7f7ac010e820 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 --2- 172.21.15.39:0/3974780500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 --2- 172.21.15.39:0/3974780500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0101c90 0x7f7ac0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 -- 172.21.15.39:0/3974780500 >> 172.21.15.39:0/3974780500 conn(0x7f7ac00fd700 msgr2=0x7f7ac00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 -- 172.21.15.39:0/3974780500 shutdown_connections 2024-09-10T21:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.738+0000 7f7ac807c640 1 -- 172.21.15.39:0/3974780500 wait complete. 2024-09-10T21:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.739+0000 7f7ac807c640 1 Processor -- start 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.739+0000 7f7ac807c640 1 -- start start 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.739+0000 7f7ac807c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.739+0000 7f7ac807c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac807c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0108020 0x7f7ac019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac807c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0110c20 con 0x7f7ac0101c90 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac807c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0110aa0 con 0x7f7ac0108020 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5e18640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac807c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0110da0 con 0x7f7ac01076a0 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5e18640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51040/0 (socket says 172.21.15.39:51040) 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5e18640 1 -- 172.21.15.39:0/1720095848 learned_addr learned my addr 172.21.15.39:0/1720095848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:31.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac6619640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0108020 0x7f7ac019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 -- 172.21.15.39:0/1720095848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0108020 msgr2=0x7f7ac019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0108020 0x7f7ac019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 -- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 msgr2=0x7f7ac0197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.740+0000 7f7ac5617640 1 -- 172.21.15.39:0/1720095848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac019d0c0 con 0x7f7ac01076a0 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0197550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a870 tx=0x7f7ab000ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ab6ffd640 1 -- 172.21.15.39:0/1720095848 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00079b0 con 0x7f7ac01076a0 2024-09-10T21:55:31.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ab6ffd640 1 -- 172.21.15.39:0/1720095848 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab0005020 con 0x7f7ac01076a0 2024-09-10T21:55:31.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ab6ffd640 1 -- 172.21.15.39:0/1720095848 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0004cd0 con 0x7f7ac01076a0 2024-09-10T21:55:31.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac019d3b0 con 0x7f7ac01076a0 2024-09-10T21:55:31.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.741+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac01a3a70 con 0x7f7ac01076a0 2024-09-10T21:55:31.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.745+0000 7f7aca451740 1 Processor -- start 2024-09-10T21:55:31.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.745+0000 7f7aca451740 1 -- start start 2024-09-10T21:55:31.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.745+0000 7f7aca451740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.745+0000 7f7aca451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebcd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51042/0 (socket says 172.21.15.39:51042) 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7aca451740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7aca451740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c8aeb37ea0 con 0x55c8aebc10f0 2024-09-10T21:55:31.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7aca451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c8aeb272d0 con 0x55c8aebc1a10 2024-09-10T21:55:31.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7aca451740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8aeb2b0e0 con 0x55c8aebcd9a0 2024-09-10T21:55:31.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 -- 172.21.15.39:0/3980114582 learned_addr learned my addr 172.21.15.39:0/3980114582 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:31.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebcd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 -- 172.21.15.39:0/3980114582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 msgr2=0x55c8aebcfd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:31.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ab6ffd640 1 -- 172.21.15.39:0/1720095848 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f7ab0007b50 con 0x7f7ac01076a0 2024-09-10T21:55:31.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcfd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 -- 172.21.15.39:0/3980114582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 msgr2=0x55c8aebcd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebcd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.746+0000 7f7ac6619640 1 -- 172.21.15.39:0/3980114582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ae885650 con 0x55c8aebc10f0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.747+0000 7f7ac6619640 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ca0 tx=0x7f7ab80093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711890cdc33501cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.747+0000 7f7aabfff640 1 -- 172.21.15.39:0/3980114582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8031db0 con 0x55c8aebc10f0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.747+0000 7f7aabfff640 1 -- 172.21.15.39:0/3980114582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab8036070 con 0x55c8aebc10f0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.747+0000 7f7ab6ffd640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 0x7f7aac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7ab6ffd640 1 -- 172.21.15.39:0/1720095848 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7ab00e50c0 con 0x7f7ac01076a0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 0x7f7aac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 -- 172.21.15.39:0/3980114582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 msgr2=0x55c8aebc14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ca0 tx=0x7f7ab80093e0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 -- 172.21.15.39:0/3980114582 shutdown_connections 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebcd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 --2- 172.21.15.39:0/3980114582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebc14d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 0x7f7aac0b78b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55c8aebbfe00 tx=0x7f7abc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.748+0000 7f7aca451740 1 -- 172.21.15.39:0/3980114582 >> 172.21.15.39:0/3980114582 conn(0x55c8aebbef20 msgr2=0x55c8aebc00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.749+0000 7f7aca451740 1 -- 172.21.15.39:0/3980114582 shutdown_connections 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.749+0000 7f7aca451740 1 -- 172.21.15.39:0/3980114582 wait complete. 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.749+0000 7f7aca451740 1 -- start start 2024-09-10T21:55:31.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.749+0000 7f7aca451740 1 Processor -- start 2024-09-10T21:55:31.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebcd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c8ae988700 con 0x55c8aebc1a10 2024-09-10T21:55:31.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c8aeac2160 con 0x55c8aebc10f0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8aebd0660 con 0x55c8aebcd9a0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7ac5617640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7ac5617640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51052/0 (socket says 172.21.15.39:51052) 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7ac5617640 1 -- 172.21.15.39:0/1656096798 learned_addr learned my addr 172.21.15.39:0/1656096798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7aca451740 10 client.0 _ll_register_callbacks cb 0x55c8aeadb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.750+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebcd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac6619640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 -- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 msgr2=0x55c8aebcabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 -- 172.21.15.39:0/1656096798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 msgr2=0x55c8aebcd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebcd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 -- 172.21.15.39:0/1656096798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8aeaefc90 con 0x55c8aebc1a10 2024-09-10T21:55:31.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7ac5617640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ab770 tx=0x7f7ab00e2f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e042d43105f62ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.751+0000 7f7aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00aac40 con 0x55c8aebc1a10 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7ab00a7130 con 0x55c8aebc1a10 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab8036070 con 0x55c8aebc1a10 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7ab00ab7e0 con 0x55c8aebc1a10 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aca451740 10 client.15510 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8aebdbfc0 con 0x55c8aebc1a10 2024-09-10T21:55:31.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.752+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab8036070 con 0x55c8aebc1a10 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7ab00b13a0 con 0x55c8aebc1a10 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 10 client.15510 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 10 client.15510 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 20 client.15510 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aebdd380 0x55c8aebdf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 4 client.15510 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.753+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8aeb39df0 con 0x55c8aebdd380 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.754+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aebdd380 0x55c8aebdf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.754+0000 7f7aa97fa640 10 client.15510 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.754+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aebdd380 0x55c8aebdf770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6cfcab684cc1bdbf server_cookie=f60c39dce1289f67 in_seq=0 out_seq=0 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aa97fa640 1 -- 172.21.15.39:0/1656096798 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8aeb39df0 con 0x55c8aebdd380 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aa97fa640 10 client.15510 handle_command_reply: tid=0 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 client.15510 shutdown 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 msgr2=0x55c8aebca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ab770 tx=0x7f7ab00e2f00 comp rx=0 tx=0).stop 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 shutdown_connections 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebca650 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.755+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aebdd380 0x55c8aebdf770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aca451740 1 --2- 172.21.15.39:0/1656096798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebcd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aa97fa640 0 client.15510 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 >> 172.21.15.39:0/1656096798 conn(0x55c8aebbef20 msgr2=0x55c8aebc4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 shutdown_connections 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aca451740 1 -- 172.21.15.39:0/1656096798 wait complete. 2024-09-10T21:55:31.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.756+0000 7f7aca451740 20 client.15510 trim_cache size 0 max 16384 2024-09-10T21:55:31.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.782+0000 7f7aca451740 1 Processor -- start 2024-09-10T21:55:31.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.782+0000 7f7aca451740 1 -- start start 2024-09-10T21:55:31.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebb9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51054/0 (socket says 172.21.15.39:51054) 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 -- 172.21.15.39:0/178025621 learned_addr learned my addr 172.21.15.39:0/178025621 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01ac0a0 con 0x55c8aebc10f0 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01adbe0 con 0x55c8aebc1a10 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01ac770 con 0x55c8aebcd9a0 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac6619640 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 -- 172.21.15.39:0/178025621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 msgr2=0x55c8aebcc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 -- 172.21.15.39:0/178025621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 msgr2=0x55c8aebb9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5617640 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebb9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebb9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.783+0000 7f7ac5e18640 1 -- 172.21.15.39:0/178025621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8aebbe760 con 0x55c8aebc10f0 2024-09-10T21:55:31.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.784+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00f760 tx=0x7f7abc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbe25317a028acd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.784+0000 7f7aab7fe640 1 -- 172.21.15.39:0/178025621 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc005020 con 0x55c8aebc10f0 2024-09-10T21:55:31.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.784+0000 7f7aab7fe640 1 -- 172.21.15.39:0/178025621 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7abc0047a0 con 0x55c8aebc10f0 2024-09-10T21:55:31.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.784+0000 7f7aab7fe640 1 -- 172.21.15.39:0/178025621 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc01c6e0 con 0x55c8aebc10f0 2024-09-10T21:55:31.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 msgr2=0x55c8aebd98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00f760 tx=0x7f7abc018000 comp rx=0 tx=0).stop 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 shutdown_connections 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebcc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc1a10 0x55c8aebb9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 --2- 172.21.15.39:0/178025621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc10f0 0x55c8aebd98e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 >> 172.21.15.39:0/178025621 conn(0x55c8aebbef20 msgr2=0x55c8aebcbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 shutdown_connections 2024-09-10T21:55:31.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.785+0000 7f7aca451740 1 -- 172.21.15.39:0/178025621 wait complete. 2024-09-10T21:55:31.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.786+0000 7f7aca451740 1 -- start start 2024-09-10T21:55:31.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.786+0000 7f7aca451740 1 Processor -- start 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebd5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebd09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01ad510 con 0x55c8aebc1a10 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7ac5617640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01ace40 con 0x55c8aebc10f0 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7ac5617640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51064/0 (socket says 172.21.15.39:51064) 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7aca451740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01aa080 con 0x55c8aebcd9a0 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7ac5e18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebd5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7ac5617640 1 -- 172.21.15.39:0/197895851 learned_addr learned my addr 172.21.15.39:0/197895851 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.787+0000 7f7ac6619640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebd09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 -- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 msgr2=0x55c8aebd09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebd09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 -- 172.21.15.39:0/197895851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 msgr2=0x55c8aebd61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 -- 172.21.15.39:0/197895851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8aebd11d0 con 0x55c8aebc10f0 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5617640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:31.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aca451740 10 client.0 _ll_register_callbacks cb 0x7f7ab00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:31.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7ac5e18640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebd5c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7abc005d00 tx=0x7f7abc0049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be820f099f4d477f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:31.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aa97fa640 10 client.25124 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:55:31.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7abc0047a0 con 0x55c8aebc10f0 2024-09-10T21:55:31.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aa97fa640 1 -- 172.21.15.39:0/197895851 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc020030 con 0x55c8aebc10f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aa97fa640 1 -- 172.21.15.39:0/197895851 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7abc004e90 con 0x55c8aebc10f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aa97fa640 1 -- 172.21.15.39:0/197895851 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7abc005090 con 0x55c8aebc10f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aca451740 10 client.25124 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.788+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c8aec4ac30 con 0x55c8aebc10f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aa97fa640 1 -- 172.21.15.39:0/197895851 <== mon.2 v2:172.21.15.70:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7abc005230 con 0x55c8aebc10f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 10 client.25124 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 10 client.25124 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 20 client.25124 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aec4b1f0 0x55c8aec4d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 4 client.25124 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.789+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7abc0047a0 con 0x55c8aec4b1f0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7ac5617640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aec4b1f0 0x55c8aec4d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7aa97fa640 10 client.25124 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:55:31.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7ac5617640 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aec4b1f0 0x55c8aec4d5e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=991c992ce4a8b69b server_cookie=5214fc237718678e in_seq=0 out_seq=0 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7aa97fa640 1 -- 172.21.15.39:0/197895851 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7abc0047a0 con 0x55c8aec4b1f0 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7aa97fa640 10 client.25124 handle_command_reply: tid=0 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.790+0000 7f7aca451740 1 client.25124 shutdown 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 msgr2=0x55c8aebd5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebd5c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7abc005d00 tx=0x7f7abc0049d0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 shutdown_connections 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8aebcd9a0 0x55c8aebd09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8aebc1a10 0x55c8aebd61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55c8aec4b1f0 0x55c8aec4d5e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aa97fa640 0 client.25124 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 --2- 172.21.15.39:0/197895851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8aebc10f0 0x55c8aebd5c50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 >> 172.21.15.39:0/197895851 conn(0x55c8aebbef20 msgr2=0x55c8aebcc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.791+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 shutdown_connections 2024-09-10T21:55:31.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.792+0000 7f7aca451740 1 -- 172.21.15.39:0/197895851 wait complete. 2024-09-10T21:55:31.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.792+0000 7f7aca451740 20 client.25124 trim_cache size 0 max 16384 2024-09-10T21:55:31.797 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.792+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 msgr2=0x7f7aac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.792+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 0x7f7aac0b78b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55c8aebbfe00 tx=0x7f7abc005f90 comp rx=0 tx=0).stop 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 msgr2=0x7f7ac0197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0197550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a870 tx=0x7f7ab000ad30 comp rx=0 tx=0).stop 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 shutdown_connections 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f7aac0b53f0 0x7f7aac0b78b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ac0108020 0x7f7ac019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac01076a0 0x7f7ac0197550 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 --2- 172.21.15.39:0/1720095848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ac0101c90 0x7f7ac0197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:31.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 >> 172.21.15.39:0/1720095848 conn(0x7f7ac00fd700 msgr2=0x7f7ac00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:31.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.793+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 shutdown_connections 2024-09-10T21:55:31.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:31.794+0000 7f7ac807c640 1 -- 172.21.15.39:0/1720095848 wait complete. 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 -- 172.21.15.39:0/1401259303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440103370 msgr2=0x7f1440109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1401259303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440103370 0x7f1440109cf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1438009cd0 tx=0x7f143802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 -- 172.21.15.39:0/1401259303 shutdown_connections 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1401259303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440103370 0x7f1440109cf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1401259303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f1440102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1401259303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440101860 0x7f1440101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 -- 172.21.15.39:0/1401259303 >> 172.21.15.39:0/1401259303 conn(0x7f14400fd140 msgr2=0x7f14400ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 -- 172.21.15.39:0/1401259303 shutdown_connections 2024-09-10T21:55:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.474+0000 7f1445c7f640 1 -- 172.21.15.39:0/1401259303 wait complete. 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.475+0000 7f1445c7f640 1 Processor -- start 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.475+0000 7f1445c7f640 1 -- start start 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.475+0000 7f1445c7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 0x7f144006b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.475+0000 7f1445c7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f144019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f1445c7f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 0x7f14401a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 0x7f144006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f1445c7f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f144010d4d0 con 0x7f1440101860 2024-09-10T21:55:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f143effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f144019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f143effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f144019da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:54588/0 (socket says 172.21.15.39:54588) 2024-09-10T21:55:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f143effd640 1 -- 172.21.15.39:0/1263731337 learned_addr learned my addr 172.21.15.39:0/1263731337 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f144010d350 con 0x7f14401029b0 2024-09-10T21:55:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f144010d650 con 0x7f1440103370 2024-09-10T21:55:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.476+0000 7f143ffff640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 0x7f14401a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 -- 172.21.15.39:0/1263731337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 msgr2=0x7f14401a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 0x7f14401a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 -- 172.21.15.39:0/1263731337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 msgr2=0x7f144019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f144019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 -- 172.21.15.39:0/1263731337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14401a08e0 con 0x7f1440101860 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143ffff640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 0x7f14401a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143f7fe640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 0x7f144006b180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f143000e9f0 tx=0x7f143000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.479+0000 7f143cff9640 1 -- 172.21.15.39:0/1263731337 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143000ccc0 con 0x7f1440101860 2024-09-10T21:55:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.480+0000 7f143cff9640 1 -- 172.21.15.39:0/1263731337 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1430005020 con 0x7f1440101860 2024-09-10T21:55:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.480+0000 7f143cff9640 1 -- 172.21.15.39:0/1263731337 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430004a00 con 0x7f1440101860 2024-09-10T21:55:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.480+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401a0bd0 con 0x7f1440101860 2024-09-10T21:55:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.482+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a1120 con 0x7f1440101860 2024-09-10T21:55:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 Processor -- start 2024-09-10T21:55:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 -- start start 2024-09-10T21:55:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec0bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557b2eb7f6f0 con 0x557b2ec1b470 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b2eb6eb20 con 0x557b2ec0b7d0 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.485+0000 7f1448a50740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557b2eb72930 con 0x557b2ec0c110 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51104/0 (socket says 172.21.15.39:51104) 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 -- 172.21.15.39:0/3186464456 learned_addr learned my addr 172.21.15.39:0/3186464456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143ffff640 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec0bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143cff9640 1 -- 172.21.15.39:0/1263731337 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f1430004ba0 con 0x7f1440101860 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 -- 172.21.15.39:0/3186464456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 msgr2=0x557b2ec1af30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 -- 172.21.15.39:0/3186464456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 msgr2=0x557b2ec0bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec0bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 -- 172.21.15.39:0/3186464456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2eb34530 con 0x557b2ec1b470 2024-09-10T21:55:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143ffff640 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec0bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.486+0000 7f143effd640 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f143400b7e0 tx=0x7f143400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b02012c5540aed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.487+0000 7f1425ffb640 1 -- 172.21.15.39:0/3186464456 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434003dd0 con 0x557b2ec1b470 2024-09-10T21:55:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.487+0000 7f1425ffb640 1 -- 172.21.15.39:0/3186464456 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1434015070 con 0x557b2ec1b470 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.487+0000 7f1425ffb640 1 -- 172.21.15.39:0/3186464456 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434010730 con 0x557b2ec1b470 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.488+0000 7f1448a50740 1 -- 172.21.15.39:0/3186464456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 msgr2=0x557b2ec1d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.488+0000 7f1448a50740 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f143400b7e0 tx=0x7f143400bca0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.488+0000 7f143cff9640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 0x7f14280b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.488+0000 7f143ffff640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 0x7f14280b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f143cff9640 1 -- 172.21.15.39:0/1263731337 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f14300e5d00 con 0x7f1440101860 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 -- 172.21.15.39:0/3186464456 shutdown_connections 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec1d8a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f143ffff640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 0x7f14280b78b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1438005e30 tx=0x7f1438031870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 --2- 172.21.15.39:0/3186464456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec0bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 -- 172.21.15.39:0/3186464456 >> 172.21.15.39:0/3186464456 conn(0x557b2ec08930 msgr2=0x557b2ec096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 -- 172.21.15.39:0/3186464456 shutdown_connections 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.489+0000 7f1448a50740 1 -- 172.21.15.39:0/3186464456 wait complete. 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.490+0000 7f1448a50740 1 -- start start 2024-09-10T21:55:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.490+0000 7f1448a50740 1 Processor -- start 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.490+0000 7f1448a50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec1f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.490+0000 7f1448a50740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.490+0000 7f1448a50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f1448a50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557b2eaa6ab0 con 0x557b2ec1b470 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51110/0 (socket says 172.21.15.39:51110) 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 -- 172.21.15.39:0/918458644 learned_addr learned my addr 172.21.15.39:0/918458644 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143f7fe640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec1f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b2eb14730 con 0x557b2ec0b7d0 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143effd640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557b2ec1e3c0 con 0x557b2ec0c110 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 -- 172.21.15.39:0/918458644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 msgr2=0x557b2ec1fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 -- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 msgr2=0x557b2ec1f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec1f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2e8d0790 con 0x557b2ec1b470 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.491+0000 7f143ffff640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1438009cd0 tx=0x7f143802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b469c61a483041 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f14237f6640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f1448a50740 10 client.0 _ll_register_callbacks cb 0x557b2eb686b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f14237f6640 1 -- 172.21.15.39:0/918458644 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438056060 con 0x557b2ec1b470 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f14237f6640 1 -- 172.21.15.39:0/918458644 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1438041030 con 0x557b2ec1b470 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1434015070 con 0x557b2ec1b470 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f14237f6640 1 -- 172.21.15.39:0/918458644 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14380098c0 con 0x557b2ec1b470 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f1448a50740 10 client.15528 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.492+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=27}) -- 0x557b2e949620 con 0x557b2ec1b470 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f14237f6640 1 -- 172.21.15.39:0/918458644 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1438030070 con 0x557b2ec1b470 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 10 client.15528 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 20 client.15528 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec2d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 4 client.15528 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1434015070 con 0x557b2ec2adc0 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.493+0000 7f143f7fe640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec2d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.494+0000 7f14237f6640 10 client.15528 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.494+0000 7f143f7fe640 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec2d260 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53e641d494402195 server_cookie=dde4a6eca586fb9b in_seq=0 out_seq=0 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f14237f6640 1 -- 172.21.15.39:0/918458644 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1434015070 con 0x557b2ec2adc0 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f14237f6640 10 client.15528 handle_command_reply: tid=0 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 client.15528 shutdown 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 msgr2=0x557b2ec20a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1438009cd0 tx=0x7f143802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 shutdown_connections 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec2d260 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f14237f6640 0 client.15528 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.495+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec1b470 0x557b2ec20a00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec0c110 0x557b2ec1fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 1 --2- 172.21.15.39:0/918458644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec1f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 >> 172.21.15.39:0/918458644 conn(0x557b2ec08930 msgr2=0x557b2ec07bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 shutdown_connections 2024-09-10T21:55:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 1 -- 172.21.15.39:0/918458644 wait complete. 2024-09-10T21:55:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.496+0000 7f1448a50740 20 client.15528 trim_cache size 0 max 16384 2024-09-10T21:55:32.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:55:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.525+0000 7f1448a50740 1 Processor -- start 2024-09-10T21:55:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.525+0000 7f1448a50740 1 -- start start 2024-09-10T21:55:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 0x557b2ec1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec09190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51118/0 (socket says 172.21.15.39:51118) 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f143f7fe640 1 -- 172.21.15.39:0/238848886 learned_addr learned my addr 172.21.15.39:0/238848886 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a7b00 con 0x557b2ec0b7d0 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a9640 con 0x557b2ec0c110 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a81d0 con 0x557b2ec1b470 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f143effd640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 0x557b2ec1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.526+0000 7f143ffff640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec09190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 -- 172.21.15.39:0/238848886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 msgr2=0x557b2ec09190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec09190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 -- 172.21.15.39:0/238848886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 msgr2=0x557b2ec1e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 0x557b2ec1e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 -- 172.21.15.39:0/238848886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2ec1e7c0 con 0x557b2ec0b7d0 2024-09-10T21:55:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143effd640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 0x557b2ec1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f143f7fe640 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f14300ac300 tx=0x7f1430009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439b320b7579a5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f14257fa640 1 -- 172.21.15.39:0/238848886 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14300d3020 con 0x557b2ec0b7d0 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f14257fa640 1 -- 172.21.15.39:0/238848886 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14300ac370 con 0x557b2ec0b7d0 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.527+0000 7f14257fa640 1 -- 172.21.15.39:0/238848886 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143001c040 con 0x557b2ec0b7d0 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 msgr2=0x557b2ec33490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f14300ac300 tx=0x7f1430009f60 comp rx=0 tx=0).stop 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 shutdown_connections 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec09190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0c110 0x557b2ec1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 --2- 172.21.15.39:0/238848886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0b7d0 0x557b2ec33490 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 >> 172.21.15.39:0/238848886 conn(0x557b2ec08930 msgr2=0x557b2ec32d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 shutdown_connections 2024-09-10T21:55:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.528+0000 7f1448a50740 1 -- 172.21.15.39:0/238848886 wait complete. 2024-09-10T21:55:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.529+0000 7f1448a50740 1 -- start start 2024-09-10T21:55:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.529+0000 7f1448a50740 1 Processor -- start 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec27850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec27850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51120/0 (socket says 172.21.15.39:51120) 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec27850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:54612/0 (socket says 172.21.15.39:54612) 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 -- 172.21.15.39:0/4201746576 learned_addr learned my addr 172.21.15.39:0/4201746576 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a8f70 con 0x557b2ec0c110 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a88a0 con 0x557b2ec0b7d0 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14401a5ae0 con 0x557b2ec1b470 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f1448a50740 10 client.0 _ll_register_callbacks cb 0x7f1438009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143ffff640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 -- 172.21.15.39:0/4201746576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 msgr2=0x557b2ec23cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec23cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 -- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 msgr2=0x557b2ec27850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec27850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.530+0000 7f143effd640 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2ec249d0 con 0x557b2ec0c110 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f143effd640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1434004650 tx=0x7f14340040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfca0e6515ed351 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f14237f6640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434029070 con 0x557b2ec0c110 2024-09-10T21:55:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1434005450 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14300ac370 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1434035050 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f1448a50740 10 client.15534 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.531+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b2ec98240 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1434015040 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1434022050 con 0x557b2ec0c110 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 10 client.15534 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 20 client.15534 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec9a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 4 client.15534 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:55:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f14300ac370 con 0x557b2ec2adc0 2024-09-10T21:55:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.532+0000 7f143f7fe640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec9a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.533+0000 7f143f7fe640 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec9a850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6efd2b50225a2f37 server_cookie=93fd6d36f6271a3e in_seq=0 out_seq=0 2024-09-10T21:55:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.533+0000 7f14237f6640 10 client.15534 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.541+0000 7f14237f6640 1 -- 172.21.15.39:0/4201746576 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f14300ac370 con 0x557b2ec2adc0 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.541+0000 7f14237f6640 10 client.15534 handle_command_reply: tid=0 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.541+0000 7f1448a50740 1 client.15534 shutdown 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 msgr2=0x557b2ec235c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1434004650 tx=0x7f14340040a0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 shutdown_connections 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557b2ec2adc0 0x557b2ec9a850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b2ec1b470 0x557b2ec23cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b2ec0c110 0x557b2ec235c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f14237f6640 0 client.15534 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 --2- 172.21.15.39:0/4201746576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b2ec0b7d0 0x557b2ec27850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 >> 172.21.15.39:0/4201746576 conn(0x557b2ec08930 msgr2=0x557b2ec1a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 shutdown_connections 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 1 -- 172.21.15.39:0/4201746576 wait complete. 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.542+0000 7f1448a50740 20 client.15534 trim_cache size 0 max 16384 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:55:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:55:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:55:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:55:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 msgr2=0x7f14280b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 0x7f14280b78b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1438005e30 tx=0x7f1438031870 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 msgr2=0x7f144006b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 0x7f144006b180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f143000e9f0 tx=0x7f143000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 shutdown_connections 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14280b53f0 0x7f14280b78b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1440103370 0x7f14401a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14401029b0 0x7f144019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 --2- 172.21.15.39:0/1263731337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1440101860 0x7f144006b180 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 >> 172.21.15.39:0/1263731337 conn(0x7f14400fd140 msgr2=0x7f1440105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 shutdown_connections 2024-09-10T21:55:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:32.543+0000 7f1445c7f640 1 -- 172.21.15.39:0/1263731337 wait complete. 2024-09-10T21:55:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:32.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:32 smithi070 ceph-mon[34909]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:32 smithi039 ceph-mon[30872]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:32 smithi173 ceph-mon[35294]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:55:33.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 -- 172.21.15.39:0/3407688610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 msgr2=0x7ff128102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/3407688610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128102070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff124009900 tx=0x7ff12402a410 comp rx=0 tx=0).stop 2024-09-10T21:55:33.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 -- 172.21.15.39:0/3407688610 shutdown_connections 2024-09-10T21:55:33.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/3407688610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 0x7ff12810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/3407688610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 0x7ff128107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/3407688610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128102070 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 -- 172.21.15.39:0/3407688610 >> 172.21.15.39:0/3407688610 conn(0x7ff1280fd700 msgr2=0x7ff1280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 -- 172.21.15.39:0/3407688610 shutdown_connections 2024-09-10T21:55:33.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.324+0000 7ff12f5ef640 1 -- 172.21.15.39:0/3407688610 wait complete. 2024-09-10T21:55:33.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.325+0000 7ff12f5ef640 1 Processor -- start 2024-09-10T21:55:33.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.325+0000 7ff12f5ef640 1 -- start start 2024-09-10T21:55:33.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.325+0000 7ff12f5ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.325+0000 7ff12f5ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 0x7ff1281986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.325+0000 7ff12f5ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 0x7ff12819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12f5ef640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111ce0 con 0x7ff128101c90 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12f5ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111b60 con 0x7ff1281076a0 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12f5ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff128111e60 con 0x7ff128108020 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51132/0 (socket says 172.21.15.39:51132) 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 -- 172.21.15.39:0/1787949716 learned_addr learned my addr 172.21.15.39:0/1787949716 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 0x7ff1281986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 0x7ff12819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 -- 172.21.15.39:0/1787949716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 msgr2=0x7ff12819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 0x7ff12819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 -- 172.21.15.39:0/1787949716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 msgr2=0x7ff1281986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 0x7ff1281986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.326+0000 7ff12d38b640 1 -- 172.21.15.39:0/1787949716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12819e220 con 0x7ff128101c90 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff12d38b640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff124005940 tx=0x7ff124032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff11e7fc640 1 -- 172.21.15.39:0/1787949716 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12403f030 con 0x7ff128101c90 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff11e7fc640 1 -- 172.21.15.39:0/1787949716 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff124003aa0 con 0x7ff128101c90 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff11e7fc640 1 -- 172.21.15.39:0/1787949716 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124035070 con 0x7ff128101c90 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12819e4b0 con 0x7ff128101c90 2024-09-10T21:55:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.327+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12806aab0 con 0x7ff128101c90 2024-09-10T21:55:33.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.330+0000 7ff1319c4740 1 Processor -- start 2024-09-10T21:55:33.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.330+0000 7ff1319c4740 1 -- start start 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.330+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b805b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b8065800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff1319c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5569b7fc4ea0 con 0x5569b804bb70 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff1319c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569b7fb42d0 con 0x5569b805b490 2024-09-10T21:55:33.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff1319c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5569b7fb80e0 con 0x5569b805be10 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51136/0 (socket says 172.21.15.39:51136) 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 -- 172.21.15.39:0/2837324754 learned_addr learned my addr 172.21.15.39:0/2837324754 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b8065800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 -- 172.21.15.39:0/2837324754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 msgr2=0x5569b8065800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b8065800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 -- 172.21.15.39:0/2837324754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 msgr2=0x5569b805b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b805b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.331+0000 7ff12db8c640 1 -- 172.21.15.39:0/2837324754 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b7d12650 con 0x5569b804bb70 2024-09-10T21:55:33.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.332+0000 7ff11e7fc640 1 -- 172.21.15.39:0/1787949716 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7ff12403bb80 con 0x7ff128101c90 2024-09-10T21:55:33.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.332+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff120009d70 tx=0x7ff12000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394c9c5ac4288161 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.332+0000 7ff1137fe640 1 -- 172.21.15.39:0/2837324754 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120003970 con 0x5569b804bb70 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.332+0000 7ff1137fe640 1 -- 172.21.15.39:0/2837324754 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff120004030 con 0x5569b804bb70 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.332+0000 7ff1137fe640 1 -- 172.21.15.39:0/2837324754 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120011770 con 0x5569b804bb70 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 -- 172.21.15.39:0/2837324754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 msgr2=0x5569b804bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff120009d70 tx=0x7ff12000f730 comp rx=0 tx=0).stop 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff11e7fc640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 0x7ff1140b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff12d38b640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 0x7ff1140b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 -- 172.21.15.39:0/2837324754 shutdown_connections 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b805b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2837324754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b804bb70 0x5569b804bf50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 -- 172.21.15.39:0/2837324754 >> 172.21.15.39:0/2837324754 conn(0x5569b804e090 msgr2=0x5569b804e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff1319c4740 1 -- 172.21.15.39:0/2837324754 shutdown_connections 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.333+0000 7ff11e7fc640 1 -- 172.21.15.39:0/1787949716 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff1241065c0 con 0x7ff128101c90 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.334+0000 7ff1319c4740 1 -- 172.21.15.39:0/2837324754 wait complete. 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.334+0000 7ff12d38b640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 0x7ff1140b7930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc8d0 tx=0x7ff124109c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.334+0000 7ff1319c4740 1 -- start start 2024-09-10T21:55:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.334+0000 7ff1319c4740 1 Processor -- start 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.334+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b80656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805be10 0x5569b80631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5569b7e15700 con 0x5569b805b490 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569b7f4f160 con 0x5569b805be10 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5569b8065ef0 con 0x5569b804bb70 2024-09-10T21:55:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff1319c4740 10 client.0 _ll_register_callbacks cb 0x5569b7f689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51140/0 (socket says 172.21.15.39:51140) 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 -- 172.21.15.39:0/2304894476 learned_addr learned my addr 172.21.15.39:0/2304894476 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b80656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805be10 0x5569b80631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 -- 172.21.15.39:0/2304894476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 msgr2=0x5569b80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b80656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 -- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805be10 msgr2=0x5569b80631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805be10 0x5569b80631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.335+0000 7ff12cb8a640 1 -- 172.21.15.39:0/2304894476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b7f7cc90 con 0x5569b805b490 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff1180116f0 tx=0x7ff118011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a78f4ae8c2d6957 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff110ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118004020 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff118017070 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff120004030 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff1180041c0 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff1319c4740 10 client.15546 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.336+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569b8071880 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff120004030 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff118003b30 con 0x5569b805b490 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 10 client.15546 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 10 client.15546 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 20 client.15546 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b8072de0 0x5569b80751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 4 client.15546 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b7fc6df0 con 0x5569b8072de0 2024-09-10T21:55:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.337+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b8072de0 0x5569b80751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.338+0000 7ff12db8c640 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b8072de0 0x5569b80751d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c0e08278a3b52d1 server_cookie=8339e6c00fd345a6 in_seq=0 out_seq=0 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.338+0000 7ff110ff9640 10 client.15546 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.338+0000 7ff110ff9640 1 -- 172.21.15.39:0/2304894476 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569b7fc6df0 con 0x5569b8072de0 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.338+0000 7ff110ff9640 10 client.15546 handle_command_reply: tid=0 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.338+0000 7ff1319c4740 1 client.15546 shutdown 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 msgr2=0x5569b8062b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff1180116f0 tx=0x7ff118011bb0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 shutdown_connections 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b8072de0 0x5569b80751d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805be10 0x5569b80631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b8062b20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 --2- 172.21.15.39:0/2304894476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b80656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 >> 172.21.15.39:0/2304894476 conn(0x5569b804e090 msgr2=0x5569b804d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff110ff9640 0 client.15546 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:55:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 shutdown_connections 2024-09-10T21:55:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 1 -- 172.21.15.39:0/2304894476 wait complete. 2024-09-10T21:55:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.339+0000 7ff1319c4740 20 client.15546 trim_cache size 0 max 16384 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 Processor -- start 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 -- start start 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b8074df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ac180 con 0x5569b805be10 2024-09-10T21:55:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281adcc0 con 0x5569b805b490 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff1319c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ac850 con 0x5569b804bb70 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff12db8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff12db8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51148/0 (socket says 172.21.15.39:51148) 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff12cb8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b8074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff12db8c640 1 -- 172.21.15.39:0/1102906407 learned_addr learned my addr 172.21.15.39:0/1102906407 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.353+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 -- 172.21.15.39:0/1102906407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 msgr2=0x5569b806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 -- 172.21.15.39:0/1102906407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 msgr2=0x5569b8074df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b8074df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 -- 172.21.15.39:0/1102906407 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b804f150 con 0x5569b805be10 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1200099a0 tx=0x7ff12000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482fdd2adc03fe6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff112ffd640 1 -- 172.21.15.39:0/1102906407 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12002a040 con 0x5569b805be10 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff112ffd640 1 -- 172.21.15.39:0/1102906407 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff120003c00 con 0x5569b805be10 2024-09-10T21:55:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.354+0000 7ff112ffd640 1 -- 172.21.15.39:0/1102906407 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120005290 con 0x5569b805be10 2024-09-10T21:55:33.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- 172.21.15.39:0/1102906407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 msgr2=0x5569b8059aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1200099a0 tx=0x7ff12000f730 comp rx=0 tx=0).stop 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- 172.21.15.39:0/1102906407 shutdown_connections 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805be10 0x5569b8059aa0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b805b490 0x5569b8074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1102906407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b804bb70 0x5569b806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- 172.21.15.39:0/1102906407 >> 172.21.15.39:0/1102906407 conn(0x5569b804e090 msgr2=0x5569b805aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- 172.21.15.39:0/1102906407 shutdown_connections 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- 172.21.15.39:0/1102906407 wait complete. 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 -- start start 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.355+0000 7ff1319c4740 1 Processor -- start 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 0x5569b807a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b807b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281ad5f0 con 0x5569b805b490 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff12cb8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281acf20 con 0x5569b804bb70 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff12cb8a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51158/0 (socket says 172.21.15.39:51158) 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff12cb8a640 1 -- 172.21.15.39:0/1456255097 learned_addr learned my addr 172.21.15.39:0/1456255097 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281aa160 con 0x5569b805be10 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 0x5569b807a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b807b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.356+0000 7ff1319c4740 10 client.0 _ll_register_callbacks cb 0x7ff11800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 -- 172.21.15.39:0/1456255097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 msgr2=0x5569b807b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b807b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 -- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 msgr2=0x5569b807a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 0x5569b807a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 -- 172.21.15.39:0/1456255097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b80decc0 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 0x5569b807a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff120003c00 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff12cb8a640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff11801a500 tx=0x7ff118010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee931919bc6114b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff110ff9640 10 client.15552 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff110ff9640 1 -- 172.21.15.39:0/1456255097 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118029070 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff110ff9640 1 -- 172.21.15.39:0/1456255097 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ff118011e00 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff110ff9640 1 -- 172.21.15.39:0/1456255097 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff118005850 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff1319c4740 10 client.15552 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.357+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5569b80dfed0 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff110ff9640 1 -- 172.21.15.39:0/1456255097 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff118036030 con 0x5569b805b490 2024-09-10T21:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 10 client.15552 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 10 client.15552 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:55:33.367 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 20 client.15552 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b80e04c0 0x5569b80e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 4 client.15552 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569b7fc28a0 con 0x5569b80e04c0 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b80e04c0 0x5569b80e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff12db8c640 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b80e04c0 0x5569b80e28e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=368dc44a506fe73 server_cookie=4c0830c4ab53fae3 in_seq=0 out_seq=0 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff110ff9640 10 client.15552 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff110ff9640 1 -- 172.21.15.39:0/1456255097 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569b7fc28a0 con 0x5569b80e04c0 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.358+0000 7ff110ff9640 10 client.15552 handle_command_reply: tid=0 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 client.15552 shutdown 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 msgr2=0x5569b807af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff11801a500 tx=0x7ff118010f40 comp rx=0 tx=0).stop 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 shutdown_connections 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569b80e04c0 0x5569b80e28e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569b805be10 0x5569b807b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569b805b490 0x5569b807af00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 --2- 172.21.15.39:0/1456255097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b804bb70 0x5569b807a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff110ff9640 0 client.15552 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 >> 172.21.15.39:0/1456255097 conn(0x5569b804e090 msgr2=0x5569b8059aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 shutdown_connections 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 1 -- 172.21.15.39:0/1456255097 wait complete. 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.359+0000 7ff1319c4740 20 client.15552 trim_cache size 0 max 16384 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 msgr2=0x7ff1140b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 0x7ff1140b7930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc8d0 tx=0x7ff124109c20 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 msgr2=0x7ff128198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff124005940 tx=0x7ff124032f60 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 shutdown_connections 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ff1140b5470 0x7ff1140b7930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff128108020 0x7ff12819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1281076a0 0x7ff1281986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 --2- 172.21.15.39:0/1787949716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff128101c90 0x7ff128198170 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:33.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 >> 172.21.15.39:0/1787949716 conn(0x7ff1280fd700 msgr2=0x7ff1280ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:33.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 shutdown_connections 2024-09-10T21:55:33.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:33.360+0000 7ff12f5ef640 1 -- 172.21.15.39:0/1787949716 wait complete. 2024-09-10T21:55:34.043 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:55:34.429 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:34.839 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:34 smithi039 ceph-mon[30872]: pgmap v358: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 -- 172.21.15.39:0/2288933622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c108020 msgr2=0x7f746c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 --2- 172.21.15.39:0/2288933622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c108020 0x7f746c10e820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7464009ca0 tx=0x7f746402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 -- 172.21.15.39:0/2288933622 shutdown_connections 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 --2- 172.21.15.39:0/2288933622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c108020 0x7f746c10e820 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 --2- 172.21.15.39:0/2288933622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c1076a0 0x7f746c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 --2- 172.21.15.39:0/2288933622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 -- 172.21.15.39:0/2288933622 >> 172.21.15.39:0/2288933622 conn(0x7f746c0fd700 msgr2=0x7f746c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 -- 172.21.15.39:0/2288933622 shutdown_connections 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.872+0000 7f74734f9640 1 -- 172.21.15.39:0/2288933622 wait complete. 2024-09-10T21:55:34.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 Processor -- start 2024-09-10T21:55:34.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 -- start start 2024-09-10T21:55:34.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c108020 0x7f746c1a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f746c111ca0 con 0x7f746c1076a0 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746c111b20 con 0x7f746c101c90 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f74734f9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f746c111e20 con 0x7f746c108020 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f7470a94640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f7470a94640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51168/0 (socket says 172.21.15.39:51168) 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.873+0000 7f7470a94640 1 -- 172.21.15.39:0/3008028584 learned_addr learned my addr 172.21.15.39:0/3008028584 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7471295640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7471a96640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c108020 0x7f746c1a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 -- 172.21.15.39:0/3008028584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c108020 msgr2=0x7f746c1a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c108020 0x7f746c1a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 -- 172.21.15.39:0/3008028584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 msgr2=0x7f746c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 -- 172.21.15.39:0/3008028584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c197e20 con 0x7f746c1076a0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7471295640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f7470a94640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9f0 tx=0x7f745c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f74627fc640 1 -- 172.21.15.39:0/3008028584 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00cd80 con 0x7f746c1076a0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f74627fc640 1 -- 172.21.15.39:0/3008028584 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0054d0 con 0x7f746c1076a0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.874+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c198110 con 0x7f746c1076a0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.875+0000 7f74627fc640 1 -- 172.21.15.39:0/3008028584 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c010690 con 0x7f746c1076a0 2024-09-10T21:55:34.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.875+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1985f0 con 0x7f746c1076a0 2024-09-10T21:55:34.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.878+0000 7f74758ce740 1 Processor -- start 2024-09-10T21:55:34.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.878+0000 7f74758ce740 1 -- start start 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56434173eea0 con 0x5643417d49a0 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56434172e2d0 con 0x5643417c80f0 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74758ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5643417320e0 con 0x5643417c8a10 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41652/0 (socket says 172.21.15.39:41652) 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 -- 172.21.15.39:0/279690976 learned_addr learned my addr 172.21.15.39:0/279690976 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471a96640 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 -- 172.21.15.39:0/279690976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 msgr2=0x5643417c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 -- 172.21.15.39:0/279690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 msgr2=0x5643417d6d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d6d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f7471295640 1 -- 172.21.15.39:0/279690976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434148c650 con 0x5643417c8a10 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.879+0000 7f74627fc640 1 -- 172.21.15.39:0/3008028584 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f745c004e90 con 0x7f746c1076a0 2024-09-10T21:55:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.880+0000 7f7471295640 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f746800bd40 tx=0x7f746800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47716cc7b19f281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f74627fc640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 0x7f74580b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f74577fe640 1 -- 172.21.15.39:0/279690976 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004220 con 0x5643417c8a10 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f74577fe640 1 -- 172.21.15.39:0/279690976 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f746800be30 con 0x5643417c8a10 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f74577fe640 1 -- 172.21.15.39:0/279690976 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74680116c0 con 0x5643417c8a10 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f74627fc640 1 -- 172.21.15.39:0/3008028584 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f745c0e6220 con 0x7f746c1076a0 2024-09-10T21:55:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.881+0000 7f7471a96640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 0x7f74580b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- 172.21.15.39:0/279690976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 msgr2=0x5643417d4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f746800bd40 tx=0x7f746800f730 comp rx=0 tx=0).stop 2024-09-10T21:55:34.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f7471a96640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 0x7f74580b78b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7464006010 tx=0x7f7464009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- 172.21.15.39:0/279690976 shutdown_connections 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d4460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 --2- 172.21.15.39:0/279690976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- 172.21.15.39:0/279690976 >> 172.21.15.39:0/279690976 conn(0x5643417c5f20 msgr2=0x5643417c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- 172.21.15.39:0/279690976 shutdown_connections 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- 172.21.15.39:0/279690976 wait complete. 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.882+0000 7f74758ce740 1 -- start start 2024-09-10T21:55:34.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 Processor -- start 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56434158f700 con 0x5643417d49a0 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5643416c9160 con 0x5643417c80f0 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5643417d7620 con 0x5643417c8a10 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f74758ce740 10 client.0 _ll_register_callbacks cb 0x5643416e29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f7471a96640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f7471a96640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51180/0 (socket says 172.21.15.39:51180) 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f7471a96640 1 -- 172.21.15.39:0/2604154892 learned_addr learned my addr 172.21.15.39:0/2604154892 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f7471295640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.883+0000 7f7470a94640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 -- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 msgr2=0x5643417d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 -- 172.21.15.39:0/2604154892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 msgr2=0x5643417d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 -- 172.21.15.39:0/2604154892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643416f6c90 con 0x5643417c80f0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7470a94640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7471295640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417d4330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7468003f60 tx=0x7f746800bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f89408179b9dff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7454ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004210 con 0x5643417c80f0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f74680043b0 con 0x5643417c80f0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.884+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f746800be30 con 0x5643417c80f0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74680035f0 con 0x5643417c80f0 2024-09-10T21:55:34.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 10 client.25166 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:34.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643417f4030 con 0x5643417c80f0 2024-09-10T21:55:34.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74680054f0 con 0x5643417c80f0 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74680049f0 con 0x5643417c80f0 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 10 client.25166 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 10 client.25166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 20 client.25166 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x5643417f7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 4 client.25166 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.885+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f746800be30 con 0x5643417f5430 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.886+0000 7f7470a94640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x5643417f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.886+0000 7f7470a94640 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x5643417f7820 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3dc7573add7468 server_cookie=988a254f4908df7e in_seq=0 out_seq=0 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.886+0000 7f7454ff9640 10 client.25166 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:55:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f7454ff9640 1 -- 172.21.15.39:0/2604154892 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f746800be30 con 0x5643417f5430 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f7454ff9640 10 client.25166 handle_command_reply: tid=0 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 client.25166 shutdown 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 msgr2=0x5643417d4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417d4330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7468003f60 tx=0x7f746800bab0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 shutdown_connections 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x5643417f7820 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f7454ff9640 0 client.25166 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417d49a0 0x5643417d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417c8a10 0x5643417d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 --2- 172.21.15.39:0/2604154892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c80f0 0x5643417d4330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.887+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 >> 172.21.15.39:0/2604154892 conn(0x5643417c5f20 msgr2=0x5643417cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.888+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 shutdown_connections 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.888+0000 7f74758ce740 1 -- 172.21.15.39:0/2604154892 wait complete. 2024-09-10T21:55:34.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.888+0000 7f74758ce740 20 client.25166 trim_cache size 0 max 16384 2024-09-10T21:55:34.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.901+0000 7f74758ce740 1 Processor -- start 2024-09-10T21:55:34.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.901+0000 7f74758ce740 1 -- start start 2024-09-10T21:55:34.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f746c073720 con 0x5643417c80f0 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1a55f0 con 0x5643417c8a10 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f74758ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f746c073df0 con 0x5643417d49a0 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471295640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471295640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51188/0 (socket says 172.21.15.39:51188) 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471295640 1 -- 172.21.15.39:0/3022846241 learned_addr learned my addr 172.21.15.39:0/3022846241 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471a96640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417d62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7470a94640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471a96640 1 -- 172.21.15.39:0/3022846241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 msgr2=0x5643417d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471a96640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.902+0000 7f7471a96640 1 -- 172.21.15.39:0/3022846241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 msgr2=0x5643417c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7471a96640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7471a96640 1 -- 172.21.15.39:0/3022846241 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643417c69a0 con 0x5643417d49a0 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7471295640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:34.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7471a96640 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417d62d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7464009430 tx=0x7f746403b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d280e09c4c346b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:34 smithi070 ceph-mon[34909]: pgmap v358: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7456ffd640 1 -- 172.21.15.39:0/3022846241 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464056070 con 0x5643417d49a0 2024-09-10T21:55:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7456ffd640 1 -- 172.21.15.39:0/3022846241 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7464036040 con 0x5643417d49a0 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.903+0000 7f7456ffd640 1 -- 172.21.15.39:0/3022846241 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746402f660 con 0x5643417d49a0 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 -- 172.21.15.39:0/3022846241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 msgr2=0x5643417d62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417d62d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7464009430 tx=0x7f746403b000 comp rx=0 tx=0).stop 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 -- 172.21.15.39:0/3022846241 shutdown_connections 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417d62d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 --2- 172.21.15.39:0/3022846241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.904+0000 7f74758ce740 1 -- 172.21.15.39:0/3022846241 >> 172.21.15.39:0/3022846241 conn(0x5643417c5f20 msgr2=0x5643417c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.905+0000 7f74758ce740 1 -- 172.21.15.39:0/3022846241 shutdown_connections 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.905+0000 7f74758ce740 1 -- 172.21.15.39:0/3022846241 wait complete. 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.905+0000 7f74758ce740 1 -- start start 2024-09-10T21:55:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.905+0000 7f74758ce740 1 Processor -- start 2024-09-10T21:55:34.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51202/0 (socket says 172.21.15.39:51202) 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 -- 172.21.15.39:0/785204679 learned_addr learned my addr 172.21.15.39:0/785204679 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417f7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f746c074b90 con 0x5643417c80f0 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746c0744c0 con 0x5643417c8a10 2024-09-10T21:55:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f746c0716e0 con 0x5643417d49a0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7470a94640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471a96640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f74758ce740 10 client.0 _ll_register_callbacks cb 0x7f7468015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 -- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 msgr2=0x5643417f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 -- 172.21.15.39:0/785204679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 msgr2=0x5643417f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417f7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.906+0000 7f7471295640 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643417f84a0 con 0x5643417c80f0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7464036040 con 0x5643417c80f0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f7471295640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7468003f60 tx=0x7f7468004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61ed900edf9054a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f7454ff9640 10 client.15567 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f7454ff9640 1 -- 172.21.15.39:0/785204679 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468011440 con 0x5643417c80f0 2024-09-10T21:55:34.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f7454ff9640 1 -- 172.21.15.39:0/785204679 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7468003790 con 0x5643417c80f0 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f7454ff9640 1 -- 172.21.15.39:0/785204679 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7468003a10 con 0x5643417c80f0 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f74758ce740 10 client.15567 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.907+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=27}) -- 0x564341862d60 con 0x5643417c80f0 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f7454ff9640 1 -- 172.21.15.39:0/785204679 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7468004640 con 0x5643417c80f0 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 10 client.15567 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 10 client.15567 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 20 client.15567 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x564341865330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 4 client.15567 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564341740df0 con 0x5643417f5430 2024-09-10T21:55:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.908+0000 7f7470a94640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x564341865330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:34.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f7470a94640 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x564341865330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e9c0839d150c1e0 server_cookie=9fc4e6d2f10b216b in_seq=0 out_seq=0 2024-09-10T21:55:34.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f7454ff9640 10 client.15567 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:55:34.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f7454ff9640 1 -- 172.21.15.39:0/785204679 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564341740df0 con 0x5643417f5430 2024-09-10T21:55:34.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f7454ff9640 10 client.15567 handle_command_reply: tid=0 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 client.15567 shutdown 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 msgr2=0x5643417faf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7468003f60 tx=0x7f7468004520 comp rx=0 tx=0).stop 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 shutdown_connections 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5643417f5430 0x564341865330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643417d49a0 0x5643417f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5643417c8a10 0x5643417f7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 --2- 172.21.15.39:0/785204679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5643417c80f0 0x5643417faf10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 >> 172.21.15.39:0/785204679 conn(0x5643417c5f20 msgr2=0x5643417df8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.909+0000 7f7454ff9640 0 client.15567 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.910+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 shutdown_connections 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.910+0000 7f74758ce740 1 -- 172.21.15.39:0/785204679 wait complete. 2024-09-10T21:55:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.910+0000 7f74758ce740 20 client.15567 trim_cache size 0 max 16384 2024-09-10T21:55:34.915 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:55:34.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 msgr2=0x7f74580b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 0x7f74580b78b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7464006010 tx=0x7f7464009360 comp rx=0 tx=0).stop 2024-09-10T21:55:34.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 msgr2=0x7f746c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9f0 tx=0x7f745c00edf0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 shutdown_connections 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74580b53f0 0x7f74580b78b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f746c108020 0x7f746c1a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1076a0 0x7f746c19a570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 --2- 172.21.15.39:0/3008028584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c101c90 0x7f746c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 >> 172.21.15.39:0/3008028584 conn(0x7f746c0fd700 msgr2=0x7f746c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 shutdown_connections 2024-09-10T21:55:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:34.913+0000 7f74734f9640 1 -- 172.21.15.39:0/3008028584 wait complete. 2024-09-10T21:55:34.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:34 smithi173 ceph-mon[35294]: pgmap v358: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-10T21:55:35.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:55:35.887 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 -- 172.21.15.39:0/3616571940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc4109130 msgr2=0x7f4fc410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3616571940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc4109130 0x7f4fc410f930 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009ca0 tx=0x7f4fbc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 -- 172.21.15.39:0/3616571940 shutdown_connections 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3616571940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc4109130 0x7f4fc410f930 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3616571940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc41087b0 0x7f4fc4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3616571940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.560+0000 7f4fcc459640 1 -- 172.21.15.39:0/3616571940 >> 172.21.15.39:0/3616571940 conn(0x7f4fc40fe850 msgr2=0x7f4fc4100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.561+0000 7f4fcc459640 1 -- 172.21.15.39:0/3616571940 shutdown_connections 2024-09-10T21:55:36.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.561+0000 7f4fcc459640 1 -- 172.21.15.39:0/3616571940 wait complete. 2024-09-10T21:55:36.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.562+0000 7f4fcc459640 1 Processor -- start 2024-09-10T21:55:36.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.562+0000 7f4fcc459640 1 -- start start 2024-09-10T21:55:36.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.562+0000 7f4fcc459640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.562+0000 7f4fcc459640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 0x7f4fc40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:54732/0 (socket says 172.21.15.39:54732) 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.562+0000 7f4fc99f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 0x7f4fc40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fca1f5640 1 -- 172.21.15.39:0/3074304189 learned_addr learned my addr 172.21.15.39:0/3074304189 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 0x7f4fc4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4112e00 con 0x7f4fc41087b0 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4112c80 con 0x7f4fc4102da0 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4112f80 con 0x7f4fc4109130 2024-09-10T21:55:36.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.563+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 0x7f4fc4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 -- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 msgr2=0x7f4fc4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 0x7f4fc4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 -- 172.21.15.39:0/3074304189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 msgr2=0x7f4fc40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc41a76f0 con 0x7f4fc41087b0 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 0x7f4fc4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 0x7f4fc40759e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eb30 tx=0x7f4fb4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.564+0000 7f4fbb7fe640 1 -- 172.21.15.39:0/3074304189 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400cc60 con 0x7f4fc41087b0 2024-09-10T21:55:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.565+0000 7f4fbb7fe640 1 -- 172.21.15.39:0/3074304189 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb400ce00 con 0x7f4fc41087b0 2024-09-10T21:55:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.565+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc41a79e0 con 0x7f4fc41087b0 2024-09-10T21:55:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.565+0000 7f4fbb7fe640 1 -- 172.21.15.39:0/3074304189 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4004a00 con 0x7f4fc41087b0 2024-09-10T21:55:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.565+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a7f20 con 0x7f4fc41087b0 2024-09-10T21:55:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.569+0000 7f4fbb7fe640 1 -- 172.21.15.39:0/3074304189 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f4fb401f060 con 0x7f4fc41087b0 2024-09-10T21:55:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.570+0000 7f4fce82e740 1 Processor -- start 2024-09-10T21:55:36.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 -- start start 2024-09-10T21:55:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd47d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd48bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5641fd3f3ea0 con 0x5641fd47da10 2024-09-10T21:55:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641fd3e32d0 con 0x5641fd4899a0 2024-09-10T21:55:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.571+0000 7f4fce82e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5641fd3e70e0 con 0x5641fd47d0f0 2024-09-10T21:55:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.572+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.572+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51228/0 (socket says 172.21.15.39:51228) 2024-09-10T21:55:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.572+0000 7f4fca1f5640 1 -- 172.21.15.39:0/4027002560 learned_addr learned my addr 172.21.15.39:0/4027002560 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.572+0000 7f4fbb7fe640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 0x7f4fb00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.572+0000 7f4fbb7fe640 1 -- 172.21.15.39:0/3074304189 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4fb40e5590 con 0x7f4fc41087b0 2024-09-10T21:55:36.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd48bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 -- 172.21.15.39:0/4027002560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 msgr2=0x5641fd47d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd47d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 -- 172.21.15.39:0/4027002560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 msgr2=0x5641fd489460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fc99f4640 1 -- 172.21.15.39:0/4027002560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641fd141650 con 0x5641fd4899a0 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.573+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.574+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd48bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40e2f50 tx=0x7f4fb40abb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c76485e013acd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.574+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 0x7f4fb00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.574+0000 7f4fb8de6640 1 -- 172.21.15.39:0/4027002560 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40b0020 con 0x5641fd4899a0 2024-09-10T21:55:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.574+0000 7f4fb8de6640 1 -- 172.21.15.39:0/4027002560 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb40930c0 con 0x5641fd4899a0 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fb8de6640 1 -- 172.21.15.39:0/4027002560 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb401c070 con 0x5641fd4899a0 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 0x7f4fb00b78b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4077560 tx=0x7f4fbc005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 -- 172.21.15.39:0/4027002560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 msgr2=0x5641fd48bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd48bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40e2f50 tx=0x7f4fb40abb00 comp rx=0 tx=0).stop 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 -- 172.21.15.39:0/4027002560 shutdown_connections 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd48bd90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd489460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 --2- 172.21.15.39:0/4027002560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd47d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.575+0000 7f4fce82e740 1 -- 172.21.15.39:0/4027002560 >> 172.21.15.39:0/4027002560 conn(0x5641fd47af20 msgr2=0x5641fd47c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.576+0000 7f4fce82e740 1 -- 172.21.15.39:0/4027002560 shutdown_connections 2024-09-10T21:55:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.576+0000 7f4fce82e740 1 -- 172.21.15.39:0/4027002560 wait complete. 2024-09-10T21:55:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.576+0000 7f4fce82e740 1 -- start start 2024-09-10T21:55:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.576+0000 7f4fce82e740 1 Processor -- start 2024-09-10T21:55:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd489280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd486d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fc99f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fc99f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51236/0 (socket says 172.21.15.39:51236) 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd489280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fca1f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd489280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41720/0 (socket says 172.21.15.39:41720) 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fc99f4640 1 -- 172.21.15.39:0/1684015991 learned_addr learned my addr 172.21.15.39:0/1684015991 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd486d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5641fd244700 con 0x5641fd47da10 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.577+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641fd37e160 con 0x5641fd4899a0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5641fd48c6c0 con 0x5641fd47d0f0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fce82e740 10 client.0 _ll_register_callbacks cb 0x5641fd3979e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 -- 172.21.15.39:0/1684015991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 msgr2=0x5641fd489280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd489280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 -- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 msgr2=0x5641fd486d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd486d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641fd3abc90 con 0x5641fd47da10 2024-09-10T21:55:36.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd486d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:36.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eb00 tx=0x7f4fb40e53a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118e427fdf270ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.578+0000 7f4fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:36.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40d2070 con 0x5641fd47da10 2024-09-10T21:55:36.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4fb40aae60 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb40930c0 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fb401c030 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fce82e740 10 client.15579 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.579+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641fd497ff0 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb40930c0 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4fb40a7550 con 0x5641fd47da10 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 10 client.15579 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 20 client.15579 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd49b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 4 client.15579 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641fd3f5df0 con 0x5641fd499340 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.580+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd49b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.581+0000 7f4fadffb640 10 client.15579 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.581+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd49b730 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a220eafe35c69aea server_cookie=2bd8d2aba07b5859 in_seq=0 out_seq=0 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fadffb640 1 -- 172.21.15.39:0/1684015991 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641fd3f5df0 con 0x5641fd499340 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fadffb640 10 client.15579 handle_command_reply: tid=0 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 client.15579 shutdown 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 msgr2=0x5641fd4866d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eb00 tx=0x7f4fb40e53a0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 shutdown_connections 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd49b730 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd486d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fadffb640 0 client.15579 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd4866d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1684015991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd489280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 >> 172.21.15.39:0/1684015991 conn(0x5641fd47af20 msgr2=0x5641fd480ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.582+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 shutdown_connections 2024-09-10T21:55:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.583+0000 7f4fce82e740 1 -- 172.21.15.39:0/1684015991 wait complete. 2024-09-10T21:55:36.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.583+0000 7f4fce82e740 20 client.15579 trim_cache size 0 max 16384 2024-09-10T21:55:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 Processor -- start 2024-09-10T21:55:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 -- start start 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd48ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd4838e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b0680 con 0x5641fd47da10 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b21c0 con 0x5641fd4899a0 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fce82e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b0d50 con 0x5641fd47d0f0 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fc99f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fc99f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51242/0 (socket says 172.21.15.39:51242) 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fc99f4640 1 -- 172.21.15.39:0/272866452 learned_addr learned my addr 172.21.15.39:0/272866452 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.609+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd48ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd4838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 -- 172.21.15.39:0/272866452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 msgr2=0x5641fd48ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd48ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 -- 172.21.15.39:0/272866452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 msgr2=0x5641fd4838e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd4838e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 -- 172.21.15.39:0/272866452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641fd47a680 con 0x5641fd47da10 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd4838e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009fd0 tx=0x7f4fb4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca0709b2000e0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4faffff640 1 -- 172.21.15.39:0/272866452 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40d2030 con 0x5641fd47da10 2024-09-10T21:55:36.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4faffff640 1 -- 172.21.15.39:0/272866452 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb40930c0 con 0x5641fd47da10 2024-09-10T21:55:36.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.610+0000 7f4faffff640 1 -- 172.21.15.39:0/272866452 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40b0050 con 0x5641fd47da10 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 -- 172.21.15.39:0/272866452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 msgr2=0x5641fd48b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009fd0 tx=0x7f4fb4009310 comp rx=0 tx=0).stop 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 -- 172.21.15.39:0/272866452 shutdown_connections 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd4899a0 0x5641fd4838e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd47da10 0x5641fd48b2d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 --2- 172.21.15.39:0/272866452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47d0f0 0x5641fd48ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.611+0000 7f4fce82e740 1 -- 172.21.15.39:0/272866452 >> 172.21.15.39:0/272866452 conn(0x5641fd47af20 msgr2=0x5641fd479f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 -- 172.21.15.39:0/272866452 shutdown_connections 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 -- 172.21.15.39:0/272866452 wait complete. 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 -- start start 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 Processor -- start 2024-09-10T21:55:36.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd47d0f0 0x5641fd49ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 0x5641fd49f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.612+0000 7f4fce82e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fce82e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b1af0 con 0x5641fd4899a0 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fce82e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b1420 con 0x5641fd47d0f0 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fce82e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41ae660 con 0x5641fd47da10 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fce82e740 10 client.0 _ll_register_callbacks cb 0x7f4fb40cef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51258/0 (socket says 172.21.15.39:51258) 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 -- 172.21.15.39:0/1865014233 learned_addr learned my addr 172.21.15.39:0/1865014233 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 0x5641fd49f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd47d0f0 0x5641fd49ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 -- 172.21.15.39:0/1865014233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 msgr2=0x5641fd49f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 0x5641fd49f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 -- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd47d0f0 msgr2=0x5641fd49ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd47d0f0 0x5641fd49ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 -- 172.21.15.39:0/1865014233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641fd500200 con 0x5641fd4899a0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fc99f4640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 0x5641fd49f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fca9f6640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009ca0 tx=0x7f4fbc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f63aa2b32e4ebee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.613+0000 7f4fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0318c0 con 0x5641fd4899a0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4fbc0047a0 con 0x5641fd4899a0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb40930c0 con 0x5641fd4899a0 2024-09-10T21:55:36.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc02f610 con 0x5641fd4899a0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 10 client.15585 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641fd50f390 con 0x5641fd4899a0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb40930c0 con 0x5641fd4899a0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4fbc044040 con 0x5641fd4899a0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 20 client.15585 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.614+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd511b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.615+0000 7f4fce82e740 4 client.15585 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.615+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641fd3f18a0 con 0x5641fd499340 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.615+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd511b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.615+0000 7f4fca1f5640 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd511b80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e88f34968303dd server_cookie=42c7836ae5ecc761 in_seq=0 out_seq=0 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.615+0000 7f4fadffb640 10 client.15585 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:36.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fadffb640 1 -- 172.21.15.39:0/1865014233 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641fd3f18a0 con 0x5641fd499340 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fadffb640 10 client.15585 handle_command_reply: tid=0 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 client.15585 shutdown 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 msgr2=0x5641fd4ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009ca0 tx=0x7f4fbc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 shutdown_connections 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5641fd499340 0x5641fd511b80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641fd4899a0 0x5641fd4ff9d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641fd47da10 0x5641fd49f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 --2- 172.21.15.39:0/1865014233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641fd47d0f0 0x5641fd49ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 >> 172.21.15.39:0/1865014233 conn(0x5641fd47af20 msgr2=0x5641fd487d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fadffb640 0 client.15585 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 shutdown_connections 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 1 -- 172.21.15.39:0/1865014233 wait complete. 2024-09-10T21:55:36.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.616+0000 7f4fce82e740 20 client.15585 trim_cache size 0 max 16384 2024-09-10T21:55:36.622 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:55:36.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 msgr2=0x7f4fb00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 0x7f4fb00b78b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4077560 tx=0x7f4fbc005d80 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 msgr2=0x7f4fc40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 0x7f4fc40759e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400eb30 tx=0x7f4fb4009f60 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 shutdown_connections 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4fb00b53f0 0x7f4fb00b78b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc4109130 0x7f4fc4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fc41087b0 0x7f4fc40759e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 --2- 172.21.15.39:0/3074304189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102da0 0x7f4fc40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 >> 172.21.15.39:0/3074304189 conn(0x7f4fc40fe850 msgr2=0x7f4fc4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 shutdown_connections 2024-09-10T21:55:36.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:36.617+0000 7f4fcc459640 1 -- 172.21.15.39:0/3074304189 wait complete. 2024-09-10T21:55:36.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:36 smithi070 ceph-mon[34909]: pgmap v359: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T21:55:36.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:36 smithi039 ceph-mon[30872]: pgmap v359: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T21:55:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:36 smithi173 ceph-mon[35294]: pgmap v359: 97 pgs: 97 active+clean; 670 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T21:55:38.284 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:55:38.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:55:38.604 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:38.837 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:38 smithi039 ceph-mon[30872]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:38 smithi070 ceph-mon[34909]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:38 smithi173 ceph-mon[35294]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:39.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 -- 172.21.15.39:0/3843184287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60104430 msgr2=0x7fbb6010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 --2- 172.21.15.39:0/3843184287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60104430 0x7fbb6010c920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb5002a410 comp rx=0 tx=0).stop 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 -- 172.21.15.39:0/3843184287 shutdown_connections 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 --2- 172.21.15.39:0/3843184287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6010cf70 0x7fbb6010f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 --2- 172.21.15.39:0/3843184287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60104430 0x7fbb6010c920 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 --2- 172.21.15.39:0/3843184287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb60103b10 0x7fbb60103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 -- 172.21.15.39:0/3843184287 >> 172.21.15.39:0/3843184287 conn(0x7fbb600fd5b0 msgr2=0x7fbb600ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 -- 172.21.15.39:0/3843184287 shutdown_connections 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.079+0000 7fbb661a1640 1 -- 172.21.15.39:0/3843184287 wait complete. 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 Processor -- start 2024-09-10T21:55:39.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 -- start start 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 0x7fbb601995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 0x7fbb6019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb6519f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb6519f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51288/0 (socket says 172.21.15.39:51288) 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112be0 con 0x7fbb60103b10 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb6519f640 1 -- 172.21.15.39:0/213554831 learned_addr learned my addr 172.21.15.39:0/213554831 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112a60 con 0x7fbb6010cf70 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112d60 con 0x7fbb60104430 2024-09-10T21:55:39.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.080+0000 7fbb6499e640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 0x7fbb601995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb659a0640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 0x7fbb6019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 -- 172.21.15.39:0/213554831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 msgr2=0x7fbb601995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 0x7fbb601995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 -- 172.21.15.39:0/213554831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 msgr2=0x7fbb6019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 0x7fbb6019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6019f120 con 0x7fbb60103b10 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6499e640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 0x7fbb601995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb659a0640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 0x7fbb6019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb6519f640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00d950 tx=0x7fbb5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb567fc640 1 -- 172.21.15.39:0/213554831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c017070 con 0x7fbb60103b10 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb567fc640 1 -- 172.21.15.39:0/213554831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5c009c30 con 0x7fbb60103b10 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb567fc640 1 -- 172.21.15.39:0/213554831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c00f620 con 0x7fbb60103b10 2024-09-10T21:55:39.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6019f410 con 0x7fbb60103b10 2024-09-10T21:55:39.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.081+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb601a5ad0 con 0x7fbb60103b10 2024-09-10T21:55:39.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 Processor -- start 2024-09-10T21:55:39.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 -- start start 2024-09-10T21:55:39.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d535244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53524a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561d5349ae60 con 0x561d535240f0 2024-09-10T21:55:39.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d5348a290 con 0x561d5352e450 2024-09-10T21:55:39.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.085+0000 7fbb697d8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561d5348e0a0 con 0x561d53539050 2024-09-10T21:55:39.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.086+0000 7fbb567fc640 1 -- 172.21.15.39:0/213554831 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fbb5c010460 con 0x7fbb60103b10 2024-09-10T21:55:39.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.086+0000 7fbb6499e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.086+0000 7fbb6499e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:41774/0 (socket says 172.21.15.39:41774) 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.086+0000 7fbb6499e640 1 -- 172.21.15.39:0/3562025983 learned_addr learned my addr 172.21.15.39:0/3562025983 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.086+0000 7fbb6519f640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53524a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb6499e640 1 -- 172.21.15.39:0/3562025983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 msgr2=0x561d53524a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb6499e640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53524a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb6499e640 1 -- 172.21.15.39:0/3562025983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 msgr2=0x561d535244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb659a0640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d535244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb6499e640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d535244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb6499e640 1 -- 172.21.15.39:0/3562025983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d531e8930 con 0x561d53539050 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb659a0640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d535244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb567fc640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 0x7fbb4c0b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb659a0640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 0x7fbb4c0b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.087+0000 7fbb567fc640 1 -- 172.21.15.39:0/213554831 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb5c0e5a80 con 0x7fbb60103b10 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.088+0000 7fbb6499e640 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb50032cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b07f6fb6bb03707c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.088+0000 7fbb4b7fe640 1 -- 172.21.15.39:0/3562025983 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5003f070 con 0x561d53539050 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.088+0000 7fbb4b7fe640 1 -- 172.21.15.39:0/3562025983 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb500316a0 con 0x561d53539050 2024-09-10T21:55:39.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.088+0000 7fbb4b7fe640 1 -- 172.21.15.39:0/3562025983 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50035070 con 0x561d53539050 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb659a0640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 0x7fbb4c0b79d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005fd0 tx=0x7fbb580094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- 172.21.15.39:0/3562025983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 msgr2=0x561d5353b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb50032cb0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- 172.21.15.39:0/3562025983 shutdown_connections 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d53539050 0x561d5353b440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53524a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3562025983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d535244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- 172.21.15.39:0/3562025983 >> 172.21.15.39:0/3562025983 conn(0x561d53521f20 msgr2=0x561d535230c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- 172.21.15.39:0/3562025983 shutdown_connections 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- 172.21.15.39:0/3562025983 wait complete. 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.089+0000 7fbb697d8740 1 -- start start 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 Processor -- start 2024-09-10T21:55:39.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d5352de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d5352b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561d532eb890 con 0x561d53539050 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d53424d40 con 0x561d5352e450 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561d5353bde0 con 0x561d535240f0 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb697d8740 10 client.0 _ll_register_callbacks cb 0x561d53488c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb659a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb659a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51306/0 (socket says 172.21.15.39:51306) 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.090+0000 7fbb659a0640 1 -- 172.21.15.39:0/87154143 learned_addr learned my addr 172.21.15.39:0/87154143 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb6519f640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d5352de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb6499e640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d5352b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 -- 172.21.15.39:0/87154143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 msgr2=0x561d5352de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d5352de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 -- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 msgr2=0x561d5352b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d5352b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 -- 172.21.15.39:0/87154143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d53545140 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb659a0640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbb58011c30 tx=0x7fbb58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611be62058d4911a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.091+0000 7fbb48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011e60 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb500316a0 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb58004b20 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb58004d20 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb697d8740 10 client.15594 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.092+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d53547ad0 con 0x561d53539050 2024-09-10T21:55:39.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb500316a0 con 0x561d53539050 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbb5801e6c0 con 0x561d53539050 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 10 client.15594 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 20 client.15594 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535493d0 0x561d5354b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 4 client.15594 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.093+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d5349cdb0 con 0x561d535493d0 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.094+0000 7fbb6519f640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535493d0 0x561d5354b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.094+0000 7fbb6519f640 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535493d0 0x561d5354b830 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a56bfc301349409 server_cookie=e59bba810f77a9f2 in_seq=0 out_seq=0 2024-09-10T21:55:39.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.094+0000 7fbb48ff9640 10 client.15594 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb48ff9640 1 -- 172.21.15.39:0/87154143 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d5349cdb0 con 0x561d535493d0 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb48ff9640 10 client.15594 handle_command_reply: tid=0 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 client.15594 shutdown 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 msgr2=0x561d5352bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbb58011c30 tx=0x7fbb58004a40 comp rx=0 tx=0).stop 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 shutdown_connections 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535493d0 0x561d5354b830 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d5352bad0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d5352b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 --2- 172.21.15.39:0/87154143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d5352de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb48ff9640 0 client.15594 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.095+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 >> 172.21.15.39:0/87154143 conn(0x561d53521f20 msgr2=0x561d53520750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.096+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 shutdown_connections 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.096+0000 7fbb697d8740 1 -- 172.21.15.39:0/87154143 wait complete. 2024-09-10T21:55:39.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.096+0000 7fbb697d8740 20 client.15594 trim_cache size 0 max 16384 2024-09-10T21:55:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 Processor -- start 2024-09-10T21:55:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 -- start start 2024-09-10T21:55:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d53522dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53523300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601abf90 con 0x561d53539050 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601adad0 con 0x561d5352e450 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb697d8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ac660 con 0x561d535240f0 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb659a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb659a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51308/0 (socket says 172.21.15.39:51308) 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb659a0640 1 -- 172.21.15.39:0/3176724915 learned_addr learned my addr 172.21.15.39:0/3176724915 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb6519f640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d53522dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.128+0000 7fbb6499e640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53523300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 -- 172.21.15.39:0/3176724915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 msgr2=0x561d53522dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d53522dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 -- 172.21.15.39:0/3176724915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 msgr2=0x561d53523300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53523300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 -- 172.21.15.39:0/3176724915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5352e1c0 con 0x561d53539050 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb6499e640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53523300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb659a0640 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbb58026420 tx=0x7fbb58004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd7798ef780c66e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb4affd640 1 -- 172.21.15.39:0/3176724915 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011c60 con 0x561d53539050 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb4affd640 1 -- 172.21.15.39:0/3176724915 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5801e8d0 con 0x561d53539050 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.129+0000 7fbb4affd640 1 -- 172.21.15.39:0/3176724915 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58026b10 con 0x561d53539050 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 -- 172.21.15.39:0/3176724915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 msgr2=0x561d53529bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbb58026420 tx=0x7fbb58004b60 comp rx=0 tx=0).stop 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 -- 172.21.15.39:0/3176724915 shutdown_connections 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d53539050 0x561d53529bc0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d5352e450 0x561d53523300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 --2- 172.21.15.39:0/3176724915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d535240f0 0x561d53522dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.130+0000 7fbb697d8740 1 -- 172.21.15.39:0/3176724915 >> 172.21.15.39:0/3176724915 conn(0x561d53521f20 msgr2=0x561d53539b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.131+0000 7fbb697d8740 1 -- 172.21.15.39:0/3176724915 shutdown_connections 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.131+0000 7fbb697d8740 1 -- 172.21.15.39:0/3176724915 wait complete. 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.131+0000 7fbb697d8740 1 -- start start 2024-09-10T21:55:39.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.131+0000 7fbb697d8740 1 Processor -- start 2024-09-10T21:55:39.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb6519f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb6519f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51312/0 (socket says 172.21.15.39:51312) 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb6519f640 1 -- 172.21.15.39:0/2984857558 learned_addr learned my addr 172.21.15.39:0/2984857558 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d5352e450 0x561d5353e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d53539050 0x561d535af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ad400 con 0x561d535240f0 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601acd30 con 0x561d53539050 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601a9f70 con 0x561d5352e450 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb6499e640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d5352e450 0x561d5353e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.132+0000 7fbb659a0640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d53539050 0x561d535af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb697d8740 10 client.0 _ll_register_callbacks cb 0x7fbb58009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 -- 172.21.15.39:0/2984857558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d5352e450 msgr2=0x561d5353e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d5352e450 0x561d5353e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 -- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d53539050 msgr2=0x561d535af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d53539050 0x561d535af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d535afb30 con 0x561d535240f0 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d53498860 con 0x561d535240f0 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb6519f640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0abd90 tx=0x7fbb5c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7930d8a5073999f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb48ff9640 10 client.15600 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb48ff9640 1 -- 172.21.15.39:0/2984857558 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c020040 con 0x561d535240f0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb48ff9640 1 -- 172.21.15.39:0/2984857558 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb5c0971a0 con 0x561d535240f0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb48ff9640 1 -- 172.21.15.39:0/2984857558 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c0973a0 con 0x561d535240f0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb697d8740 10 client.15600 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.133+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=27}) -- 0x561d535b6e60 con 0x561d535240f0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb48ff9640 1 -- 172.21.15.39:0/2984857558 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbb5c0ab2f0 con 0x561d535240f0 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 10 client.15600 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 20 client.15600 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535b7480 0x561d535b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 4 client.15600 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:55:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561d53495c90 con 0x561d535b7480 2024-09-10T21:55:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.134+0000 7fbb6499e640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535b7480 0x561d535b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.135+0000 7fbb48ff9640 10 client.15600 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.135+0000 7fbb6499e640 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535b7480 0x561d535b98a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c9ed74ece49a7e server_cookie=b5f740969f8876d8 in_seq=0 out_seq=0 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.136+0000 7fbb48ff9640 1 -- 172.21.15.39:0/2984857558 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561d53495c90 con 0x561d535b7480 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.136+0000 7fbb48ff9640 10 client.15600 handle_command_reply: tid=0 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 client.15600 shutdown 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 msgr2=0x561d5353db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0abd90 tx=0x7fbb5c010cb0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 shutdown_connections 2024-09-10T21:55:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561d535b7480 0x561d535b98a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb48ff9640 0 client.15600 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d53539050 0x561d535af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561d5352e450 0x561d5353e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 --2- 172.21.15.39:0/2984857558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d535240f0 0x561d5353db40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.137+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 >> 172.21.15.39:0/2984857558 conn(0x561d53521f20 msgr2=0x561d53539b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.138+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 shutdown_connections 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.138+0000 7fbb697d8740 1 -- 172.21.15.39:0/2984857558 wait complete. 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.138+0000 7fbb697d8740 20 client.15600 trim_cache size 0 max 16384 2024-09-10T21:55:39.143 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:55:39.144 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:55:39.144 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "70562817-5291-43eb-866f-3b35e96de93b", 2024-09-10T21:55:39.144 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:55:39.144 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:55:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 msgr2=0x7fbb4c0b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 0x7fbb4c0b79d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005fd0 tx=0x7fbb580094d0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 msgr2=0x7fbb60199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00d950 tx=0x7fbb5c00de10 comp rx=0 tx=0).stop 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 shutdown_connections 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb4c0b5510 0x7fbb4c0b79d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6010cf70 0x7fbb6019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60104430 0x7fbb601995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 --2- 172.21.15.39:0/213554831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb60103b10 0x7fbb60199070 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:39.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 >> 172.21.15.39:0/213554831 conn(0x7fbb600fd5b0 msgr2=0x7fbb600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:39.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 shutdown_connections 2024-09-10T21:55:39.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:39.139+0000 7fbb661a1640 1 -- 172.21.15.39:0/213554831 wait complete. 2024-09-10T21:55:39.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:55:40.105 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:55:40.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.600+0000 7f3198f0f640 1 -- 172.21.15.39:0/3532470963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 msgr2=0x7f319410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.600+0000 7f3198f0f640 1 --2- 172.21.15.39:0/3532470963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319410ee70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3188009900 tx=0x7f318802a410 comp rx=0 tx=0).stop 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 -- 172.21.15.39:0/3532470963 shutdown_connections 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 --2- 172.21.15.39:0/3532470963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f319410f3b0 0x7f31941117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 --2- 172.21.15.39:0/3532470963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319410ee70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 --2- 172.21.15.39:0/3532470963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31940754e0 0x7f31940758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 -- 172.21.15.39:0/3532470963 >> 172.21.15.39:0/3532470963 conn(0x7f31940fe830 msgr2=0x7f3194100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 -- 172.21.15.39:0/3532470963 shutdown_connections 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.601+0000 7f3198f0f640 1 -- 172.21.15.39:0/3532470963 wait complete. 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.602+0000 7f3198f0f640 1 Processor -- start 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.602+0000 7f3198f0f640 1 -- start start 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 0x7f319419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 0x7f31941a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53274/0 (socket says 172.21.15.39:53274) 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f319259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 0x7f319419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f319259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 0x7f319419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:57236/0 (socket says 172.21.15.39:57236) 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3191d9b640 1 -- 172.21.15.39:0/2404737178 learned_addr learned my addr 172.21.15.39:0/2404737178 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3194114f60 con 0x7f3194075e00 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3194114de0 con 0x7f319410f3b0 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.603+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f31941150e0 con 0x7f31940754e0 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 0x7f31941a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 -- 172.21.15.39:0/2404737178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 msgr2=0x7f319419b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 0x7f319419b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 -- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 msgr2=0x7f319419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941a1560 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3191d9b640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.604+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 0x7f31941a0d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f318c00ca80 tx=0x7f318c00cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.605+0000 7f31837fe640 1 -- 172.21.15.39:0/2404737178 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c007d90 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.605+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941a1850 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.605+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941a7f10 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.605+0000 7f31837fe640 1 -- 172.21.15.39:0/2404737178 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f318c003e40 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.605+0000 7f31837fe640 1 -- 172.21.15.39:0/2404737178 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c00f6b0 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.608+0000 7f319b2e4740 1 Processor -- start 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.609+0000 7f31837fe640 1 -- 172.21.15.39:0/2404737178 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f318c004000 con 0x7f319410f3b0 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.609+0000 7f319b2e4740 1 -- start start 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af851860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 0x5599af860120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5599af7c7e50 con 0x5599af85dd30 2024-09-10T21:55:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599af7b7280 con 0x5599af851da0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f31837fe640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 0x7f317c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319b2e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5599af7bb090 con 0x5599af851480 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:49674/0 (socket says 172.21.15.39:49674) 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.610+0000 7f319259c640 1 -- 172.21.15.39:0/3814904938 learned_addr learned my addr 172.21.15.39:0/3814904938 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f31837fe640 1 -- 172.21.15.39:0/2404737178 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f318c0e5db0 con 0x7f319410f3b0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 0x7f317c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 0x5599af860120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f319259c640 1 -- 172.21.15.39:0/3814904938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 msgr2=0x5599af851860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f319259c640 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af851860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f319259c640 1 -- 172.21.15.39:0/3814904938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 msgr2=0x5599af860120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f319259c640 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 0x5599af860120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f319259c640 1 -- 172.21.15.39:0/3814904938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599af515650 con 0x5599af851da0 2024-09-10T21:55:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f3192d9d640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 0x7f317c0b7830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f318c00a2e0 tx=0x7f318c004320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.611+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 0x5599af860120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.612+0000 7f319259c640 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f318400bd50 tx=0x7f31840107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a5a7ab3ab1b195 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.612+0000 7f3180ff9640 1 -- 172.21.15.39:0/3814904938 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184005220 con 0x5599af851da0 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.612+0000 7f3180ff9640 1 -- 172.21.15.39:0/3814904938 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f318400be40 con 0x5599af851da0 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.612+0000 7f3180ff9640 1 -- 172.21.15.39:0/3814904938 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31840117c0 con 0x5599af851da0 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 -- 172.21.15.39:0/3814904938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 msgr2=0x5599af85d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f318400bd50 tx=0x7f31840107a0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 -- 172.21.15.39:0/3814904938 shutdown_connections 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af85dd30 0x5599af860120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851da0 0x5599af85d7f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3814904938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af851860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.613+0000 7f319b2e4740 1 -- 172.21.15.39:0/3814904938 >> 172.21.15.39:0/3814904938 conn(0x5599af84f2b0 msgr2=0x5599af850450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.614+0000 7f319b2e4740 1 -- 172.21.15.39:0/3814904938 shutdown_connections 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.614+0000 7f319b2e4740 1 -- 172.21.15.39:0/3814904938 wait complete. 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.614+0000 7f319b2e4740 1 -- start start 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.615+0000 7f319b2e4740 1 Processor -- start 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.615+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.615+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af85aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.615+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f319b2e4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5599af618700 con 0x5599af851da0 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f319b2e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599af752110 con 0x5599af85dd30 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f319b2e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5599af8609b0 con 0x5599af851480 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:57250/0 (socket says 172.21.15.39:57250) 2024-09-10T21:55:40.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 -- 172.21.15.39:0/3601832056 learned_addr learned my addr 172.21.15.39:0/3601832056 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f319b2e4740 10 client.0 _ll_register_callbacks cb 0x5599af76b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f319259c640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af85aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 -- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 msgr2=0x5599af85b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 -- 172.21.15.39:0/3601832056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 msgr2=0x5599af85aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af85aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.616+0000 7f3191d9b640 1 -- 172.21.15.39:0/3601832056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599af77fc40 con 0x5599af851480 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f3191d9b640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f3188009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49cc4864de416c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f3179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188035070 con 0x5599af851480 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31880035f0 con 0x5599af851480 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599af7c9da0 con 0x5599af851480 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31880037f0 con 0x5599af851480 2024-09-10T21:55:40.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f319b2e4740 10 client.25240 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.617+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599af86c300 con 0x5599af851480 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.618+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5599af7c9da0 con 0x5599af851480 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.618+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3188049020 con 0x5599af851480 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.618+0000 7f319b2e4740 10 client.25240 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.618+0000 7f319b2e4740 10 client.25240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.618+0000 7f319b2e4740 20 client.25240 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af86d810 0x5599af86fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f319b2e4740 4 client.25240 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599af7c5850 con 0x5599af86d810 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f319259c640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af86d810 0x5599af86fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f319259c640 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af86d810 0x5599af86fc30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64da865079e7b477 server_cookie=45ed9ea04edd0893 in_seq=0 out_seq=0 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.619+0000 7f3179ffb640 10 client.25240 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.620+0000 7f3179ffb640 1 -- 172.21.15.39:0/3601832056 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599af7c5850 con 0x5599af86d810 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.620+0000 7f3179ffb640 10 client.25240 handle_command_reply: tid=0 2024-09-10T21:55:40.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.620+0000 7f319b2e4740 1 client.25240 shutdown 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.620+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 msgr2=0x5599af85d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.620+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f3188009260 comp rx=0 tx=0).stop 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 shutdown_connections 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af86d810 0x5599af86fc30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af85aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 --2- 172.21.15.39:0/3601832056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851480 0x5599af85d5f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 >> 172.21.15.39:0/3601832056 conn(0x5599af84f2b0 msgr2=0x5599af854e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f3179ffb640 0 client.25240 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 shutdown_connections 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 1 -- 172.21.15.39:0/3601832056 wait complete. 2024-09-10T21:55:40.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.621+0000 7f319b2e4740 20 client.25240 trim_cache size 0 max 16384 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 Processor -- start 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 -- start start 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851480 0x5599af8592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f317400e290 con 0x5599af851480 2024-09-10T21:55:40.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f317400fdd0 con 0x5599af85dd30 2024-09-10T21:55:40.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319b2e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f317400e960 con 0x5599af851da0 2024-09-10T21:55:40.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f3191d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851480 0x5599af8592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:57266/0 (socket says 172.21.15.39:57266) 2024-09-10T21:55:40.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.656+0000 7f319259c640 1 -- 172.21.15.39:0/1931582084 learned_addr learned my addr 172.21.15.39:0/1931582084 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:40.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 -- 172.21.15.39:0/1931582084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 msgr2=0x5599af85f120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:55:40.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 -- 172.21.15.39:0/1931582084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851480 msgr2=0x5599af8592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851480 0x5599af8592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 -- 172.21.15.39:0/1931582084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599af85a7f0 con 0x5599af851da0 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f319259c640 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f318400bd50 tx=0x7f3184005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c04417326b90a028 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f317bfff640 1 -- 172.21.15.39:0/1931582084 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318400b410 con 0x5599af851da0 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f317bfff640 1 -- 172.21.15.39:0/1931582084 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31840054f0 con 0x5599af851da0 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.657+0000 7f317bfff640 1 -- 172.21.15.39:0/1931582084 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184013660 con 0x5599af851da0 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.658+0000 7f319b2e4740 1 -- 172.21.15.39:0/1931582084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 msgr2=0x5599af859800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.658+0000 7f319b2e4740 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f318400bd50 tx=0x7f3184005fb0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 -- 172.21.15.39:0/1931582084 shutdown_connections 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af85dd30 0x5599af85f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af851da0 0x5599af859800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 --2- 172.21.15.39:0/1931582084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851480 0x5599af8592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 -- 172.21.15.39:0/1931582084 >> 172.21.15.39:0/1931582084 conn(0x5599af84f2b0 msgr2=0x5599af850300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 -- 172.21.15.39:0/1931582084 shutdown_connections 2024-09-10T21:55:40.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 -- 172.21.15.39:0/1931582084 wait complete. 2024-09-10T21:55:40.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.659+0000 7f319b2e4740 1 -- start start 2024-09-10T21:55:40.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319b2e4740 1 Processor -- start 2024-09-10T21:55:40.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851480 0x5599af865ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53318/0 (socket says 172.21.15.39:53318) 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319b2e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af85dd30 0x5599af860c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.660+0000 7f319259c640 1 -- 172.21.15.39:0/4009525873 learned_addr learned my addr 172.21.15.39:0/4009525873 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f3191d9b640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851480 0x5599af865ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f317400f700 con 0x5599af851da0 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f317400f030 con 0x5599af851480 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f317400c320 con 0x5599af85dd30 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f3191d9b640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af85dd30 0x5599af860c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319b2e4740 10 client.0 _ll_register_callbacks cb 0x7f3188009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 -- 172.21.15.39:0/4009525873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af85dd30 msgr2=0x5599af860c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af85dd30 0x5599af860c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 -- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851480 msgr2=0x5599af865ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:40.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851480 0x5599af865ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599af8611d0 con 0x5599af851da0 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f319259c640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f318402c000 tx=0x7f318400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5a29dc617c9dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.661+0000 7f3179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184038030 con 0x5599af851da0 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31840054f0 con 0x5599af851da0 2024-09-10T21:55:40.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31840132a0 con 0x5599af851da0 2024-09-10T21:55:40.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3184004bb0 con 0x5599af851da0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 10 client.15618 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599af8daef0 con 0x5599af851da0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31840054f0 con 0x5599af851da0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3184013660 con 0x5599af851da0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 10 client.15618 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 20 client.15618 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af8db470 0x5599af8dd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 4 client.15618 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.662+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5599af7c2c80 con 0x5599af8db470 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.663+0000 7f3191d9b640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af8db470 0x5599af8dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.663+0000 7f3191d9b640 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af8db470 0x5599af8dd890 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1129e905685c860 server_cookie=c7a4de6c137cec7e in_seq=0 out_seq=0 2024-09-10T21:55:40.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.663+0000 7f3179ffb640 10 client.15618 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f3179ffb640 1 -- 172.21.15.39:0/4009525873 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x5599af7c2c80 con 0x5599af8db470 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f3179ffb640 10 client.15618 handle_command_reply: tid=0 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 client.15618 shutdown 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 msgr2=0x5599af866220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f318402c000 tx=0x7f318400b710 comp rx=0 tx=0).stop 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 shutdown_connections 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5599af8db470 0x5599af8dd890 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599af85dd30 0x5599af860c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f3179ffb640 0 client.15618 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599af851da0 0x5599af866220 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 --2- 172.21.15.39:0/4009525873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599af851480 0x5599af865ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 >> 172.21.15.39:0/4009525873 conn(0x5599af84f2b0 msgr2=0x5599af850300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 shutdown_connections 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 1 -- 172.21.15.39:0/4009525873 wait complete. 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.664+0000 7f319b2e4740 20 client.15618 trim_cache size 0 max 16384 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "70562817-5291-43eb-866f-3b35e96de93b", 2024-09-10T21:55:40.669 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:55:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:55:40.671 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.665+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 msgr2=0x7f317c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.665+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 0x7f317c0b7830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f318c00a2e0 tx=0x7f318c004320 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.665+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 msgr2=0x7f31941a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.665+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 0x7f31941a0d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f318c00ca80 tx=0x7f318c00cf40 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 shutdown_connections 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f317c0b5370 0x7f317c0b7830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f319410f3b0 0x7f31941a0d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3194075e00 0x7f319419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 --2- 172.21.15.39:0/2404737178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31940754e0 0x7f319419b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 >> 172.21.15.39:0/2404737178 conn(0x7f31940fe830 msgr2=0x7f3194111580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 shutdown_connections 2024-09-10T21:55:40.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:55:40.666+0000 7f3198f0f640 1 -- 172.21.15.39:0/2404737178 wait complete. 2024-09-10T21:55:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:40 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:55:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:40 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:40 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:55:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:40 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:40 smithi070 ceph-mon[34909]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:40 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:55:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:40 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:40 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:55:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:40 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:40 smithi039 ceph-mon[30872]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:40 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:55:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:40 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:40 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:55:40.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:40 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:55:40.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:40 smithi173 ceph-mon[35294]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-10T21:55:41.408 INFO:tasks.cephfs.filesystem:scrub status for tag:70562817-5291-43eb-866f-3b35e96de93b - {'path': '/', 'tag': '70562817-5291-43eb-866f-3b35e96de93b', 'options': 'recursive,force'} 2024-09-10T21:55:41.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:41 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:55:41.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:41 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:55:41.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:41 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:55:42.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:42 smithi070 ceph-mon[34909]: pgmap v362: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T21:55:42.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:42 smithi039 ceph-mon[30872]: pgmap v362: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T21:55:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:42 smithi173 ceph-mon[35294]: pgmap v362: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T21:55:44.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:44 smithi070 ceph-mon[34909]: pgmap v363: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-10T21:55:44.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:44 smithi039 ceph-mon[30872]: pgmap v363: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-10T21:55:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:44 smithi173 ceph-mon[35294]: pgmap v363: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-10T21:55:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/3262174455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08101860 msgr2=0x7fbb08101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/3262174455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08101860 0x7fbb08101c60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009930 tx=0x7fbaf802a420 comp rx=0 tx=0).stop 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/3262174455 shutdown_connections 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/3262174455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08103370 0x7fbb08109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/3262174455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 0x7fbb08102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/3262174455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08101860 0x7fbb08101c60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/3262174455 >> 172.21.15.39:0/3262174455 conn(0x7fbb080fd140 msgr2=0x7fbb080ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/3262174455 shutdown_connections 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.639+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/3262174455 wait complete. 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 Processor -- start 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 -- start start 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08101860 0x7fbb0819afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 0x7fbb0819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810d4d0 con 0x7fbb08103370 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810d350 con 0x7fbb08101860 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb0d5bb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810d650 con 0x7fbb081029b0 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53338/0 (socket says 172.21.15.39:53338) 2024-09-10T21:55:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 -- 172.21.15.39:0/2371381662 learned_addr learned my addr 172.21.15.39:0/2371381662 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08101860 0x7fbb0819afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 0x7fbb0819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 -- 172.21.15.39:0/2371381662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 msgr2=0x7fbb0819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 0x7fbb0819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.640+0000 7fbb077fe640 1 -- 172.21.15.39:0/2371381662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08101860 msgr2=0x7fbb0819afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbb077fe640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08101860 0x7fbb0819afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbb077fe640 1 -- 172.21.15.39:0/2371381662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0819cb10 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbb077fe640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000cad0 tx=0x7fbb0000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbaeffff640 1 -- 172.21.15.39:0/2371381662 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000ae20 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0819ce00 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbaeffff640 1 -- 172.21.15.39:0/2371381662 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb00005020 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbaeffff640 1 -- 172.21.15.39:0/2371381662 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000f6b0 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.641+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb081a34d0 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 Processor -- start 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbaeffff640 1 -- 172.21.15.39:0/2371381662 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fbb000054f0 con 0x7fbb08103370 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 -- start start 2024-09-10T21:55:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a733d860 0x5581a733fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a7342bd0 0x5581a7345090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5581a72af6f0 con 0x5581a7340190 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5581a729eb20 con 0x5581a733d860 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb10468740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5581a72a2930 con 0x5581a7342bd0 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53350/0 (socket says 172.21.15.39:53350) 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 -- 172.21.15.39:0/1640817268 learned_addr learned my addr 172.21.15.39:0/1640817268 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb067fc640 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a7342bd0 0x5581a7345090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb067fc640 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a733d860 0x5581a733fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 -- 172.21.15.39:0/1640817268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a7342bd0 msgr2=0x5581a7345090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a7342bd0 0x5581a7345090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 -- 172.21.15.39:0/1640817268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a733d860 msgr2=0x5581a733fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a733d860 0x5581a733fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbaeffff640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 0x7fbaf00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.644+0000 7fbb06ffd640 1 -- 172.21.15.39:0/1640817268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a7264530 con 0x5581a7340190 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 0x7fbaf00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbaf802a940 tx=0x7fbaf8031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752e66211dae28fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbaeffff640 1 -- 172.21.15.39:0/2371381662 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb000e5cf0 con 0x7fbb08103370 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbaed7fa640 1 -- 172.21.15.39:0/1640817268 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8035030 con 0x5581a7340190 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbaed7fa640 1 -- 172.21.15.39:0/1640817268 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf8040070 con 0x5581a7340190 2024-09-10T21:55:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.645+0000 7fbaed7fa640 1 -- 172.21.15.39:0/1640817268 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8003b20 con 0x5581a7340190 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 0x7fbaf00b7830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00bfd0 tx=0x7fbafc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- 172.21.15.39:0/1640817268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 msgr2=0x5581a7342580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbaf802a940 tx=0x7fbaf8031c40 comp rx=0 tx=0).stop 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- 172.21.15.39:0/1640817268 shutdown_connections 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a7342bd0 0x5581a7345090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a7342580 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 --2- 172.21.15.39:0/1640817268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a733d860 0x5581a733fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- 172.21.15.39:0/1640817268 >> 172.21.15.39:0/1640817268 conn(0x5581a73389b0 msgr2=0x5581a7339740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- 172.21.15.39:0/1640817268 shutdown_connections 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- 172.21.15.39:0/1640817268 wait complete. 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 -- start start 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.646+0000 7fbb10468740 1 Processor -- start 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7346e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a73474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5581a71d6ab0 con 0x5581a7342bd0 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5581a7244730 con 0x5581a7340190 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5581a7345b50 con 0x5581a733d860 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb10468740 10 client.0 _ll_register_callbacks cb 0x5581a72986b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53364/0 (socket says 172.21.15.39:53364) 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 -- 172.21.15.39:0/1920410804 learned_addr learned my addr 172.21.15.39:0/1920410804 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7346e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb067fc640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a73474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 -- 172.21.15.39:0/1920410804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 msgr2=0x5581a7346e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7346e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 -- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 msgr2=0x5581a73474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a73474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 -- 172.21.15.39:0/1920410804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a7000790 con 0x5581a7342bd0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7346e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb000a89e0 tx=0x7fbb000e3b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17c50bf4b44cda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.647+0000 7fbaeaff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00093da0 con 0x5581a7342bd0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaf8040070 con 0x5581a7342bd0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb000cf0c0 con 0x5581a7342bd0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb000b58f0 con 0x5581a7342bd0 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 10 client.15630 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581a7079620 con 0x5581a7342bd0 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf8040070 con 0x5581a7342bd0 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbb000a6ba0 con 0x5581a7342bd0 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 10 client.15630 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 20 client.15630 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a7354b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 4 client.15630 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.648+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581a72b1640 con 0x5581a7352710 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.649+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a7354b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.649+0000 7fbaeaff5640 10 client.15630 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.649+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a7354b40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=955291016a1413a5 server_cookie=f9d59be58689533e in_seq=0 out_seq=0 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbaeaff5640 1 -- 172.21.15.39:0/1920410804 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581a72b1640 con 0x5581a7352710 2024-09-10T21:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbaeaff5640 10 client.15630 handle_command_reply: tid=0 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 client.15630 shutdown 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 msgr2=0x5581a73480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb000a89e0 tx=0x7fbb000e3b30 comp rx=0 tx=0).stop 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 shutdown_connections 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a7354b40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbaeaff5640 0 client.15630 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a73480a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a73474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 --2- 172.21.15.39:0/1920410804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7346e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 >> 172.21.15.39:0/1920410804 conn(0x5581a73389b0 msgr2=0x5581a7337bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 shutdown_connections 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 1 -- 172.21.15.39:0/1920410804 wait complete. 2024-09-10T21:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.650+0000 7fbb10468740 20 client.15630 trim_cache size 0 max 16384 2024-09-10T21:55:45.677 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 96% (11711/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 Processor -- start 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 -- start start 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7348080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a7346e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081ac0b0 con 0x5581a7342bd0 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081adbf0 con 0x5581a7340190 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb10468740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081ac780 con 0x5581a733d860 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53378/0 (socket says 172.21.15.39:53378) 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.679+0000 7fbb077fe640 1 -- 172.21.15.39:0/1556428062 learned_addr learned my addr 172.21.15.39:0/1556428062 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7348080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb067fc640 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a7346e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 -- 172.21.15.39:0/1556428062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 msgr2=0x5581a7348080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7348080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 -- 172.21.15.39:0/1556428062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 msgr2=0x5581a7346e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a7346e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 -- 172.21.15.39:0/1556428062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a73342d0 con 0x5581a7342bd0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbb077fe640 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ac110 tx=0x7fbb0000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4088bb769fb15ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbaecff9640 1 -- 172.21.15.39:0/1556428062 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000d3190 con 0x5581a7342bd0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbaecff9640 1 -- 172.21.15.39:0/1556428062 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb00093ba0 con 0x5581a7342bd0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.680+0000 7fbaecff9640 1 -- 172.21.15.39:0/1556428062 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000ab670 con 0x5581a7342bd0 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- 172.21.15.39:0/1556428062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 msgr2=0x5581a733ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ac110 tx=0x7fbb0000ca60 comp rx=0 tx=0).stop 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- 172.21.15.39:0/1556428062 shutdown_connections 2024-09-10T21:55:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7342bd0 0x5581a733ccc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7340190 0x5581a7346e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 --2- 172.21.15.39:0/1556428062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a7348080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- 172.21.15.39:0/1556428062 >> 172.21.15.39:0/1556428062 conn(0x5581a73389b0 msgr2=0x5581a73395d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- 172.21.15.39:0/1556428062 shutdown_connections 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- 172.21.15.39:0/1556428062 wait complete. 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 -- start start 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.681+0000 7fbb10468740 1 Processor -- start 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a734bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7342bd0 0x5581a734cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081ad520 con 0x5581a7340190 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081ace50 con 0x5581a7342bd0 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb081aa090 con 0x5581a733d860 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 10 client.0 _ll_register_callbacks cb 0x7fbb000a82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53380/0 (socket says 172.21.15.39:53380) 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 -- 172.21.15.39:0/2628981109 learned_addr learned my addr 172.21.15.39:0/2628981109 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a734bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb077fe640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7342bd0 0x5581a734cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 -- 172.21.15.39:0/2628981109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 msgr2=0x5581a734bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a734bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 -- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7342bd0 msgr2=0x5581a734cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7342bd0 0x5581a734cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 -- 172.21.15.39:0/2628981109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a734d790 con 0x5581a7340190 2024-09-10T21:55:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb067fc640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbafc012800 tx=0x7fbafc005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6c1d0ee8218268 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbaeaff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc02f060 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbafc01f690 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.682+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb00093ba0 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbafc01f890 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 10 client.15636 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581a734ebd0 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb00093ba0 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbafc020940 con 0x5581a7340190 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 10 client.15636 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 20 client.15636 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a73c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 4 client.15636 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581a72ad0f0 con 0x5581a7352710 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.683+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a73c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.684+0000 7fbb06ffd640 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a73c1af0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343f9c7427734e6c server_cookie=da03af17e7ad550e in_seq=0 out_seq=0 2024-09-10T21:55:45.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.684+0000 7fbaeaff5640 10 client.15636 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbaeaff5640 1 -- 172.21.15.39:0/2628981109 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581a72ad0f0 con 0x5581a7352710 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbaeaff5640 10 client.15636 handle_command_reply: tid=0 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 client.15636 shutdown 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 msgr2=0x5581a734c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbafc012800 tx=0x7fbafc005c90 comp rx=0 tx=0).stop 2024-09-10T21:55:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 shutdown_connections 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5581a7352710 0x5581a73c1af0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5581a7342bd0 0x5581a734cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbaeaff5640 0 client.15636 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581a7340190 0x5581a734c390 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 --2- 172.21.15.39:0/2628981109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581a733d860 0x5581a734bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 >> 172.21.15.39:0/2628981109 conn(0x5581a73389b0 msgr2=0x5581a7342fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 shutdown_connections 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 1 -- 172.21.15.39:0/2628981109 wait complete. 2024-09-10T21:55:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.688+0000 7fbb10468740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T21:55:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:55:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:55:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:55:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 msgr2=0x7fbaf00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 0x7fbaf00b7830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00bfd0 tx=0x7fbafc00b390 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 msgr2=0x7fbb0819c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000cad0 tx=0x7fbb0000cf90 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 shutdown_connections 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbaf00b5370 0x7fbaf00b7830 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb08103370 0x7fbb0819c250 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb081029b0 0x7fbb0819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 --2- 172.21.15.39:0/2371381662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08101860 0x7fbb0819afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 >> 172.21.15.39:0/2371381662 conn(0x7fbb080fd140 msgr2=0x7fbb080fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 shutdown_connections 2024-09-10T21:55:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:45.689+0000 7fbb0d5bb640 1 -- 172.21.15.39:0/2371381662 wait complete. 2024-09-10T21:55:46.685 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-10T21:55:46.686 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:46.687 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:55:46.690 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T21:55:46.715 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T21:55:46.717 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T21:55:46.717 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T21:55:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:46 smithi070 ceph-mon[34909]: pgmap v364: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:55:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:46 smithi039 ceph-mon[30872]: pgmap v364: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:55:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:46 smithi173 ceph-mon[35294]: pgmap v364: 97 pgs: 97 active+clean; 671 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:55:47.383 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T21:55:47.445 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T21:55:47.488 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T21:55:47.490 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T21:55:47.490 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T21:55:47.530 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T21:55:47.533 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T21:55:47.533 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T21:55:47.590 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-10T21:55:47.591 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-10T21:55:47.591 DEBUG:teuthology.orchestra.run.smithi039:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-10T21:55:47.654 INFO:tasks.workunit.client.0.smithi039.stdout:getting blogbench 2024-09-10T21:55:47.654 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo 'getting blogbench' 2024-09-10T21:55:47.654 INFO:tasks.workunit.client.0.smithi039.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-10T21:55:47.679 INFO:tasks.workunit.client.0.smithi039.stderr:--2024-09-10 21:55:47-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-10T21:55:47.689 INFO:tasks.workunit.client.0.smithi039.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-10T21:55:47.709 INFO:tasks.workunit.client.0.smithi039.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-10T21:55:47.730 INFO:tasks.workunit.client.0.smithi039.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-10T21:55:47.730 INFO:tasks.workunit.client.0.smithi039.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-10T21:55:47.731 INFO:tasks.workunit.client.0.smithi039.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-10T21:55:47.734 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:47.772 INFO:tasks.workunit.client.0.smithi039.stderr: 0K .......... .......... .......... .......... .......... 49% 1.23M 0s 2024-09-10T21:55:47.791 INFO:tasks.workunit.client.0.smithi039.stderr: 50K .......... .......... .......... .......... .......... 99% 2.41M 0s 2024-09-10T21:55:47.791 INFO:tasks.workunit.client.0.smithi039.stderr: 100K 100% 1.74T=0.06s 2024-09-10T21:55:47.792 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:47.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-10 21:55:47 (1.65 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-10T21:55:47.792 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-10T21:55:47.792 INFO:tasks.workunit.client.0.smithi039.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-10T21:55:47.824 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/ 2024-09-10T21:55:47.825 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/m4/ 2024-09-10T21:55:47.826 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-10T21:55:47.827 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/man/ 2024-09-10T21:55:47.827 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/man/blogbench.8 2024-09-10T21:55:47.828 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/man/Makefile.am 2024-09-10T21:55:47.829 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/man/Makefile.in 2024-09-10T21:55:47.830 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/ 2024-09-10T21:55:47.831 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-10T21:55:47.832 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-10T21:55:47.833 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/blogbench.c 2024-09-10T21:55:47.833 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/blogbench.h 2024-09-10T21:55:47.834 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-10T21:55:47.835 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-10T21:55:47.836 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-10T21:55:47.837 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-10T21:55:47.838 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-10T21:55:47.839 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/Makefile.am 2024-09-10T21:55:47.840 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/Makefile.in 2024-09-10T21:55:47.840 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/process.c 2024-09-10T21:55:47.841 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/globals.h 2024-09-10T21:55:47.842 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/commenter.c 2024-09-10T21:55:47.843 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/rewriter.c 2024-09-10T21:55:47.844 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/reader.c 2024-09-10T21:55:47.845 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/writer.c 2024-09-10T21:55:47.846 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/src/helpers.c 2024-09-10T21:55:47.846 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/NEWS 2024-09-10T21:55:47.847 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/compile 2024-09-10T21:55:47.848 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/depcomp 2024-09-10T21:55:47.849 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/aclocal.m4 2024-09-10T21:55:47.850 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/README 2024-09-10T21:55:47.851 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/configure 2024-09-10T21:55:47.854 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/configure.ac 2024-09-10T21:55:47.855 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/config.guess 2024-09-10T21:55:47.856 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/install-sh 2024-09-10T21:55:47.857 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/config.sub 2024-09-10T21:55:47.858 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/missing 2024-09-10T21:55:47.859 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/mkinstalldirs 2024-09-10T21:55:47.860 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/Makefile.am 2024-09-10T21:55:47.861 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/Makefile.in 2024-09-10T21:55:47.861 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/config.h.in 2024-09-10T21:55:47.862 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/AUTHORS 2024-09-10T21:55:47.863 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/INSTALL 2024-09-10T21:55:47.864 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/ChangeLog 2024-09-10T21:55:47.865 INFO:tasks.workunit.client.0.smithi039.stdout:blogbench-1.0/COPYING 2024-09-10T21:55:47.866 INFO:tasks.workunit.client.0.smithi039.stderr:+ cd blogbench-1.0/ 2024-09-10T21:55:47.866 INFO:tasks.workunit.client.0.smithi039.stdout:making blogbench 2024-09-10T21:55:47.866 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo 'making blogbench' 2024-09-10T21:55:47.867 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./configure 2024-09-10T21:55:47.966 INFO:tasks.workunit.client.0.smithi039.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T21:55:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:48 smithi070 ceph-mon[34909]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T21:55:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:48 smithi039 ceph-mon[30872]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T21:55:48.973 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether build environment is sane... yes 2024-09-10T21:55:48.981 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gawk... gawk 2024-09-10T21:55:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:48 smithi173 ceph-mon[35294]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T21:55:48.996 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T21:55:49.025 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc... gcc 2024-09-10T21:55:49.073 INFO:tasks.workunit.client.0.smithi039.stdout:checking for C compiler default output file name... a.out 2024-09-10T21:55:49.074 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether the C compiler works... yes 2024-09-10T21:55:49.077 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether we are cross compiling... no 2024-09-10T21:55:49.113 INFO:tasks.workunit.client.0.smithi039.stdout:checking for suffix of executables... 2024-09-10T21:55:49.147 INFO:tasks.workunit.client.0.smithi039.stdout:checking for suffix of object files... o 2024-09-10T21:55:49.179 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T21:55:49.212 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether gcc accepts -g... yes 2024-09-10T21:55:49.267 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-10T21:55:49.310 INFO:tasks.workunit.client.0.smithi039.stdout:checking for style of include used by make... GNU 2024-09-10T21:55:49.401 INFO:tasks.workunit.client.0.smithi039.stdout:checking dependency style of gcc... gcc3 2024-09-10T21:55:49.401 INFO:tasks.workunit.client.0.smithi039.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T21:55:49.452 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T21:55:49.494 INFO:tasks.workunit.client.0.smithi039.stdout:checking for egrep... grep -E 2024-09-10T21:55:49.503 INFO:tasks.workunit.client.0.smithi039.stdout:checking for AIX... no 2024-09-10T21:55:49.577 INFO:tasks.workunit.client.0.smithi039.stdout:checking for library containing strerror... none required 2024-09-10T21:55:49.726 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ANSI C header files... yes 2024-09-10T21:55:49.766 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T21:55:49.816 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/types.h... yes 2024-09-10T21:55:49.863 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/stat.h... yes 2024-09-10T21:55:49.909 INFO:tasks.workunit.client.0.smithi039.stdout:checking for stdlib.h... yes 2024-09-10T21:55:49.957 INFO:tasks.workunit.client.0.smithi039.stdout:checking for string.h... yes 2024-09-10T21:55:50.006 INFO:tasks.workunit.client.0.smithi039.stdout:checking for memory.h... yes 2024-09-10T21:55:50.054 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strings.h... yes 2024-09-10T21:55:50.104 INFO:tasks.workunit.client.0.smithi039.stdout:checking for inttypes.h... yes 2024-09-10T21:55:50.152 INFO:tasks.workunit.client.0.smithi039.stdout:checking for stdint.h... yes 2024-09-10T21:55:50.202 INFO:tasks.workunit.client.0.smithi039.stdout:checking for unistd.h... yes 2024-09-10T21:55:50.214 INFO:tasks.workunit.client.0.smithi039.stdout:checking for memory.h... (cached) yes 2024-09-10T21:55:50.219 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strings.h... (cached) yes 2024-09-10T21:55:50.224 INFO:tasks.workunit.client.0.smithi039.stdout:checking for unistd.h... (cached) yes 2024-09-10T21:55:50.267 INFO:tasks.workunit.client.0.smithi039.stdout:checking locale.h usability... yes 2024-09-10T21:55:50.287 INFO:tasks.workunit.client.0.smithi039.stdout:checking locale.h presence... yes 2024-09-10T21:55:50.287 INFO:tasks.workunit.client.0.smithi039.stdout:checking for locale.h... yes 2024-09-10T21:55:50.301 INFO:tasks.workunit.client.0.smithi039.stdout:checking for stdlib.h... (cached) yes 2024-09-10T21:55:50.306 INFO:tasks.workunit.client.0.smithi039.stdout:checking for string.h... (cached) yes 2024-09-10T21:55:50.354 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/socket.h usability... yes 2024-09-10T21:55:50.375 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/socket.h presence... yes 2024-09-10T21:55:50.376 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/socket.h... yes 2024-09-10T21:55:50.433 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/time.h usability... yes 2024-09-10T21:55:50.453 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/time.h presence... yes 2024-09-10T21:55:50.454 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/time.h... yes 2024-09-10T21:55:50.506 INFO:tasks.workunit.client.0.smithi039.stdout:checking fcntl.h usability... yes 2024-09-10T21:55:50.526 INFO:tasks.workunit.client.0.smithi039.stdout:checking fcntl.h presence... yes 2024-09-10T21:55:50.527 INFO:tasks.workunit.client.0.smithi039.stdout:checking for fcntl.h... yes 2024-09-10T21:55:50.579 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fcntl.h usability... yes 2024-09-10T21:55:50.600 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fcntl.h presence... yes 2024-09-10T21:55:50.601 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/fcntl.h... yes 2024-09-10T21:55:50.684 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/param.h usability... yes 2024-09-10T21:55:50.708 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/param.h presence... yes 2024-09-10T21:55:50.708 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/param.h... yes 2024-09-10T21:55:50.753 INFO:tasks.workunit.client.0.smithi039.stdout:checking ioctl.h usability... no 2024-09-10T21:55:50.774 INFO:tasks.workunit.client.0.smithi039.stdout:checking ioctl.h presence... no 2024-09-10T21:55:50.774 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ioctl.h... no 2024-09-10T21:55:50.823 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/ioctl.h usability... yes 2024-09-10T21:55:50.843 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/ioctl.h presence... yes 2024-09-10T21:55:50.844 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/ioctl.h... yes 2024-09-10T21:55:50.897 INFO:tasks.workunit.client.0.smithi039.stdout:checking return type of signal handlers... void 2024-09-10T21:55:50.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:50 smithi070 ceph-mon[34909]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:55:50.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:50 smithi039 ceph-mon[30872]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:55:50.943 INFO:tasks.workunit.client.0.smithi039.stdout:checking for size_t... yes 2024-09-10T21:55:50.981 INFO:tasks.workunit.client.0.smithi039.stdout:checking for dev_t... yes 2024-09-10T21:55:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:50 smithi173 ceph-mon[35294]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:55:51.024 INFO:tasks.workunit.client.0.smithi039.stdout:checking for short... yes 2024-09-10T21:55:51.107 INFO:tasks.workunit.client.0.smithi039.stdout:checking size of short... 2 2024-09-10T21:55:51.156 INFO:tasks.workunit.client.0.smithi039.stdout:checking for int... yes 2024-09-10T21:55:51.227 INFO:tasks.workunit.client.0.smithi039.stdout:checking size of int... 4 2024-09-10T21:55:51.272 INFO:tasks.workunit.client.0.smithi039.stdout:checking for long... yes 2024-09-10T21:55:51.339 INFO:tasks.workunit.client.0.smithi039.stdout:checking size of long... 8 2024-09-10T21:55:51.383 INFO:tasks.workunit.client.0.smithi039.stdout:checking for long long... yes 2024-09-10T21:55:51.449 INFO:tasks.workunit.client.0.smithi039.stdout:checking size of long long... 8 2024-09-10T21:55:51.492 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ssize_t... yes 2024-09-10T21:55:51.532 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sig_atomic_t... yes 2024-09-10T21:55:51.598 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether gcc needs -traditional... no 2024-09-10T21:55:51.632 INFO:tasks.workunit.client.0.smithi039.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T21:55:51.657 INFO:tasks.workunit.client.0.smithi039.stdout:checking for inline... inline 2024-09-10T21:55:51.719 INFO:tasks.workunit.client.0.smithi039.stdout:checking for working alloca.h... yes 2024-09-10T21:55:51.767 INFO:tasks.workunit.client.0.smithi039.stdout:checking for alloca... yes 2024-09-10T21:55:51.838 INFO:tasks.workunit.client.0.smithi039.stdout:checking for working memcmp... yes 2024-09-10T21:55:51.894 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strftime... yes 2024-09-10T21:55:51.965 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-10T21:55:52.024 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether stat accepts an empty string... no 2024-09-10T21:55:52.080 INFO:tasks.workunit.client.0.smithi039.stdout:checking for vprintf... yes 2024-09-10T21:55:52.137 INFO:tasks.workunit.client.0.smithi039.stdout:checking for _doprnt... no 2024-09-10T21:55:52.159 INFO:tasks.workunit.client.0.smithi039.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T21:55:52.171 INFO:tasks.workunit.client.0.smithi039.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T21:55:52.229 INFO:tasks.workunit.client.0.smithi039.stdout:checking for the pthreads library -lpthreads... no 2024-09-10T21:55:52.283 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether pthreads work without any flags... yes 2024-09-10T21:55:52.329 INFO:tasks.workunit.client.0.smithi039.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-10T21:55:52.329 INFO:tasks.workunit.client.0.smithi039.stdout:checking if more special flags are required for pthreads... no 2024-09-10T21:55:52.329 INFO:tasks.workunit.client.0.smithi039.stdout:checking for cc_r... gcc 2024-09-10T21:55:52.402 INFO:tasks.workunit.client.0.smithi039.stdout:checking for setrlimit... yes 2024-09-10T21:55:52.462 INFO:tasks.workunit.client.0.smithi039.stdout:checking for setproctitle... no 2024-09-10T21:55:52.522 INFO:tasks.workunit.client.0.smithi039.stdout:checking for getopt_long... yes 2024-09-10T21:55:52.585 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strtoull... yes 2024-09-10T21:55:52.648 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strtoq... yes 2024-09-10T21:55:52.710 INFO:tasks.workunit.client.0.smithi039.stdout:checking for snprintf... yes 2024-09-10T21:55:52.771 INFO:tasks.workunit.client.0.smithi039.stdout:checking for vsnprintf... yes 2024-09-10T21:55:52.835 INFO:tasks.workunit.client.0.smithi039.stdout:checking for vfprintf... yes 2024-09-10T21:55:52.897 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gethostname... yes 2024-09-10T21:55:52.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:52 smithi070 ceph-mon[34909]: pgmap v367: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:55:52.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:52 smithi039 ceph-mon[30872]: pgmap v367: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:55:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:52 smithi173 ceph-mon[35294]: pgmap v367: 97 pgs: 97 active+clean; 672 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:55:53.011 INFO:tasks.workunit.client.0.smithi039.stdout:checking for setlocale... yes 2024-09-10T21:55:53.083 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sync... yes 2024-09-10T21:55:53.179 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether snprintf is C99 conformant... done 2024-09-10T21:55:53.192 INFO:tasks.workunit.client.0.smithi039.stdout:configure: creating ./config.status 2024-09-10T21:55:53.345 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating Makefile 2024-09-10T21:55:53.362 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating src/Makefile 2024-09-10T21:55:53.381 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating man/Makefile 2024-09-10T21:55:53.394 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating config.h 2024-09-10T21:55:53.444 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: executing depfiles commands 2024-09-10T21:55:53.570 INFO:tasks.workunit.client.0.smithi039.stderr:+ make 2024-09-10T21:55:53.579 INFO:tasks.workunit.client.0.smithi039.stdout:make all-recursive 2024-09-10T21:55:53.581 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-10T21:55:53.584 INFO:tasks.workunit.client.0.smithi039.stdout:Making all in src 2024-09-10T21:55:53.589 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-10T21:55:53.589 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-10T21:55:53.589 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-10T21:55:53.673 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-10T21:55:53.674 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-10T21:55:53.739 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-10T21:55:53.740 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-10T21:55:53.791 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-10T21:55:53.792 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-10T21:55:53.842 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-10T21:55:53.842 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-10T21:55:53.893 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-10T21:55:53.894 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-10T21:55:53.943 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-10T21:55:53.943 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-10T21:55:54.018 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-10T21:55:54.019 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-10T21:55:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-10T21:55:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-10T21:55:54.089 INFO:tasks.workunit.client.0.smithi039.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-10T21:55:54.089 INFO:tasks.workunit.client.0.smithi039.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-10T21:55:54.126 INFO:tasks.workunit.client.0.smithi039.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-10T21:55:54.146 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-10T21:55:54.146 INFO:tasks.workunit.client.0.smithi039.stdout:Making all in man 2024-09-10T21:55:54.149 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-10T21:55:54.149 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Nothing to be done for 'all'. 2024-09-10T21:55:54.149 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-10T21:55:54.150 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-10T21:55:54.151 INFO:tasks.workunit.client.0.smithi039.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-10T21:55:54.151 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-10T21:55:54.152 INFO:tasks.workunit.client.0.smithi039.stderr:+ cd src 2024-09-10T21:55:54.152 INFO:tasks.workunit.client.0.smithi039.stderr:+ mkdir blogtest_in 2024-09-10T21:55:54.154 INFO:tasks.workunit.client.0.smithi039.stdout:running blogbench 2024-09-10T21:55:54.154 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo 'running blogbench' 2024-09-10T21:55:54.154 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./blogbench -d blogtest_in 2024-09-10T21:55:54.154 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-10T21:55:54.155 INFO:tasks.workunit.client.0.smithi039.stdout:Frequency = 10 secs 2024-09-10T21:55:54.155 INFO:tasks.workunit.client.0.smithi039.stdout:Scratch dir = [blogtest_in] 2024-09-10T21:55:54.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:54 smithi070 ceph-mon[34909]: pgmap v368: 97 pgs: 97 active+clean; 2.5 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 173 KiB/s wr, 25 op/s 2024-09-10T21:55:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:54 smithi039 ceph-mon[30872]: pgmap v368: 97 pgs: 97 active+clean; 2.5 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 173 KiB/s wr, 25 op/s 2024-09-10T21:55:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:54 smithi173 ceph-mon[35294]: pgmap v368: 97 pgs: 97 active+clean; 2.5 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 173 KiB/s wr, 25 op/s 2024-09-10T21:55:56.495 INFO:tasks.workunit.client.0.smithi039.stdout:Spawning 3 writers... 2024-09-10T21:55:56.495 INFO:tasks.workunit.client.0.smithi039.stdout:Spawning 1 rewriters... 2024-09-10T21:55:56.496 INFO:tasks.workunit.client.0.smithi039.stdout:Spawning 5 commenters... 2024-09-10T21:55:56.496 INFO:tasks.workunit.client.0.smithi039.stdout:Spawning 100 readers... 2024-09-10T21:55:56.498 INFO:tasks.workunit.client.0.smithi039.stdout:Benchmarking for 30 iterations. 2024-09-10T21:55:56.498 INFO:tasks.workunit.client.0.smithi039.stdout:The test will run during 5 minutes. 2024-09-10T21:55:56.498 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-10T21:55:56.498 INFO:tasks.workunit.client.0.smithi039.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-10T21:55:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:56 smithi070 ceph-mon[34909]: pgmap v369: 97 pgs: 97 active+clean; 2.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 220 KiB/s wr, 29 op/s 2024-09-10T21:55:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:56 smithi039 ceph-mon[30872]: pgmap v369: 97 pgs: 97 active+clean; 2.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 220 KiB/s wr, 29 op/s 2024-09-10T21:55:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:56 smithi173 ceph-mon[35294]: pgmap v369: 97 pgs: 97 active+clean; 2.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 220 KiB/s wr, 29 op/s 2024-09-10T21:55:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 -- 172.21.15.39:0/1803611195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e201044a0 msgr2=0x7f0e2010ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 --2- 172.21.15.39:0/1803611195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e201044a0 0x7f0e2010ae20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009cd0 tx=0x7f0e1802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 -- 172.21.15.39:0/1803611195 shutdown_connections 2024-09-10T21:55:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 --2- 172.21.15.39:0/1803611195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e201044a0 0x7f0e2010ae20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 --2- 172.21.15.39:0/1803611195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e20103ae0 0x7f0e20103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 --2- 172.21.15.39:0/1803611195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20102990 0x7f0e20102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 -- 172.21.15.39:0/1803611195 >> 172.21.15.39:0/1803611195 conn(0x7f0e200fe250 msgr2=0x7f0e20100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 -- 172.21.15.39:0/1803611195 shutdown_connections 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.781+0000 7f0e28493640 1 -- 172.21.15.39:0/1803611195 wait complete. 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 Processor -- start 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 -- start start 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 0x7f0e201992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e201044a0 0x7f0e20199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2010e5e0 con 0x7f0e20102990 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2010e460 con 0x7f0e20103ae0 2024-09-10T21:55:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e28493640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2010e760 con 0x7f0e201044a0 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e2622f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e2622f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57408/0 (socket says 172.21.15.39:57408) 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e2622f640 1 -- 172.21.15.39:0/3819222521 learned_addr learned my addr 172.21.15.39:0/3819222521 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 0x7f0e201992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.782+0000 7f0e26a30640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e201044a0 0x7f0e20199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 -- 172.21.15.39:0/3819222521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e201044a0 msgr2=0x7f0e20199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e201044a0 0x7f0e20199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 -- 172.21.15.39:0/3819222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 msgr2=0x7f0e201992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 0x7f0e201992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 -- 172.21.15.39:0/3819222521 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2019a7e0 con 0x7f0e20102990 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 0x7f0e201992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e2622f640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00ea60 tx=0x7f0e1c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e177fe640 1 -- 172.21.15.39:0/3819222521 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00cd20 con 0x7f0e20102990 2024-09-10T21:55:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2019aad0 con 0x7f0e20102990 2024-09-10T21:55:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e177fe640 1 -- 172.21.15.39:0/3819222521 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c0035f0 con 0x7f0e20102990 2024-09-10T21:55:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e177fe640 1 -- 172.21.15.39:0/3819222521 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c010690 con 0x7f0e20102990 2024-09-10T21:55:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.783+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e201a11a0 con 0x7f0e20102990 2024-09-10T21:55:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.786+0000 7f0e2b265740 1 Processor -- start 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.786+0000 7f0e2b265740 1 -- start start 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.786+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d6119d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2b265740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d611076f0 con 0x560d6119abd0 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2b265740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d610f6b20 con 0x560d61195860 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2b265740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d610fa930 con 0x560d61198190 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e25a2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d6119d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37014/0 (socket says 172.21.15.39:37014) 2024-09-10T21:55:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 -- 172.21.15.39:0/897041288 learned_addr learned my addr 172.21.15.39:0/897041288 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e177fe640 1 -- 172.21.15.39:0/3819222521 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f0e1c004000 con 0x7f0e20102990 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 -- 172.21.15.39:0/897041288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 msgr2=0x560d6119a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2622f640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 -- 172.21.15.39:0/897041288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 msgr2=0x560d6119d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d6119d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 -- 172.21.15.39:0/897041288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d610bc530 con 0x560d61195860 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d6119d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e2622f640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.787+0000 7f0e26a30640 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802ae00 tx=0x7f0e18009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be478aa99cbd7b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e14bfe640 1 -- 172.21.15.39:0/897041288 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031b50 con 0x560d61195860 2024-09-10T21:55:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e14bfe640 1 -- 172.21.15.39:0/897041288 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e18036040 con 0x560d61195860 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e14bfe640 1 -- 172.21.15.39:0/897041288 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004750 con 0x560d61195860 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e177fe640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 0x7f0e0c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2622f640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 0x7f0e0c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e177fe640 1 -- 172.21.15.39:0/3819222521 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0e1c0e60c0 con 0x7f0e20102990 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 -- 172.21.15.39:0/897041288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 msgr2=0x560d61197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2622f640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 0x7f0e0c0b7830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0a8d00 tx=0x7f0e1c003e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802ae00 tx=0x7f0e18009a20 comp rx=0 tx=0).stop 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 -- 172.21.15.39:0/897041288 shutdown_connections 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d6119d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 --2- 172.21.15.39:0/897041288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d61197c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.788+0000 7f0e2b265740 1 -- 172.21.15.39:0/897041288 >> 172.21.15.39:0/897041288 conn(0x560d611909b0 msgr2=0x560d61191740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- 172.21.15.39:0/897041288 shutdown_connections 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- 172.21.15.39:0/897041288 wait complete. 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- start start 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 Processor -- start 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61195860 0x560d6119eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d6119abd0 0x560d611a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560d6102eab0 con 0x560d61198190 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d6109c730 con 0x560d6119abd0 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560d6119db50 con 0x560d61195860 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e2b265740 10 client.0 _ll_register_callbacks cb 0x560d610f06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e25a2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e25a2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57424/0 (socket says 172.21.15.39:57424) 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e25a2e640 1 -- 172.21.15.39:0/1949605186 learned_addr learned my addr 172.21.15.39:0/1949605186 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.789+0000 7f0e26a30640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d6119abd0 0x560d611a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e26a30640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61195860 0x560d6119eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 -- 172.21.15.39:0/1949605186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61195860 msgr2=0x560d6119eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61195860 0x560d6119eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 -- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d6119abd0 msgr2=0x560d611a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d6119abd0 0x560d611a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 -- 172.21.15.39:0/1949605186 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d60e58790 con 0x560d61198190 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0e10010f10 tx=0x7f0e1000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d144d1a7b530b810 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10005020 con 0x560d61198190 2024-09-10T21:55:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0e100051c0 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e18036040 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e100053c0 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e2b265740 10 client.15648 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d60ed1620 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.790+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e18036040 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0e10019680 con 0x560d61198190 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 10 client.15648 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 20 client.15648 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d611aa800 0x560d611acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 4 client.15648 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:55:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d61109640 con 0x560d611aa800 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e26a30640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d611aa800 0x560d611acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e26a30640 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d611aa800 0x560d611acbf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ef5aa82096ef3e server_cookie=b93d869187a825c2 in_seq=0 out_seq=0 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.791+0000 7f0e09ffb640 10 client.15648 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.794+0000 7f0e09ffb640 1 -- 172.21.15.39:0/1949605186 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d61109640 con 0x560d611aa800 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.794+0000 7f0e09ffb640 10 client.15648 handle_command_reply: tid=0 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.794+0000 7f0e2b265740 1 client.15648 shutdown 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 msgr2=0x560d6119f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0e10010f10 tx=0x7f0e1000f7f0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 shutdown_connections 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d611aa800 0x560d611acbf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d6119abd0 0x560d611a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e09ffb640 0 client.15648 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61198190 0x560d6119f560 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 --2- 172.21.15.39:0/1949605186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61195860 0x560d6119eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 >> 172.21.15.39:0/1949605186 conn(0x560d611909b0 msgr2=0x560d6118fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 shutdown_connections 2024-09-10T21:55:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 1 -- 172.21.15.39:0/1949605186 wait complete. 2024-09-10T21:55:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.795+0000 7f0e2b265740 20 client.15648 trim_cache size 0 max 16384 2024-09-10T21:55:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 Processor -- start 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 -- start start 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d6119e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201a9db0 con 0x560d6119abd0 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201ab8f0 con 0x560d61195860 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e2b265740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201aa480 con 0x560d61198190 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57436/0 (socket says 172.21.15.39:57436) 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 -- 172.21.15.39:0/449741155 learned_addr learned my addr 172.21.15.39:0/449741155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d6119e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 -- 172.21.15.39:0/449741155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 msgr2=0x560d6119e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 -- 172.21.15.39:0/449741155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 msgr2=0x560d6119e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d6119e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.810+0000 7f0e26a30640 1 -- 172.21.15.39:0/449741155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d611acf60 con 0x560d6119abd0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e26a30640 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009bf0 tx=0x7f0e18048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bf47a882f74aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e0bfff640 1 -- 172.21.15.39:0/449741155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031a60 con 0x560d6119abd0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e0bfff640 1 -- 172.21.15.39:0/449741155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e18036070 con 0x560d6119abd0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e0bfff640 1 -- 172.21.15.39:0/449741155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180042b0 con 0x560d6119abd0 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 -- 172.21.15.39:0/449741155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 msgr2=0x560d611927e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009bf0 tx=0x7f0e18048040 comp rx=0 tx=0).stop 2024-09-10T21:55:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 -- 172.21.15.39:0/449741155 shutdown_connections 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d6119abd0 0x560d611927e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d61198190 0x560d6119e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 --2- 172.21.15.39:0/449741155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61195860 0x560d6119e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 -- 172.21.15.39:0/449741155 >> 172.21.15.39:0/449741155 conn(0x560d611909b0 msgr2=0x560d6119afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 -- 172.21.15.39:0/449741155 shutdown_connections 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.811+0000 7f0e2b265740 1 -- 172.21.15.39:0/449741155 wait complete. 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 -- start start 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 Processor -- start 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61198190 0x560d611a5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d6119abd0 0x560d611a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201ab220 con 0x560d61195860 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201aab50 con 0x560d61198190 2024-09-10T21:55:58.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201a7d90 con 0x560d6119abd0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e2b265740 10 client.0 _ll_register_callbacks cb 0x7f0e1000abf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57450/0 (socket says 172.21.15.39:57450) 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 -- 172.21.15.39:0/3757381002 learned_addr learned my addr 172.21.15.39:0/3757381002 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61198190 0x560d611a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d6119abd0 0x560d611a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 -- 172.21.15.39:0/3757381002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d6119abd0 msgr2=0x560d611a59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d6119abd0 0x560d611a59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 -- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61198190 msgr2=0x560d611a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61198190 0x560d611a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.812+0000 7f0e26a30640 1 -- 172.21.15.39:0/3757381002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d611a6010 con 0x560d61195860 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e26a30640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b090 tx=0x7f0e1802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65c668b5f32839b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:55:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18003b80 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0e18004b40 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e18036070 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e18004d40 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 10 client.15654 fetch_fsmap learned FSMap version 27 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d61217710 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e18036070 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0e18030070 con 0x560d61195860 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 10 client.15654 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 20 client.15654 populate_metadata read hostname 'smithi039' 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d61217aa0 0x560d61219e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:55:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 4 client.15654 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:55:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.813+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d611050f0 con 0x560d61217aa0 2024-09-10T21:55:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.814+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d61217aa0 0x560d61219e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:55:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.814+0000 7f0e25a2e640 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d61217aa0 0x560d61219e90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e2df6879e72f70d server_cookie=2c69fbc492790528 in_seq=0 out_seq=0 2024-09-10T21:55:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:55:58.814+0000 7f0e09ffb640 10 client.15654 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:55:58.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:55:58 smithi039 ceph-mon[30872]: pgmap v370: 97 pgs: 97 active+clean; 4.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 395 KiB/s wr, 55 op/s 2024-09-10T21:55:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:55:58 smithi070 ceph-mon[34909]: pgmap v370: 97 pgs: 97 active+clean; 4.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 395 KiB/s wr, 55 op/s 2024-09-10T21:55:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:55:58 smithi173 ceph-mon[35294]: pgmap v370: 97 pgs: 97 active+clean; 4.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 395 KiB/s wr, 55 op/s 2024-09-10T21:56:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:00 smithi070 ceph-mon[34909]: pgmap v371: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 592 KiB/s wr, 64 op/s 2024-09-10T21:56:00.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:00 smithi039 ceph-mon[30872]: pgmap v371: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 592 KiB/s wr, 64 op/s 2024-09-10T21:56:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:00 smithi173 ceph-mon[35294]: pgmap v371: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 592 KiB/s wr, 64 op/s 2024-09-10T21:56:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.448+0000 7f0e09ffb640 1 -- 172.21.15.39:0/3757381002 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d611050f0 con 0x560d61217aa0 2024-09-10T21:56:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.448+0000 7f0e09ffb640 10 client.15654 handle_command_reply: tid=0 2024-09-10T21:56:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.448+0000 7f0e2b265740 1 client.15654 shutdown 2024-09-10T21:56:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.448+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 msgr2=0x560d611a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.448+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b090 tx=0x7f0e1802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 shutdown_connections 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560d61217aa0 0x560d61219e90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560d6119abd0 0x560d611a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d61198190 0x560d611a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e09ffb640 0 client.15654 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 --2- 172.21.15.39:0/3757381002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d61195860 0x560d611a6760 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 >> 172.21.15.39:0/3757381002 conn(0x560d611909b0 msgr2=0x560d6119e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 shutdown_connections 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 1 -- 172.21.15.39:0/3757381002 wait complete. 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e2b265740 20 client.15654 trim_cache size 0 max 16384 2024-09-10T21:56:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:56:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:56:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:56:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 msgr2=0x7f0e0c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 0x7f0e0c0b7830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0a8d00 tx=0x7f0e1c003e90 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 msgr2=0x7f0e20198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00ea60 tx=0x7f0e1c00ee60 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 shutdown_connections 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0e0c0b5370 0x7f0e0c0b7830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e201044a0 0x7f0e20199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e20103ae0 0x7f0e201992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 --2- 172.21.15.39:0/3819222521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e20102990 0x7f0e20198ca0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 >> 172.21.15.39:0/3819222521 conn(0x7f0e200fe250 msgr2=0x7f0e20106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.449+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 shutdown_connections 2024-09-10T21:56:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:01.450+0000 7f0e28493640 1 -- 172.21.15.39:0/3819222521 wait complete. 2024-09-10T21:56:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:02 smithi070 ceph-mon[34909]: pgmap v372: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 594 KiB/s wr, 63 op/s 2024-09-10T21:56:02.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:02 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:02 smithi039 ceph-mon[30872]: pgmap v372: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 594 KiB/s wr, 63 op/s 2024-09-10T21:56:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:02 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:02 smithi173 ceph-mon[35294]: pgmap v372: 97 pgs: 97 active+clean; 6.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 594 KiB/s wr, 63 op/s 2024-09-10T21:56:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:02 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:04.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:04 smithi070 ceph-mon[34909]: pgmap v373: 97 pgs: 97 active+clean; 35 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-09-10T21:56:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:04 smithi039 ceph-mon[30872]: pgmap v373: 97 pgs: 97 active+clean; 35 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-09-10T21:56:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:04 smithi173 ceph-mon[35294]: pgmap v373: 97 pgs: 97 active+clean; 35 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-09-10T21:56:06.498 INFO:tasks.workunit.client.0.smithi039.stdout: 13 214048 805 132990 751 80915 1300 2024-09-10T21:56:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 386 op/s 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:56:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:06 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 386 op/s 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:56:06.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:56:06.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:06 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 386 op/s 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:06.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:56:06.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:56:06.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:06 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:56:08.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:08 smithi070 ceph-mon[34909]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 436 op/s 2024-09-10T21:56:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:08 smithi039 ceph-mon[30872]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 436 op/s 2024-09-10T21:56:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:08 smithi173 ceph-mon[35294]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 436 op/s 2024-09-10T21:56:10.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:10 smithi070 ceph-mon[34909]: pgmap v376: 97 pgs: 97 active+clean; 48 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 542 op/s 2024-09-10T21:56:10.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:10 smithi039 ceph-mon[30872]: pgmap v376: 97 pgs: 97 active+clean; 48 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 542 op/s 2024-09-10T21:56:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:10 smithi173 ceph-mon[35294]: pgmap v376: 97 pgs: 97 active+clean; 48 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 542 op/s 2024-09-10T21:56:11.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:56:11.682 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:12.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.236+0000 7f710a834640 1 -- 172.21.15.39:0/338589340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104106e40 msgr2=0x7f7104107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.236+0000 7f710a834640 1 --2- 172.21.15.39:0/338589340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104106e40 0x7f7104107280 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f70f801a910 tx=0x7f70f803b450 comp rx=0 tx=0).stop 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.237+0000 7f710a834640 1 -- 172.21.15.39:0/338589340 shutdown_connections 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.237+0000 7f710a834640 1 --2- 172.21.15.39:0/338589340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71041077c0 0x7f710410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.237+0000 7f710a834640 1 --2- 172.21.15.39:0/338589340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104106e40 0x7f7104107280 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f70f801a910 tx=0x7f70f803b450 comp rx=0 tx=0).stop 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.237+0000 7f710a834640 1 --2- 172.21.15.39:0/338589340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7104101810 0x7f7104101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.237+0000 7f710a834640 1 -- 172.21.15.39:0/338589340 >> 172.21.15.39:0/338589340 conn(0x7f7104076f50 msgr2=0x7f7104077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.244+0000 7f710a834640 1 -- 172.21.15.39:0/338589340 shutdown_connections 2024-09-10T21:56:12.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.248+0000 7f710a834640 1 -- 172.21.15.39:0/338589340 wait complete. 2024-09-10T21:56:12.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.249+0000 7f710a834640 1 Processor -- start 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.251+0000 7f710a834640 1 -- start start 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71041077c0 0x7f7104074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71041b9990 0x7f710410c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f710406f400 con 0x7f7104101810 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f710406f280 con 0x7f71041b9990 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.252+0000 7f710a834640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f710406f580 con 0x7f71041077c0 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59956/0 (socket says 172.21.15.39:59956) 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 -- 172.21.15.39:0/3884522443 learned_addr learned my addr 172.21.15.39:0/3884522443 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f71037fe640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71041077c0 0x7f7104074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 -- 172.21.15.39:0/3884522443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71041077c0 msgr2=0x7f7104074ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71041077c0 0x7f7104074ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 -- 172.21.15.39:0/3884522443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71041b9990 msgr2=0x7f710410c0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71041b9990 0x7f710410c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.253+0000 7f7103fff640 1 -- 172.21.15.39:0/3884522443 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710410c8d0 con 0x7f7104101810 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.254+0000 7f7103fff640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b450 tx=0x7f70f400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.255+0000 7f71017fa640 1 -- 172.21.15.39:0/3884522443 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4015020 con 0x7f7104101810 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.255+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710410cbc0 con 0x7f7104101810 2024-09-10T21:56:12.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.256+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71041b9d70 con 0x7f7104101810 2024-09-10T21:56:12.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.260+0000 7f71017fa640 1 -- 172.21.15.39:0/3884522443 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f4011d40 con 0x7f7104101810 2024-09-10T21:56:12.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.260+0000 7f71017fa640 1 -- 172.21.15.39:0/3884522443 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f400f340 con 0x7f7104101810 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.265+0000 7f71017fa640 1 -- 172.21.15.39:0/3884522443 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f70f400f5a0 con 0x7f7104101810 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.265+0000 7f710cc09740 1 Processor -- start 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 -- start start 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf44d30 0x55eaedf47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eaedeaee50 con 0x55eaedf44d30 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eaede9e280 con 0x55eaedf38da0 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.270+0000 7f710cc09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eaedea2090 con 0x55eaedf38480 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36412/0 (socket says 172.21.15.39:36412) 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 -- 172.21.15.39:0/753529127 learned_addr learned my addr 172.21.15.39:0/753529127 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f71037fe640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf44d30 0x55eaedf47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7103fff640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 -- 172.21.15.39:0/753529127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 msgr2=0x55eaedf447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 -- 172.21.15.39:0/753529127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf44d30 msgr2=0x55eaedf47120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf44d30 0x55eaedf47120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7108dd1640 1 -- 172.21.15.39:0/753529127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaedbfc650 con 0x55eaedf38480 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.271+0000 7f7103fff640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.272+0000 7f71017fa640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 0x7f70ec0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.272+0000 7f7108dd1640 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009e00 tx=0x7f70fc00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41038b889b6e783e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.273+0000 7f7103fff640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 0x7f70ec0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.274+0000 7f70ea7fc640 1 -- 172.21.15.39:0/753529127 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc004d20 con 0x55eaedf38480 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.274+0000 7f70ea7fc640 1 -- 172.21.15.39:0/753529127 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70fc00ee70 con 0x55eaedf38480 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.274+0000 7f70ea7fc640 1 -- 172.21.15.39:0/753529127 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc010430 con 0x55eaedf38480 2024-09-10T21:56:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.275+0000 7f7103fff640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 0x7f70ec0b7a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70f4013000 tx=0x7f70f4010000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.277+0000 7f710cc09740 1 -- 172.21.15.39:0/753529127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 msgr2=0x55eaedf38860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.277+0000 7f710cc09740 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009e00 tx=0x7f70fc00e720 comp rx=0 tx=0).stop 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.278+0000 7f71017fa640 1 -- 172.21.15.39:0/3884522443 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f70f40e69d0 con 0x7f7104101810 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.279+0000 7f710cc09740 1 -- 172.21.15.39:0/753529127 shutdown_connections 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.279+0000 7f710cc09740 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf44d30 0x55eaedf47120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.279+0000 7f710cc09740 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.279+0000 7f710cc09740 1 --2- 172.21.15.39:0/753529127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf38480 0x55eaedf38860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.279+0000 7f710cc09740 1 -- 172.21.15.39:0/753529127 >> 172.21.15.39:0/753529127 conn(0x55eaedf362b0 msgr2=0x55eaedf37450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.281+0000 7f710cc09740 1 -- 172.21.15.39:0/753529127 shutdown_connections 2024-09-10T21:56:12.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.281+0000 7f710cc09740 1 -- 172.21.15.39:0/753529127 wait complete. 2024-09-10T21:56:12.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.281+0000 7f710cc09740 1 -- start start 2024-09-10T21:56:12.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 Processor -- start 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf41a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33652/0 (socket says 172.21.15.39:33652) 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f7108dd1640 1 -- 172.21.15.39:0/979461462 learned_addr learned my addr 172.21.15.39:0/979461462 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eaedcff700 con 0x55eaedf38da0 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eaede39110 con 0x55eaedf38480 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.282+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eaedf479b0 con 0x55eaedf44d30 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 -- 172.21.15.39:0/979461462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 msgr2=0x55eaedf420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 -- 172.21.15.39:0/979461462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 msgr2=0x55eaedf41a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:56:12.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf41a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaede66c40 con 0x55eaedf38480 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f710cc09740 10 client.0 _ll_register_callbacks cb 0x55eaede52990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f7108dd1640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009810 tx=0x7f70fc009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22d593675c61555 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70fc00ee70 con 0x55eaedf38480 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f70e37fe640 10 client.25259 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f70e37fe640 1 -- 172.21.15.39:0/979461462 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc030050 con 0x55eaedf38480 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.283+0000 7f70e37fe640 1 -- 172.21.15.39:0/979461462 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f70fc018670 con 0x55eaedf38480 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.284+0000 7f70e37fe640 1 -- 172.21.15.39:0/979461462 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70fc018870 con 0x55eaedf38480 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.285+0000 7f710cc09740 10 client.25259 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:12.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.285+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55eaedf531e0 con 0x55eaedf38480 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.287+0000 7f70e37fe640 1 -- 172.21.15.39:0/979461462 <== mon.2 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f70fc018a10 con 0x55eaedf38480 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 10 client.25259 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 10 client.25259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 20 client.25259 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedf54530 0x55eaedf56920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 4 client.25259 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.288+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaedeb0da0 con 0x55eaedf54530 2024-09-10T21:56:12.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.289+0000 7f71037fe640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedf54530 0x55eaedf56920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.296+0000 7f71037fe640 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedf54530 0x55eaedf56920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25233bb5c3bdcc5b server_cookie=c6bcd4b713727e3e in_seq=0 out_seq=0 2024-09-10T21:56:12.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.296+0000 7f70e37fe640 10 client.25259 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:12.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.298+0000 7f70e37fe640 1 -- 172.21.15.39:0/979461462 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eaedeb0da0 con 0x55eaedf54530 2024-09-10T21:56:12.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.298+0000 7f70e37fe640 10 client.25259 handle_command_reply: tid=0 2024-09-10T21:56:12.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.299+0000 7f710cc09740 1 client.25259 shutdown 2024-09-10T21:56:12.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.300+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 msgr2=0x55eaedf44640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.300+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009810 tx=0x7f70fc009f50 comp rx=0 tx=0).stop 2024-09-10T21:56:12.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 shutdown_connections 2024-09-10T21:56:12.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedf54530 0x55eaedf56920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf41a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 --2- 172.21.15.39:0/979461462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf44640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f70e37fe640 0 client.25259 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:12.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.301+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 >> 172.21.15.39:0/979461462 conn(0x55eaedf362b0 msgr2=0x55eaedf3be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.305+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 shutdown_connections 2024-09-10T21:56:12.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.310+0000 7f710cc09740 1 -- 172.21.15.39:0/979461462 wait complete. 2024-09-10T21:56:12.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.310+0000 7f710cc09740 20 client.25259 trim_cache size 0 max 16384 2024-09-10T21:56:12.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.358+0000 7f710cc09740 1 Processor -- start 2024-09-10T21:56:12.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.362+0000 7f710cc09740 1 -- start start 2024-09-10T21:56:12.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.362+0000 7f710cc09740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 0x55eaedf312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 0x55eaedf312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 0x55eaedf312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59980/0 (socket says 172.21.15.39:59980) 2024-09-10T21:56:12.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f7108dd1640 1 -- 172.21.15.39:0/2658688834 learned_addr learned my addr 172.21.15.39:0/2658688834 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:12.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf37370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf378b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000e4a0 con 0x55eaedf38480 2024-09-10T21:56:12.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0010040 con 0x55eaedf38da0 2024-09-10T21:56:12.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.363+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000eb70 con 0x55eaedf44d30 2024-09-10T21:56:12.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.365+0000 7f71037fe640 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf37370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.366+0000 7f71037fe640 1 -- 172.21.15.39:0/2658688834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 msgr2=0x55eaedf378b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:56:12.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.366+0000 7f71037fe640 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf378b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.366+0000 7f71037fe640 1 -- 172.21.15.39:0/2658688834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 msgr2=0x55eaedf312d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.366+0000 7f71037fe640 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 0x55eaedf312d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.366+0000 7f71037fe640 1 -- 172.21.15.39:0/2658688834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaedf42430 con 0x55eaedf38da0 2024-09-10T21:56:12.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.373+0000 7f71037fe640 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf37370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70f8019000 tx=0x7f70f8005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c8c1c3852fba25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.375+0000 7f70e9ffb640 1 -- 172.21.15.39:0/2658688834 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8000e60 con 0x55eaedf38da0 2024-09-10T21:56:12.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.375+0000 7f70e9ffb640 1 -- 172.21.15.39:0/2658688834 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f8004e20 con 0x55eaedf38da0 2024-09-10T21:56:12.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.375+0000 7f70e9ffb640 1 -- 172.21.15.39:0/2658688834 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8046040 con 0x55eaedf38da0 2024-09-10T21:56:12.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.377+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 msgr2=0x55eaedf37370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.377+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf37370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70f8019000 tx=0x7f70f8005fd0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.380+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 shutdown_connections 2024-09-10T21:56:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.380+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.380+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38da0 0x55eaedf37370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.380+0000 7f710cc09740 1 --2- 172.21.15.39:0/2658688834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38480 0x55eaedf312d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.380+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 >> 172.21.15.39:0/2658688834 conn(0x55eaedf362b0 msgr2=0x55eaedf40310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.384+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 shutdown_connections 2024-09-10T21:56:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.384+0000 7f710cc09740 1 -- 172.21.15.39:0/2658688834 wait complete. 2024-09-10T21:56:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.385+0000 7f710cc09740 1 -- start start 2024-09-10T21:56:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.385+0000 7f710cc09740 1 Processor -- start 2024-09-10T21:56:12.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.391+0000 7f710cc09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf4d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.391+0000 7f710cc09740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf4acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.391+0000 7f710cc09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf4b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f710cc09740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000f910 con 0x55eaedf38da0 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f710cc09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000f240 con 0x55eaedf38480 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f710cc09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000c480 con 0x55eaedf44d30 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f710cc09740 10 client.0 _ll_register_callbacks cb 0x7f70fc009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf4d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f7108dd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf4d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33658/0 (socket says 172.21.15.39:33658) 2024-09-10T21:56:12.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f7108dd1640 1 -- 172.21.15.39:0/1019741187 learned_addr learned my addr 172.21.15.39:0/1019741187 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:12.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.392+0000 7f71037fe640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf4acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f71037fe640 1 -- 172.21.15.39:0/1019741187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 msgr2=0x55eaedf4b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f7108dd1640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf4b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f71037fe640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf4b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f71037fe640 1 -- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 msgr2=0x55eaedf4d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:12.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f71037fe640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf4d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.393+0000 7f71037fe640 1 -- 172.21.15.39:0/1019741187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaedf38bd0 con 0x55eaedf38da0 2024-09-10T21:56:12.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.394+0000 7f71037fe640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf4acd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f70f803b9c0 tx=0x7f70f803b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6361d002c7b91668 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.394+0000 7f70e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.394+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8046070 con 0x55eaedf38da0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.395+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f8004e20 con 0x55eaedf38da0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.395+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f70f8014040 con 0x55eaedf38da0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.395+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70f8004c10 con 0x55eaedf38da0 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.395+0000 7f710cc09740 10 client.15669 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:12.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.395+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eaedfc1e40 con 0x55eaedf38da0 2024-09-10T21:56:12.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.396+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f8004e20 con 0x55eaedf38da0 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f70f8003790 con 0x55eaedf38da0 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 20 client.15669 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedfc2500 0x55eaedfc4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 4 client.15669 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eaedeac850 con 0x55eaedfc2500 2024-09-10T21:56:12.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.397+0000 7f7108dd1640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedfc2500 0x55eaedfc4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.398+0000 7f7108dd1640 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedfc2500 0x55eaedfc4920 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff09ae002cda6563 server_cookie=7d8d713d2bd6fd4f in_seq=0 out_seq=0 2024-09-10T21:56:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.398+0000 7f70e37fe640 10 client.15669 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.398+0000 7f70e37fe640 1 -- 172.21.15.39:0/1019741187 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55eaedeac850 con 0x55eaedfc2500 2024-09-10T21:56:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.398+0000 7f70e37fe640 10 client.15669 handle_command_reply: tid=0 2024-09-10T21:56:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.398+0000 7f710cc09740 1 client.15669 shutdown 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 msgr2=0x55eaedf4acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf4acd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f70f803b9c0 tx=0x7f70f803b450 comp rx=0 tx=0).stop 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 shutdown_connections 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55eaedfc2500 0x55eaedfc4920 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eaedf44d30 0x55eaedf4b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eaedf38da0 0x55eaedf4acd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 --2- 172.21.15.39:0/1019741187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eaedf38480 0x55eaedf4d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f70e37fe640 0 client.15669 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.399+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 >> 172.21.15.39:0/1019741187 conn(0x55eaedf362b0 msgr2=0x55eaedf372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.400+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 shutdown_connections 2024-09-10T21:56:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.400+0000 7f710cc09740 1 -- 172.21.15.39:0/1019741187 wait complete. 2024-09-10T21:56:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.400+0000 7f710cc09740 20 client.15669 trim_cache size 0 max 16384 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:12.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:12.403 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.401+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 msgr2=0x7f70ec0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.401+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 0x7f70ec0b7a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70f4013000 tx=0x7f70f4010000 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.401+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 msgr2=0x7f7104074590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.401+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b450 tx=0x7f70f400b910 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 shutdown_connections 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f70ec0b5580 0x7f70ec0b7a40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71041b9990 0x7f710410c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71041077c0 0x7f7104074ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 --2- 172.21.15.39:0/3884522443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104101810 0x7f7104074590 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.402+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 >> 172.21.15.39:0/3884522443 conn(0x7f7104076f50 msgr2=0x7f7104104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.403+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 shutdown_connections 2024-09-10T21:56:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:12.403+0000 7f710a834640 1 -- 172.21.15.39:0/3884522443 wait complete. 2024-09-10T21:56:12.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:12 smithi070 ceph-mon[34909]: pgmap v377: 97 pgs: 97 active+clean; 48 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 561 op/s 2024-09-10T21:56:12.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:12 smithi039 ceph-mon[30872]: pgmap v377: 97 pgs: 97 active+clean; 48 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 561 op/s 2024-09-10T21:56:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:12 smithi173 ceph-mon[35294]: pgmap v377: 97 pgs: 97 active+clean; 48 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 561 op/s 2024-09-10T21:56:13.192 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:56:13.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:56:13.507 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:13.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 -- 172.21.15.39:0/3042852970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f923010d110 msgr2=0x7f923010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 --2- 172.21.15.39:0/3042852970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f923010d110 0x7f923010f570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9228009ca0 tx=0x7f922802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 -- 172.21.15.39:0/3042852970 shutdown_connections 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 --2- 172.21.15.39:0/3042852970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f923010d110 0x7f923010f570 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 --2- 172.21.15.39:0/3042852970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92301045d0 0x7f923010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 --2- 172.21.15.39:0/3042852970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9230103cb0 0x7f9230104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 -- 172.21.15.39:0/3042852970 >> 172.21.15.39:0/3042852970 conn(0x7f92300fd730 msgr2=0x7f92300ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 -- 172.21.15.39:0/3042852970 shutdown_connections 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.993+0000 7f923784f640 1 -- 172.21.15.39:0/3042852970 wait complete. 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 Processor -- start 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 -- start start 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92301045d0 0x7f92301997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 0x7f923019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9230112d80 con 0x7f9230103cb0 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9230112c00 con 0x7f923010d110 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f923784f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9230112f00 con 0x7f92301045d0 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f92355eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f92355eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60016/0 (socket says 172.21.15.39:60016) 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f92355eb640 1 -- 172.21.15.39:0/3649173063 learned_addr learned my addr 172.21.15.39:0/3649173063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.994+0000 7f9235dec640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 0x7f923019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f9234dea640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92301045d0 0x7f92301997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 -- 172.21.15.39:0/3649173063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92301045d0 msgr2=0x7f92301997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92301045d0 0x7f92301997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 -- 172.21.15.39:0/3649173063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 msgr2=0x7f923019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 0x7f923019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 -- 172.21.15.39:0/3649173063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923019f360 con 0x7f9230103cb0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f9235dec640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 0x7f923019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92355eb640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f922c00d950 tx=0x7f922c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c017070 con 0x7f9230103cb0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923019f650 con 0x7f9230103cb0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f922c009c30 con 0x7f9230103cb0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c00f620 con 0x7f9230103cb0 2024-09-10T21:56:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.995+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92301a5ee0 con 0x7f9230103cb0 2024-09-10T21:56:14.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.997+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923006b9d0 con 0x7f9230103cb0 2024-09-10T21:56:14.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.998+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f922c010460 con 0x7f9230103cb0 2024-09-10T21:56:14.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.999+0000 7f92227fc640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 0x7f921c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.999+0000 7f9234dea640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 0x7f921c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.999+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f922c0e58e0 con 0x7f9230103cb0 2024-09-10T21:56:14.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:13.999+0000 7f9234dea640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 0x7f921c0b7830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f92300ffdf0 tx=0x7f9224005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.002+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f922c009de0 con 0x7f9230103cb0 2024-09-10T21:56:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.283+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9230104090 con 0x7f9230103cb0 2024-09-10T21:56:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.283+0000 7f92227fc640 1 -- 172.21.15.39:0/3649173063 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11976 (secure 0 0 0) 0x7f922c0ac000 con 0x7f9230103cb0 2024-09-10T21:56:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:56:14.285 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-10T21:56:01:618749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:56:00.760505+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:56:14.285 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-10T21:56:14.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 msgr2=0x7f921c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 0x7f921c0b7830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f92300ffdf0 tx=0x7f9224005f90 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 msgr2=0x7f92301992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f922c00d950 tx=0x7f922c00de10 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 shutdown_connections 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f921c0b5370 0x7f921c0b7830 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f923010d110 0x7f923019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92301045d0 0x7f92301997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 --2- 172.21.15.39:0/3649173063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9230103cb0 0x7f92301992b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 >> 172.21.15.39:0/3649173063 conn(0x7f92300fd730 msgr2=0x7f923010f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 shutdown_connections 2024-09-10T21:56:14.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:14.286+0000 7f923784f640 1 -- 172.21.15.39:0/3649173063 wait complete. 2024-09-10T21:56:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 -- 172.21.15.39:0/3166911751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc101860 msgr2=0x7fe0cc101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 --2- 172.21.15.39:0/3166911751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc101860 0x7fe0cc101c60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009930 tx=0x7fe0bc02a420 comp rx=0 tx=0).stop 2024-09-10T21:56:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 -- 172.21.15.39:0/3166911751 shutdown_connections 2024-09-10T21:56:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 --2- 172.21.15.39:0/3166911751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.542 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 --2- 172.21.15.39:0/3166911751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 --2- 172.21.15.39:0/3166911751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc101860 0x7fe0cc101c60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 -- 172.21.15.39:0/3166911751 >> 172.21.15.39:0/3166911751 conn(0x7fe0cc0fd140 msgr2=0x7fe0cc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 -- 172.21.15.39:0/3166911751 shutdown_connections 2024-09-10T21:56:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.541+0000 7fe0d096b640 1 -- 172.21.15.39:0/3166911751 wait complete. 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 Processor -- start 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 -- start start 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc101860 0x7fe0cc197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc10d4b0 con 0x7fe0cc1029b0 2024-09-10T21:56:14.545 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc10d330 con 0x7fe0cc101860 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0d096b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc10d630 con 0x7fe0cc103370 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60044/0 (socket says 172.21.15.39:60044) 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/564934297 learned_addr learned my addr 172.21.15.39:0/564934297 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc101860 0x7fe0cc197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/564934297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 msgr2=0x7fe0cc198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/564934297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc101860 msgr2=0x7fe0cc197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc101860 0x7fe0cc197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/564934297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc199820 con 0x7fe0cc1029b0 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:14.546 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.542+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000e9f0 tx=0x7fe0c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.543+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000cd80 con 0x7fe0cc1029b0 2024-09-10T21:56:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.543+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c00108e0 con 0x7fe0cc1029b0 2024-09-10T21:56:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.543+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc199b10 con 0x7fe0cc1029b0 2024-09-10T21:56:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.543+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0018980 con 0x7fe0cc1029b0 2024-09-10T21:56:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.543+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc06aa10 con 0x7fe0cc1029b0 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 Processor -- start 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 -- start start 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fe0c0010430 con 0x7fe0cc1029b0 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b86580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562ad8af36f0 con 0x562ad8b86bd0 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562ad8ae2b20 con 0x562ad8b81860 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.545+0000 7fe0d381b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562ad8ae6930 con 0x562ad8b84190 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60048/0 (socket says 172.21.15.39:60048) 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/146370840 learned_addr learned my addr 172.21.15.39:0/146370840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33712/0 (socket says 172.21.15.39:33712) 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b86580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 -- 172.21.15.39:0/146370840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 msgr2=0x562ad8b86580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b86580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 -- 172.21.15.39:0/146370840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 msgr2=0x562ad8b89090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 -- 172.21.15.39:0/146370840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad8aa8530 con 0x562ad8b81860 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b86580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005fd0 tx=0x7fe0c400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9785e93ad3110306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0bb7fe640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 0x7fe0b40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0b8ff9640 1 -- 172.21.15.39:0/146370840 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4015070 con 0x562ad8b81860 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0b8ff9640 1 -- 172.21.15.39:0/146370840 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c401ab10 con 0x562ad8b81860 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 0x7fe0b40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.546+0000 7fe0b8ff9640 1 -- 172.21.15.39:0/146370840 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011bf0 con 0x562ad8b81860 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe0c00e5fc0 con 0x7fe0cc1029b0 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 -- 172.21.15.39:0/146370840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 msgr2=0x562ad8b83c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 0x7fe0b40b78b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc006010 tx=0x7fe0bc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005fd0 tx=0x7fe0c400f7f0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 -- 172.21.15.39:0/146370840 shutdown_connections 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b89090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b86580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 --2- 172.21.15.39:0/146370840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b83c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 -- 172.21.15.39:0/146370840 >> 172.21.15.39:0/146370840 conn(0x562ad8b7c9b0 msgr2=0x562ad8b7d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 -- 172.21.15.39:0/146370840 shutdown_connections 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.547+0000 7fe0d381b740 1 -- 172.21.15.39:0/146370840 wait complete. 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 -- start start 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 Processor -- start 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 0x562ad8b8b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 0x562ad8b8c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562ad8a1aab0 con 0x562ad8b81860 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562ad8a88730 con 0x562ad8b84190 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562ad8b89bb0 con 0x562ad8b86bd0 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0d381b740 10 client.0 _ll_register_callbacks cb 0x562ad8adc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 0x562ad8b8b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60052/0 (socket says 172.21.15.39:60052) 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0ca59c640 1 -- 172.21.15.39:0/2067065405 learned_addr learned my addr 172.21.15.39:0/2067065405 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.548+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 0x562ad8b8c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 -- 172.21.15.39:0/2067065405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 msgr2=0x562ad8b8c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 0x562ad8b8c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 -- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 msgr2=0x562ad8b8b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 0x562ad8b8b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 -- 172.21.15.39:0/2067065405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad8844790 con 0x562ad8b81860 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 0x562ad8b8c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 0x562ad8b8b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009930 tx=0x7fe0bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a621dc3559a0eea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc035070 con 0x562ad8b81860 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c401ab10 con 0x562ad8b81860 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe0bc0037f0 con 0x562ad8b81860 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc0039f0 con 0x562ad8b81860 2024-09-10T21:56:14.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0d381b740 10 client.15687 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:14.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.549+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ad88bd620 con 0x562ad8b81860 2024-09-10T21:56:14.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c401ab10 con 0x562ad8b81860 2024-09-10T21:56:14.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0bc058070 con 0x562ad8b81860 2024-09-10T21:56:14.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:14.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 20 client.15687 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8b96840 0x562ad8b98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 4 client.15687 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad8af5640 con 0x562ad8b96840 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8b96840 0x562ad8b98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8b96840 0x562ad8b98c90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a54801279f72b91 server_cookie=fb4c7213427cc80b in_seq=0 out_seq=0 2024-09-10T21:56:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.550+0000 7fe0b1ffb640 10 client.15687 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.566+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/2067065405 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ad8af5640 con 0x562ad8b96840 2024-09-10T21:56:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.566+0000 7fe0b1ffb640 10 client.15687 handle_command_reply: tid=0 2024-09-10T21:56:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.566+0000 7fe0d381b740 1 client.15687 shutdown 2024-09-10T21:56:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.566+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 msgr2=0x562ad8b8aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.566+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009930 tx=0x7fe0bc009260 comp rx=0 tx=0).stop 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 shutdown_connections 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8b96840 0x562ad8b98c90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b86bd0 0x562ad8b8c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b84190 0x562ad8b8b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 --2- 172.21.15.39:0/2067065405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aef0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 >> 172.21.15.39:0/2067065405 conn(0x562ad8b7c9b0 msgr2=0x562ad8b7bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:14.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.567+0000 7fe0b1ffb640 0 client.15687 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.570+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 shutdown_connections 2024-09-10T21:56:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.570+0000 7fe0d381b740 1 -- 172.21.15.39:0/2067065405 wait complete. 2024-09-10T21:56:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.570+0000 7fe0d381b740 20 client.15687 trim_cache size 0 max 16384 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 Processor -- start 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 -- start start 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b80cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b86bd0 0x562ad8b81230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1a9f80 con 0x562ad8b81860 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1abb20 con 0x562ad8b86bd0 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0d381b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1aa650 con 0x562ad8b84190 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60056/0 (socket says 172.21.15.39:60056) 2024-09-10T21:56:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0ca59c640 1 -- 172.21.15.39:0/3886086238 learned_addr learned my addr 172.21.15.39:0/3886086238 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b80cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.593+0000 7fe0cad9d640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b86bd0 0x562ad8b81230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/3886086238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b86bd0 msgr2=0x562ad8b81230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b86bd0 0x562ad8b81230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/3886086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 msgr2=0x562ad8b8aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0c9d9b640 1 -- 172.21.15.39:0/3886086238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad8b8c4d0 con 0x562ad8b84190 2024-09-10T21:56:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.594+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.595+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b80cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ac660 tx=0x7fe0c00e8540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ce6a88d032b1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.595+0000 7fe0b3fff640 1 -- 172.21.15.39:0/3886086238 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00ac020 con 0x562ad8b84190 2024-09-10T21:56:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.595+0000 7fe0b3fff640 1 -- 172.21.15.39:0/3886086238 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c00ac1e0 con 0x562ad8b84190 2024-09-10T21:56:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.595+0000 7fe0b3fff640 1 -- 172.21.15.39:0/3886086238 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00abe40 con 0x562ad8b84190 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- 172.21.15.39:0/3886086238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 msgr2=0x562ad8b80cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b80cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ac660 tx=0x7fe0c00e8540 comp rx=0 tx=0).stop 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- 172.21.15.39:0/3886086238 shutdown_connections 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b86bd0 0x562ad8b81230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b80cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3886086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b81860 0x562ad8b8aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- 172.21.15.39:0/3886086238 >> 172.21.15.39:0/3886086238 conn(0x562ad8b7c9b0 msgr2=0x562ad8b7d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- 172.21.15.39:0/3886086238 shutdown_connections 2024-09-10T21:56:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- 172.21.15.39:0/3886086238 wait complete. 2024-09-10T21:56:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 -- start start 2024-09-10T21:56:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.597+0000 7fe0d381b740 1 Processor -- start 2024-09-10T21:56:14.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b91380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b918c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1ab3f0 con 0x562ad8b86bd0 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1aad20 con 0x562ad8b81860 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1a7f60 con 0x562ad8b84190 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0d381b740 10 client.0 _ll_register_callbacks cb 0x7fe0bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0cad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33746/0 (socket says 172.21.15.39:33746) 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 -- 172.21.15.39:0/3952301378 learned_addr learned my addr 172.21.15.39:0/3952301378 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b91380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 -- 172.21.15.39:0/3952301378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 msgr2=0x562ad8b91380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b91380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 -- 172.21.15.39:0/3952301378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 msgr2=0x562ad8b918c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b918c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 -- 172.21.15.39:0/3952301378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad8b868f0 con 0x562ad8b81860 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0ca59c640 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc03cd90 tx=0x7fe0bc03ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54c925a970a29d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.598+0000 7fe0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc003d90 con 0x562ad8b81860 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fe0bc03c440 con 0x562ad8b81860 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c00ac1e0 con 0x562ad8b81860 2024-09-10T21:56:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc069050 con 0x562ad8b81860 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 10 client.25289 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ad8b90ac0 con 0x562ad8b81860 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c00ac1e0 con 0x562ad8b81860 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0bc058040 con 0x562ad8b81860 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 10 client.25289 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 10 client.25289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 20 client.25289 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8c03df0 0x562ad8c06210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 4 client.25289 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ad8af10f0 con 0x562ad8c03df0 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.599+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8c03df0 0x562ad8c06210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.600+0000 7fe0c9d9b640 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8c03df0 0x562ad8c06210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fda63b7362984ef server_cookie=430d07d80cc917d0 in_seq=0 out_seq=0 2024-09-10T21:56:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:14.600+0000 7fe0b1ffb640 10 client.25289 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:14.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:14 smithi039 ceph-mon[30872]: pgmap v378: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 704 op/s 2024-09-10T21:56:14.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:14 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3649173063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:56:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:14 smithi070 ceph-mon[34909]: pgmap v378: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 704 op/s 2024-09-10T21:56:14.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:14 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3649173063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:56:14.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:56:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:14 smithi173 ceph-mon[35294]: pgmap v378: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 704 op/s 2024-09-10T21:56:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:14 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3649173063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:56:15.264 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:15.669+0000 7fe0bb7fe640 1 -- 172.21.15.39:0/564934297 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe0c00e80b0 con 0x7fe0cc1029b0 2024-09-10T21:56:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 -- 172.21.15.39:0/4247106681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec1018c0 msgr2=0x7f84ec101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 --2- 172.21.15.39:0/4247106681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec1018c0 0x7f84ec101ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009900 tx=0x7f84dc02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 -- 172.21.15.39:0/4247106681 shutdown_connections 2024-09-10T21:56:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 --2- 172.21.15.39:0/4247106681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec10d300 0x7f84ec10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 --2- 172.21.15.39:0/4247106681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10a9d0 0x7f84ec10cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 --2- 172.21.15.39:0/4247106681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec1018c0 0x7f84ec101ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 -- 172.21.15.39:0/4247106681 >> 172.21.15.39:0/4247106681 conn(0x7f84ec076e50 msgr2=0x7f84ec077260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 -- 172.21.15.39:0/4247106681 shutdown_connections 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.776+0000 7f84f15d8640 1 -- 172.21.15.39:0/4247106681 wait complete. 2024-09-10T21:56:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 Processor -- start 2024-09-10T21:56:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 -- start start 2024-09-10T21:56:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec10a9d0 0x7f84ec102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 0x7f84ec103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec112dc0 con 0x7f84ec10d300 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec112c40 con 0x7f84ec1018c0 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84f15d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec112f40 con 0x7f84ec10a9d0 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33766/0 (socket says 172.21.15.39:33766) 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 -- 172.21.15.39:0/2791874996 learned_addr learned my addr 172.21.15.39:0/2791874996 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec10a9d0 0x7f84ec102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 0x7f84ec103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 -- 172.21.15.39:0/2791874996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec10a9d0 msgr2=0x7f84ec102dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec10a9d0 0x7f84ec102dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 -- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 msgr2=0x7f84ec103310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 0x7f84ec103310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eaffd640 1 -- 172.21.15.39:0/2791874996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec1a7790 con 0x7f84ec1018c0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.777+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 0x7f84ec103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84eaffd640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005940 tx=0x7f84dc0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84e3fff640 1 -- 172.21.15.39:0/2791874996 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc03f030 con 0x7f84ec1018c0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ec199080 con 0x7f84ec1018c0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84e3fff640 1 -- 172.21.15.39:0/2791874996 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc0044c0 con 0x7f84ec1018c0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ec1995b0 con 0x7f84ec1018c0 2024-09-10T21:56:15.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.778+0000 7f84e3fff640 1 -- 172.21.15.39:0/2791874996 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc035070 con 0x7f84ec1018c0 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.780+0000 7f84f39ad740 1 Processor -- start 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84e3fff640 1 -- 172.21.15.39:0/2791874996 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f84dc03ba20 con 0x7f84ec1018c0 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 -- start start 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556b7775dea0 con 0x556b777e74d0 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b7774d2d0 con 0x556b777e7df0 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84f39ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556b777510e0 con 0x556b777f3d80 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60086/0 (socket says 172.21.15.39:60086) 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33776/0 (socket says 172.21.15.39:33776) 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84eb7fe640 1 -- 172.21.15.39:0/3257386512 learned_addr learned my addr 172.21.15.39:0/3257386512 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.781+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 -- 172.21.15.39:0/3257386512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 msgr2=0x556b777f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 -- 172.21.15.39:0/3257386512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 msgr2=0x556b777e78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777e78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 -- 172.21.15.39:0/3257386512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b774ab650 con 0x556b777e7df0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eaffd640 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84dc103ca0 tx=0x7f84dc10e540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c212495977ad60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84e3fff640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 0x7f84d80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 0x7f84d80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84e17fa640 1 -- 172.21.15.39:0/3257386512 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc1082d0 con 0x556b777e7df0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84e17fa640 1 -- 172.21.15.39:0/3257386512 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc113030 con 0x556b777e7df0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84e17fa640 1 -- 172.21.15.39:0/3257386512 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc117630 con 0x556b777e7df0 2024-09-10T21:56:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.782+0000 7f84e3fff640 1 -- 172.21.15.39:0/2791874996 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f84dc106250 con 0x7f84ec1018c0 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 -- 172.21.15.39:0/3257386512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 msgr2=0x556b777f3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 0x7f84d80b7820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84e4005c40 tx=0x7f84e4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84dc103ca0 tx=0x7f84dc10e540 comp rx=0 tx=0).stop 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 -- 172.21.15.39:0/3257386512 shutdown_connections 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777f3840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 --2- 172.21.15.39:0/3257386512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 -- 172.21.15.39:0/3257386512 >> 172.21.15.39:0/3257386512 conn(0x556b777e5300 msgr2=0x556b777e64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 -- 172.21.15.39:0/3257386512 shutdown_connections 2024-09-10T21:56:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.783+0000 7f84f39ad740 1 -- 172.21.15.39:0/3257386512 wait complete. 2024-09-10T21:56:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 -- start start 2024-09-10T21:56:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 Processor -- start 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777f3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556b775ae700 con 0x556b777e7df0 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b776e8160 con 0x556b777f3d80 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556b777f67c0 con 0x556b777e74d0 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84f39ad740 10 client.0 _ll_register_callbacks cb 0x556b777019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60088/0 (socket says 172.21.15.39:60088) 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777f3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36542/0 (socket says 172.21.15.39:36542) 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1292477916 learned_addr learned my addr 172.21.15.39:0/1292477916 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.784+0000 7f84eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33788/0 (socket says 172.21.15.39:33788) 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 msgr2=0x556b777f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1292477916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 msgr2=0x556b777f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1292477916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b77715c90 con 0x556b777e7df0 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f84d400b2f0 tx=0x7f84d400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8a4ea2263851d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004460 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f84d40035f0 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84dc113030 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f84d40037f0 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84f39ad740 10 client.15705 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.785+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b778020d0 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc113030 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f84d401fb40 con 0x556b777e7df0 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 10 client.15705 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 20 client.15705 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:15.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b77803680 0x556b77805ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 4 client.15705 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b7775fdf0 con 0x556b77803680 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84eaffd640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b77803680 0x556b77805ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84d27fc640 10 client.15705 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.786+0000 7f84eaffd640 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b77803680 0x556b77805ae0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5db20b14b12459c7 server_cookie=cfb90fc7be950bba in_seq=0 out_seq=0 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84d27fc640 1 -- 172.21.15.39:0/1292477916 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b7775fdf0 con 0x556b77803680 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84d27fc640 10 client.15705 handle_command_reply: tid=0 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 client.15705 shutdown 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 msgr2=0x556b777f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f84d400b2f0 tx=0x7f84d400b7b0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 shutdown_connections 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b77803680 0x556b77805ae0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777f3d80 0x556b777f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e7df0 0x556b777f0a70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1292477916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 >> 172.21.15.39:0/1292477916 conn(0x556b777e5300 msgr2=0x556b777eae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84d27fc640 0 client.15705 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 shutdown_connections 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.787+0000 7f84f39ad740 1 -- 172.21.15.39:0/1292477916 wait complete. 2024-09-10T21:56:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.788+0000 7f84f39ad740 20 client.15705 trim_cache size 0 max 16384 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.801+0000 7f84f39ad740 1 Processor -- start 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.801+0000 7f84f39ad740 1 -- start start 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1ac200 con 0x556b777e74d0 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1adda0 con 0x556b777e7df0 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33800/0 (socket says 172.21.15.39:33800) 2024-09-10T21:56:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1750339323 learned_addr learned my addr 172.21.15.39:0/1750339323 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.802+0000 7f84f39ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1ac8d0 con 0x556b777f3d80 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1750339323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 msgr2=0x556b777f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1750339323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 msgr2=0x556b777ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1750339323 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b777f1d40 con 0x556b777e7df0 2024-09-10T21:56:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009420 tx=0x7f84d400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60960740b149928 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84e0ff9640 1 -- 172.21.15.39:0/1750339323 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4009b60 con 0x556b777e7df0 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84e0ff9640 1 -- 172.21.15.39:0/1750339323 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d4024070 con 0x556b777e7df0 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.803+0000 7f84e0ff9640 1 -- 172.21.15.39:0/1750339323 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d401eb60 con 0x556b777e7df0 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 -- 172.21.15.39:0/1750339323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 msgr2=0x556b777e0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009420 tx=0x7f84d400bcb0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 -- 172.21.15.39:0/1750339323 shutdown_connections 2024-09-10T21:56:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777f3d80 0x556b777f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777e0320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1750339323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777e74d0 0x556b777ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.804+0000 7f84f39ad740 1 -- 172.21.15.39:0/1750339323 >> 172.21.15.39:0/1750339323 conn(0x556b777e5300 msgr2=0x556b777ebcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 -- 172.21.15.39:0/1750339323 shutdown_connections 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 -- 172.21.15.39:0/1750339323 wait complete. 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 -- start start 2024-09-10T21:56:15.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 Processor -- start 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777fba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.805+0000 7f84f39ad740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777f3d80 0x556b777f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84f39ad740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1ad670 con 0x556b777f3d80 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84f39ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1acfa0 con 0x556b777e7df0 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84f39ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec1aa220 con 0x556b777e74d0 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84f39ad740 10 client.0 _ll_register_callbacks cb 0x7f84d4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33812/0 (socket says 172.21.15.39:33812) 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1181111964 learned_addr learned my addr 172.21.15.39:0/1181111964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84eb7fe640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777f3d80 0x556b777f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84eaffd640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 msgr2=0x556b777fba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777fba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1181111964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777f3d80 msgr2=0x556b777f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777f3d80 0x556b777f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 -- 172.21.15.39:0/1181111964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b777fc5a0 con 0x556b777e7df0 2024-09-10T21:56:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84ea7fc640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x556b777e09b0 tx=0x7f84d4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dad108fa380d9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.806+0000 7f84d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4041070 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d4024070 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f84d401e4f0 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f84d40052e0 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 10 client.25307 fetch_fsmap learned FSMap version 28 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b778709f0 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d4024070 con 0x556b777e7df0 2024-09-10T21:56:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f84d401f590 con 0x556b777e7df0 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 10 client.25307 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 10 client.25307 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 20 client.25307 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b778710e0 0x556b77873500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 4 client.25307 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.807+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b7775b8a0 con 0x556b778710e0 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84eaffd640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b778710e0 0x556b77873500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84eaffd640 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b778710e0 0x556b77873500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b9836e1fe163358 server_cookie=42a02946376c0b2c in_seq=0 out_seq=0 2024-09-10T21:56:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84d27fc640 10 client.25307 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84d27fc640 1 -- 172.21.15.39:0/1181111964 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b7775b8a0 con 0x556b778710e0 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84d27fc640 10 client.25307 handle_command_reply: tid=0 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 client.25307 shutdown 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 msgr2=0x556b777fbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x556b777e09b0 tx=0x7f84d4005f90 comp rx=0 tx=0).stop 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 shutdown_connections 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556b778710e0 0x556b77873500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84d27fc640 0 client.25307 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b777f3d80 0x556b777f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b777e7df0 0x556b777fbf60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 --2- 172.21.15.39:0/1181111964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b777e74d0 0x556b777fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 >> 172.21.15.39:0/1181111964 conn(0x556b777e5300 msgr2=0x556b777e3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 shutdown_connections 2024-09-10T21:56:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.808+0000 7f84f39ad740 1 -- 172.21.15.39:0/1181111964 wait complete. 2024-09-10T21:56:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f39ad740 20 client.25307 trim_cache size 0 max 16384 2024-09-10T21:56:15.815 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 msgr2=0x7f84d80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 0x7f84d80b7820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84e4005c40 tx=0x7f84e4009500 comp rx=0 tx=0).stop 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 msgr2=0x7f84ec102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005940 tx=0x7f84dc0040c0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 shutdown_connections 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f84d80b5360 0x7f84d80b7820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84ec10d300 0x7f84ec103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84ec10a9d0 0x7f84ec102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 --2- 172.21.15.39:0/2791874996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84ec1018c0 0x7f84ec102890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.809+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 >> 172.21.15.39:0/2791874996 conn(0x7f84ec076e50 msgr2=0x7f84ec100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.810+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 shutdown_connections 2024-09-10T21:56:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:15.810+0000 7f84f15d8640 1 -- 172.21.15.39:0/2791874996 wait complete. 2024-09-10T21:56:16.500 INFO:tasks.workunit.client.0.smithi039.stdout: 27 482402 721 273431 603 191231 1451 2024-09-10T21:56:16.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:56:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0b1ffb640 1 -- 172.21.15.39:0/3952301378 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ad8af10f0 con 0x562ad8c03df0 2024-09-10T21:56:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0b1ffb640 10 client.25289 handle_command_reply: tid=0 2024-09-10T21:56:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 client.25289 shutdown 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 msgr2=0x562ad8b92680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc03cd90 tx=0x7fe0bc03ce80 comp rx=0 tx=0).stop 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 shutdown_connections 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562ad8c03df0 0x562ad8c06210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ad8b86bd0 0x562ad8b918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562ad8b84190 0x562ad8b91380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 --2- 172.21.15.39:0/3952301378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad8b81860 0x562ad8b92680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0b1ffb640 0 client.25289 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.839+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 >> 172.21.15.39:0/3952301378 conn(0x562ad8b7c9b0 msgr2=0x562ad8b8aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 shutdown_connections 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d381b740 1 -- 172.21.15.39:0/3952301378 wait complete. 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d381b740 20 client.25289 trim_cache size 0 max 16384 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:56:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 msgr2=0x7fe0b40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 0x7fe0b40b78b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc006010 tx=0x7fe0bc0314a0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 msgr2=0x7fe0cc198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.840+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000e9f0 tx=0x7fe0c000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 shutdown_connections 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe0b40b53f0 0x7fe0b40b78b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0cc103370 0x7fe0cc198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0cc1029b0 0x7fe0cc198330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 --2- 172.21.15.39:0/564934297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0cc101860 0x7fe0cc197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 >> 172.21.15.39:0/564934297 conn(0x7fe0cc0fd140 msgr2=0x7fe0cc103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 shutdown_connections 2024-09-10T21:56:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:16.841+0000 7fe0d096b640 1 -- 172.21.15.39:0/564934297 wait complete. 2024-09-10T21:56:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:16 smithi070 ceph-mon[34909]: pgmap v379: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 463 op/s 2024-09-10T21:56:16.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:16 smithi070 ceph-mon[34909]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T21:56:16.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:16 smithi039 ceph-mon[30872]: pgmap v379: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 463 op/s 2024-09-10T21:56:16.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:16 smithi039 ceph-mon[30872]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T21:56:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:16 smithi173 ceph-mon[35294]: pgmap v379: 97 pgs: 97 active+clean; 55 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 463 op/s 2024-09-10T21:56:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:16 smithi173 ceph-mon[35294]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T21:56:17.017 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 -- 172.21.15.39:0/311851741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 msgr2=0x7f228c107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 --2- 172.21.15.39:0/311851741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c107c00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f227c009930 tx=0x7f227c02a420 comp rx=0 tx=0).stop 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 -- 172.21.15.39:0/311851741 shutdown_connections 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 --2- 172.21.15.39:0/311851741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c108140 0x7f228c10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 --2- 172.21.15.39:0/311851741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c107c00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 --2- 172.21.15.39:0/311851741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c1029d0 0x7f228c102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.519+0000 7f2293ac1640 1 -- 172.21.15.39:0/311851741 >> 172.21.15.39:0/311851741 conn(0x7f228c076e20 msgr2=0x7f228c077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.520+0000 7f2293ac1640 1 -- 172.21.15.39:0/311851741 shutdown_connections 2024-09-10T21:56:17.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.520+0000 7f2293ac1640 1 -- 172.21.15.39:0/311851741 wait complete. 2024-09-10T21:56:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.520+0000 7f2293ac1640 1 Processor -- start 2024-09-10T21:56:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.520+0000 7f2293ac1640 1 -- start start 2024-09-10T21:56:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.520+0000 7f2293ac1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f2293ac1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f2293ac1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 0x7f228c1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f2293ac1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f228c111cb0 con 0x7f228c1077c0 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f2293ac1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f228c111b30 con 0x7f228c1029d0 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f2293ac1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f228c111e30 con 0x7f228c108140 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229205e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 0x7f228c1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33834/0 (socket says 172.21.15.39:33834) 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229205e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 0x7f228c1a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36580/0 (socket says 172.21.15.39:36580) 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 -- 172.21.15.39:0/3177807077 learned_addr learned my addr 172.21.15.39:0/3177807077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229105c640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 -- 172.21.15.39:0/3177807077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 msgr2=0x7f228c1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 0x7f228c1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 -- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 msgr2=0x7f228c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 -- 172.21.15.39:0/3177807077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c1a15f0 con 0x7f228c1029d0 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.521+0000 7f229185d640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f228800e9f0 tx=0x7f228800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.522+0000 7f2282ffd640 1 -- 172.21.15.39:0/3177807077 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228800cd80 con 0x7f228c1029d0 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.522+0000 7f2282ffd640 1 -- 172.21.15.39:0/3177807077 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22880054d0 con 0x7f228c1029d0 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.522+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1a18e0 con 0x7f228c1029d0 2024-09-10T21:56:17.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.522+0000 7f2282ffd640 1 -- 172.21.15.39:0/3177807077 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288010690 con 0x7f228c1029d0 2024-09-10T21:56:17.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.522+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1a7fa0 con 0x7f228c1029d0 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.524+0000 7f2282ffd640 1 -- 172.21.15.39:0/3177807077 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2288004e90 con 0x7f228c1029d0 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 Processor -- start 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 -- start start 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5607d3f21ea0 con 0x5607d3fb79a0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5607d3f112d0 con 0x5607d3fab0f0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f2295e96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5607d3f150e0 con 0x5607d3faba10 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f229205e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f229185d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.525+0000 7f229105c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33846/0 (socket says 172.21.15.39:33846) 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229105c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60124/0 (socket says 172.21.15.39:60124) 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 -- 172.21.15.39:0/1378483617 learned_addr learned my addr 172.21.15.39:0/1378483617 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f2282ffd640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 0x7f22780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 0x7f22780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f2282ffd640 1 -- 172.21.15.39:0/3177807077 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f22880e5f50 con 0x7f228c1029d0 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 -- 172.21.15.39:0/1378483617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 msgr2=0x5607d3fb7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 -- 172.21.15.39:0/1378483617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 msgr2=0x5607d3fb9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 -- 172.21.15.39:0/1378483617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d3c6f650 con 0x5607d3fab0f0 2024-09-10T21:56:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229105c640 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f229205e640 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2284005c40 tx=0x7f2284013f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf9e6ff0172048e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.526+0000 7f2277fff640 1 -- 172.21.15.39:0/1378483617 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228402e070 con 0x5607d3fab0f0 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2277fff640 1 -- 172.21.15.39:0/1378483617 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2284025030 con 0x5607d3fab0f0 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2277fff640 1 -- 172.21.15.39:0/1378483617 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284010c60 con 0x5607d3fab0f0 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f229205e640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 0x7f22780b7820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f228402b000 tx=0x7f2284027000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 -- 172.21.15.39:0/1378483617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 msgr2=0x5607d3fab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2284005c40 tx=0x7f2284013f50 comp rx=0 tx=0).stop 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 -- 172.21.15.39:0/1378483617 shutdown_connections 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 --2- 172.21.15.39:0/1378483617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fab4d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.527+0000 7f2295e96740 1 -- 172.21.15.39:0/1378483617 >> 172.21.15.39:0/1378483617 conn(0x5607d3fa8f20 msgr2=0x5607d3faa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.528+0000 7f2295e96740 1 -- 172.21.15.39:0/1378483617 shutdown_connections 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.528+0000 7f2295e96740 1 -- 172.21.15.39:0/1378483617 wait complete. 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.528+0000 7f2295e96740 1 -- start start 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.528+0000 7f2295e96740 1 Processor -- start 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33862/0 (socket says 172.21.15.39:33862) 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229105c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 -- 172.21.15.39:0/4263582420 learned_addr learned my addr 172.21.15.39:0/4263582420 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5607d3d72700 con 0x5607d3fb79a0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5607d3eac160 con 0x5607d3fab0f0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5607d3fba620 con 0x5607d3faba10 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229205e640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f2295e96740 10 client.0 _ll_register_callbacks cb 0x5607d3ec59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 -- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 msgr2=0x5607d3fb4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 -- 172.21.15.39:0/4263582420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 msgr2=0x5607d3fb4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.529+0000 7f229185d640 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d3ed9c90 con 0x5607d3fab0f0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f229185d640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22880e3a60 tx=0x7f22880ac5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839853c2fce751e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f22757fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880ac230 con 0x5607d3fab0f0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f22880a8990 con 0x5607d3fab0f0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2284025030 con 0x5607d3fab0f0 2024-09-10T21:56:17.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2288005680 con 0x5607d3fab0f0 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f2295e96740 10 client.25319 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607d3fc5ee0 con 0x5607d3fab0f0 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.530+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22880ace20 con 0x5607d3fab0f0 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f22880b5820 con 0x5607d3fab0f0 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 10 client.25319 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 10 client.25319 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 20 client.25319 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d3fc73a0 0x5607d3fc9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 4 client.25319 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2284025030 con 0x5607d3fc73a0 2024-09-10T21:56:17.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f229105c640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d3fc73a0 0x5607d3fc9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f229105c640 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d3fc73a0 0x5607d3fc9790 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec34f91b62cc55a server_cookie=53f6e8b99e778ed8 in_seq=0 out_seq=0 2024-09-10T21:56:17.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.531+0000 7f22757fa640 10 client.25319 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:56:17.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f22757fa640 1 -- 172.21.15.39:0/4263582420 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2284025030 con 0x5607d3fc73a0 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f22757fa640 10 client.25319 handle_command_reply: tid=0 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 client.25319 shutdown 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 msgr2=0x5607d3fb7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22880e3a60 tx=0x7f22880ac5b0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 shutdown_connections 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fb4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fb4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d3fc73a0 0x5607d3fc9790 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.532+0000 7f2295e96740 1 --2- 172.21.15.39:0/4263582420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fb7230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.533+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 >> 172.21.15.39:0/4263582420 conn(0x5607d3fa8f20 msgr2=0x5607d3faea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.533+0000 7f22757fa640 0 client.25319 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:56:17.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.533+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 shutdown_connections 2024-09-10T21:56:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.533+0000 7f2295e96740 1 -- 172.21.15.39:0/4263582420 wait complete. 2024-09-10T21:56:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.533+0000 7f2295e96740 20 client.25319 trim_cache size 0 max 16384 2024-09-10T21:56:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 Processor -- start 2024-09-10T21:56:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 -- start start 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 0x5607d3fa8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3faba10 0x5607d3fb8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 0x5607d3fb92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ac1b0 con 0x5607d3faba10 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1add80 con 0x5607d3fb79a0 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.559+0000 7f2295e96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ac880 con 0x5607d3fab0f0 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229185d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 0x5607d3fa8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229185d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 0x5607d3fa8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36598/0 (socket says 172.21.15.39:36598) 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229185d640 1 -- 172.21.15.39:0/170712774 learned_addr learned my addr 172.21.15.39:0/170712774 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229105c640 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3faba10 0x5607d3fb8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 0x5607d3fb92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 -- 172.21.15.39:0/170712774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 msgr2=0x5607d3fa8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 0x5607d3fa8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 -- 172.21.15.39:0/170712774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3faba10 msgr2=0x5607d3fb8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3faba10 0x5607d3fb8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 -- 172.21.15.39:0/170712774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d3fb2b80 con 0x5607d3fb79a0 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.560+0000 7f229205e640 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 0x5607d3fb92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2284005fd0 tx=0x7f228400ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453c352252990f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.561+0000 7f22777fe640 1 -- 172.21.15.39:0/170712774 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228402e040 con 0x5607d3fb79a0 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.561+0000 7f22777fe640 1 -- 172.21.15.39:0/170712774 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2284025040 con 0x5607d3fb79a0 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.561+0000 7f22777fe640 1 -- 172.21.15.39:0/170712774 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284010690 con 0x5607d3fb79a0 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 -- 172.21.15.39:0/170712774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 msgr2=0x5607d3fb92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 0x5607d3fb92d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2284005fd0 tx=0x7f228400ff10 comp rx=0 tx=0).stop 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 -- 172.21.15.39:0/170712774 shutdown_connections 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fb79a0 0x5607d3fb92d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3faba10 0x5607d3fb8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 --2- 172.21.15.39:0/170712774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3fab0f0 0x5607d3fa8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.562+0000 7f2295e96740 1 -- 172.21.15.39:0/170712774 >> 172.21.15.39:0/170712774 conn(0x5607d3fa8f20 msgr2=0x5607d3fa9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.563+0000 7f2295e96740 1 -- 172.21.15.39:0/170712774 shutdown_connections 2024-09-10T21:56:17.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.563+0000 7f2295e96740 1 -- 172.21.15.39:0/170712774 wait complete. 2024-09-10T21:56:17.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.564+0000 7f2295e96740 1 -- start start 2024-09-10T21:56:17.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.564+0000 7f2295e96740 1 Processor -- start 2024-09-10T21:56:17.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.564+0000 7f2295e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.564+0000 7f2295e96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fbfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.564+0000 7f2295e96740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f2295e96740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ad620 con 0x5607d3fb79a0 2024-09-10T21:56:17.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f2295e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1acf50 con 0x5607d3fab0f0 2024-09-10T21:56:17.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f2295e96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1aa1f0 con 0x5607d3faba10 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229105c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fbfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f2295e96740 10 client.0 _ll_register_callbacks cb 0x7f228800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229105c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fbfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36604/0 (socket says 172.21.15.39:36604) 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229105c640 1 -- 172.21.15.39:0/48540395 learned_addr learned my addr 172.21.15.39:0/48540395 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33882/0 (socket says 172.21.15.39:33882) 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229205e640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 -- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 msgr2=0x5607d3fbfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fbfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 -- 172.21.15.39:0/48540395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 msgr2=0x5607d3fba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229185d640 1 -- 172.21.15.39:0/48540395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d3fc0660 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.565+0000 7f229205e640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f229185d640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22880ac6b0 tx=0x7f22880e9390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60f3a7deb582a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880a83f0 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f22880ab3f0 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2284025040 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f22880a85c0 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f2295e96740 10 client.25325 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607d40347f0 con 0x5607d3fab0f0 2024-09-10T21:56:17.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22880ac230 con 0x5607d3fab0f0 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.566+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f22880cfa70 con 0x5607d3fab0f0 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 10 client.25325 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 10 client.25325 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 20 client.25325 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d4034f20 0x5607d4037340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 4 client.25325 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2284025040 con 0x5607d4034f20 2024-09-10T21:56:17.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f229105c640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d4034f20 0x5607d4037340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:17.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f22757fa640 10 client.25325 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:56:17.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.567+0000 7f229105c640 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d4034f20 0x5607d4037340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1656e6e7ed47cfa1 server_cookie=3e236bdd96708b36 in_seq=0 out_seq=0 2024-09-10T21:56:17.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f22757fa640 1 -- 172.21.15.39:0/48540395 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2284025040 con 0x5607d4034f20 2024-09-10T21:56:17.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f22757fa640 10 client.25325 handle_command_reply: tid=0 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 client.25325 shutdown 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 msgr2=0x5607d3fbf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22880ac6b0 tx=0x7f22880e9390 comp rx=0 tx=0).stop 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 shutdown_connections 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5607d3fb79a0 0x5607d3fba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5607d3faba10 0x5607d3fbfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5607d4034f20 0x5607d4037340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 --2- 172.21.15.39:0/48540395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5607d3fab0f0 0x5607d3fbf8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f22757fa640 0 client.25325 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 >> 172.21.15.39:0/48540395 conn(0x5607d3fa8f20 msgr2=0x5607d3fb5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 shutdown_connections 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 1 -- 172.21.15.39:0/48540395 wait complete. 2024-09-10T21:56:17.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.568+0000 7f2295e96740 20 client.25325 trim_cache size 0 max 16384 2024-09-10T21:56:17.573 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:56:17.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 msgr2=0x7f22780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 0x7f22780b7820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f228402b000 tx=0x7f2284027000 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 msgr2=0x7f228c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f228800e9f0 tx=0x7f228800edf0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 shutdown_connections 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f22780b5360 0x7f22780b7820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c108140 0x7f228c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1077c0 0x7f228c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 --2- 172.21.15.39:0/3177807077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f228c1029d0 0x7f228c19b540 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.569+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 >> 172.21.15.39:0/3177807077 conn(0x7f228c076e20 msgr2=0x7f228c10cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.570+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 shutdown_connections 2024-09-10T21:56:17.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:17.570+0000 7f2293ac1640 1 -- 172.21.15.39:0/3177807077 wait complete. 2024-09-10T21:56:17.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:17 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:17.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:17 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:18.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:17 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:18.453 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:56:18.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:18 smithi039 ceph-mon[30872]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 721 op/s 2024-09-10T21:56:18.740 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:18 smithi173 ceph-mon[35294]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 721 op/s 2024-09-10T21:56:19.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:18 smithi070 ceph-mon[34909]: pgmap v380: 97 pgs: 97 active+clean; 46 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.4 MiB/s wr, 721 op/s 2024-09-10T21:56:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 -- 172.21.15.39:0/821812759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 msgr2=0x7f09b010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 --2- 172.21.15.39:0/821812759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b010cb10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f099c009900 tx=0x7f099c02a410 comp rx=0 tx=0).stop 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 -- 172.21.15.39:0/821812759 shutdown_connections 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 --2- 172.21.15.39:0/821812759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b010d0e0 0x7f09b010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 --2- 172.21.15.39:0/821812759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b010cb10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 --2- 172.21.15.39:0/821812759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b0103b30 0x7f09b0103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 -- 172.21.15.39:0/821812759 >> 172.21.15.39:0/821812759 conn(0x7f09b00fd700 msgr2=0x7f09b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 -- 172.21.15.39:0/821812759 shutdown_connections 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.241+0000 7f09b7066640 1 -- 172.21.15.39:0/821812759 wait complete. 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 Processor -- start 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 -- start start 2024-09-10T21:56:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 0x7f09b01019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 0x7f09b0102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0112db0 con 0x7f09b0104530 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0112c30 con 0x7f09b010d0e0 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b7066640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0112f30 con 0x7f09b0103b30 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09b4e02640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 0x7f09b01019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60168/0 (socket says 172.21.15.39:60168) 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.242+0000 7f09affff640 1 -- 172.21.15.39:0/604233666 learned_addr learned my addr 172.21.15.39:0/604233666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09b5603640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 0x7f09b0102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 -- 172.21.15.39:0/604233666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 msgr2=0x7f09b01019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 0x7f09b01019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 -- 172.21.15.39:0/604233666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 msgr2=0x7f09b0102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 0x7f09b0102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 -- 172.21.15.39:0/604233666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b01a7700 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09b5603640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 0x7f09b0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09b4e02640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 0x7f09b01019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09affff640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f099c005ab0 tx=0x7f099c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09adffb640 1 -- 172.21.15.39:0/604233666 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c03f070 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09adffb640 1 -- 172.21.15.39:0/604233666 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f099c031b60 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.243+0000 7f09adffb640 1 -- 172.21.15.39:0/604233666 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c035030 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.244+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b01a7990 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.244+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b01a7e20 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.246+0000 7f09adffb640 1 -- 172.21.15.39:0/604233666 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f099c04c060 con 0x7f09b0104530 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.246+0000 7f09b943b740 1 Processor -- start 2024-09-10T21:56:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 -- start start 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdeca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdecad80 0x5569bdecd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5569bde34ea0 con 0x5569bdebedf0 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569bde242d0 con 0x5569bdecad80 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b943b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5569bde280e0 con 0x5569bdebe4d0 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b4e02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdeca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36626/0 (socket says 172.21.15.39:36626) 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 -- 172.21.15.39:0/2710848141 learned_addr learned my addr 172.21.15.39:0/2710848141 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09affff640 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdecad80 0x5569bdecd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09adffb640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 0x7f09a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 -- 172.21.15.39:0/2710848141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdecad80 msgr2=0x5569bdecd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdecad80 0x5569bdecd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 -- 172.21.15.39:0/2710848141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 msgr2=0x5569bdeca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdeca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b5603640 1 -- 172.21.15.39:0/2710848141 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569bdb82650 con 0x5569bdebe4d0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.247+0000 7f09b4e02640 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdeca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f09b5603640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 0x7f09a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f09adffb640 1 -- 172.21.15.39:0/604233666 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f099c105e40 con 0x7f09b0104530 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f09b5603640 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09a8011880 tx=0x7f09a8011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a21a387e469926c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f099affd640 1 -- 172.21.15.39:0/2710848141 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8017050 con 0x5569bdebe4d0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f09b5603640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 0x7f09a00b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09a8023000 tx=0x7f09a8024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f099affd640 1 -- 172.21.15.39:0/2710848141 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8026440 con 0x5569bdebe4d0 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.248+0000 7f099affd640 1 -- 172.21.15.39:0/2710848141 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a800e610 con 0x5569bdebe4d0 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- 172.21.15.39:0/2710848141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 msgr2=0x5569bdebe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09a8011880 tx=0x7f09a8011d40 comp rx=0 tx=0).stop 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- 172.21.15.39:0/2710848141 shutdown_connections 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdecad80 0x5569bdecd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdeca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 --2- 172.21.15.39:0/2710848141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebe4d0 0x5569bdebe8b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- 172.21.15.39:0/2710848141 >> 172.21.15.39:0/2710848141 conn(0x5569bdebc300 msgr2=0x5569bdebd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- 172.21.15.39:0/2710848141 shutdown_connections 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- 172.21.15.39:0/2710848141 wait complete. 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 -- start start 2024-09-10T21:56:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.249+0000 7f09b943b740 1 Processor -- start 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdec7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdecad80 0x5569bdec80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5569bdc85700 con 0x5569bdebedf0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569bddbf160 con 0x5569bdebe4d0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5569bdecda00 con 0x5569bdecad80 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b943b740 10 client.0 _ll_register_callbacks cb 0x5569bddd89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdec7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b5603640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdecad80 0x5569bdec80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09affff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdec7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60198/0 (socket says 172.21.15.39:60198) 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33940/0 (socket says 172.21.15.39:33940) 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 -- 172.21.15.39:0/3678370216 learned_addr learned my addr 172.21.15.39:0/3678370216 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 -- 172.21.15.39:0/3678370216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdecad80 msgr2=0x5569bdec80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdecad80 0x5569bdec80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 -- 172.21.15.39:0/3678370216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 msgr2=0x5569bdec7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdec7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.250+0000 7f09b4e02640 1 -- 172.21.15.39:0/3678370216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569bddecc90 con 0x5569bdebe4d0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f09b4e02640 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09a4012d20 tx=0x7f09a400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e311053b589c6f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f098ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40120d0 con 0x5569bdebe4d0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f09a4004020 con 0x5569bdebe4d0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a8026440 con 0x5569bdebe4d0 2024-09-10T21:56:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f09a4012270 con 0x5569bdebe4d0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f09b943b740 10 client.25337 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.251+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569bded9390 con 0x5569bdebe4d0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8026440 con 0x5569bdebe4d0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f09a401c470 con 0x5569bdebe4d0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 10 client.25337 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 10 client.25337 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 20 client.25337 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdedccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 4 client.25337 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569bde36df0 con 0x5569bdeda8a0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.252+0000 7f09affff640 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdedccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.253+0000 7f09affff640 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdedccc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1252faa8c241444d server_cookie=cb3c010ff3e6df95 in_seq=0 out_seq=0 2024-09-10T21:56:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.253+0000 7f098ffff640 10 client.25337 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.253+0000 7f098ffff640 1 -- 172.21.15.39:0/3678370216 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569bde36df0 con 0x5569bdeda8a0 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.253+0000 7f098ffff640 10 client.25337 handle_command_reply: tid=0 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.253+0000 7f09b943b740 1 client.25337 shutdown 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 msgr2=0x5569bdeca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09a4012d20 tx=0x7f09a400f790 comp rx=0 tx=0).stop 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 shutdown_connections 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdedccc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f098ffff640 0 client.25337 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdecad80 0x5569bdec80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdebedf0 0x5569bdec7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 --2- 172.21.15.39:0/3678370216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdeca670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 >> 172.21.15.39:0/3678370216 conn(0x5569bdebc300 msgr2=0x5569bdec1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 shutdown_connections 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 1 -- 172.21.15.39:0/3678370216 wait complete. 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.254+0000 7f09b943b740 20 client.25337 trim_cache size 0 max 16384 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 Processor -- start 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 -- start start 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdec7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bdecc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b0590 con 0x5569bdecad80 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b2160 con 0x5569bdebe4d0 2024-09-10T21:56:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b943b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b0c60 con 0x5569bdebedf0 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60210/0 (socket says 172.21.15.39:60210) 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 -- 172.21.15.39:0/3607046751 learned_addr learned my addr 172.21.15.39:0/3607046751 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b4e02640 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdec7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09affff640 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bdecc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 -- 172.21.15.39:0/3607046751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 msgr2=0x5569bdecc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bdecc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 -- 172.21.15.39:0/3607046751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 msgr2=0x5569bdec7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdec7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.268+0000 7f09b5603640 1 -- 172.21.15.39:0/3607046751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569bded7070 con 0x5569bdecad80 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.269+0000 7f09b5603640 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09a8011fd0 tx=0x7f09a8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b3febfcb872e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.269+0000 7f099a7fc640 1 -- 172.21.15.39:0/3607046751 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8026e30 con 0x5569bdecad80 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.269+0000 7f099a7fc640 1 -- 172.21.15.39:0/3607046751 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8036070 con 0x5569bdecad80 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.269+0000 7f099a7fc640 1 -- 172.21.15.39:0/3607046751 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80266a0 con 0x5569bdecad80 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- 172.21.15.39:0/3607046751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 msgr2=0x5569bdecc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09a8011fd0 tx=0x7f09a8009480 comp rx=0 tx=0).stop 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- 172.21.15.39:0/3607046751 shutdown_connections 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecc6b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bdecc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- 172.21.15.39:0/3607046751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bdec7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- 172.21.15.39:0/3607046751 >> 172.21.15.39:0/3607046751 conn(0x5569bdebc300 msgr2=0x5569bdec2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- 172.21.15.39:0/3607046751 shutdown_connections 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- 172.21.15.39:0/3607046751 wait complete. 2024-09-10T21:56:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- start start 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 Processor -- start 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bded3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bded3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b1a00 con 0x5569bdecad80 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b1330 con 0x5569bdebe4d0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.270+0000 7f09b943b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ae570 con 0x5569bdebedf0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b943b740 10 client.0 _ll_register_callbacks cb 0x7f09a4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09affff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bded3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b4e02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bded3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60224/0 (socket says 172.21.15.39:60224) 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09affff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bded3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36662/0 (socket says 172.21.15.39:36662) 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 -- 172.21.15.39:0/418945765 learned_addr learned my addr 172.21.15.39:0/418945765 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 -- 172.21.15.39:0/418945765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 msgr2=0x5569bded3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bded3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 -- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 msgr2=0x5569bded3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bded3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 -- 172.21.15.39:0/418945765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569bdece590 con 0x5569bdecad80 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b4e02640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bded3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b5603640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f09a801d010 tx=0x7f09a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72045d7fb11d028d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f098ffff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a803e020 con 0x5569bdecad80 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f09a801bae0 con 0x5569bdecad80 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.271+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a8036070 con 0x5569bdecad80 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f09a8017040 con 0x5569bdecad80 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 10 client.15744 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:19.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569bdf483f0 con 0x5569bdecad80 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8036070 con 0x5569bdecad80 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f09a80043e0 con 0x5569bdecad80 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 10 client.15744 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 10 client.15744 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 20 client.15744 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdf4a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 4 client.15744 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569bde328a0 con 0x5569bdeda8a0 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.272+0000 7f09b4e02640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdf4a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b4e02640 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdf4a9e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ee38d0cbef68939 server_cookie=e8a6094036bf759 in_seq=0 out_seq=0 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f098ffff640 10 client.15744 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f098ffff640 1 -- 172.21.15.39:0/418945765 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569bde328a0 con 0x5569bdeda8a0 2024-09-10T21:56:19.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f098ffff640 10 client.15744 handle_command_reply: tid=0 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 client.15744 shutdown 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 msgr2=0x5569bdecdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f09a801d010 tx=0x7f09a8009750 comp rx=0 tx=0).stop 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 shutdown_connections 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x5569bdeda8a0 0x5569bdf4a9e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5569bdecad80 0x5569bdecdd90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5569bdebedf0 0x5569bded3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f098ffff640 0 client.15744 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 --2- 172.21.15.39:0/418945765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569bdebe4d0 0x5569bded3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 >> 172.21.15.39:0/418945765 conn(0x5569bdebc300 msgr2=0x5569bdec1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 shutdown_connections 2024-09-10T21:56:19.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 1 -- 172.21.15.39:0/418945765 wait complete. 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.273+0000 7f09b943b740 20 client.15744 trim_cache size 0 max 16384 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 msgr2=0x7f09a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 0x7f09a00b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09a8023000 tx=0x7f09a8024000 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 msgr2=0x7f09b0101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f099c005ab0 tx=0x7f099c003c10 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 shutdown_connections 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f09a00b5360 0x7f09a00b7820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09b010d0e0 0x7f09b0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09b0104530 0x7f09b0101ef0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 --2- 172.21.15.39:0/604233666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0103b30 0x7f09b01019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 >> 172.21.15.39:0/604233666 conn(0x7f09b00fd700 msgr2=0x7f09b00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 shutdown_connections 2024-09-10T21:56:19.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:19.274+0000 7f09b7066640 1 -- 172.21.15.39:0/604233666 wait complete. 2024-09-10T21:56:19.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:56:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:20.744 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:20 smithi039 ceph-mon[30872]: pgmap v381: 97 pgs: 97 active+clean; 40 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-09-10T21:56:20.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.829+0000 7fd2f5627640 1 -- 172.21.15.39:0/2128542873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f01087d0 msgr2=0x7fd2f0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 --2- 172.21.15.39:0/2128542873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f01087d0 0x7fd2f0108c10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009900 tx=0x7fd2d802a410 comp rx=0 tx=0).stop 2024-09-10T21:56:20.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 -- 172.21.15.39:0/2128542873 shutdown_connections 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 --2- 172.21.15.39:0/2128542873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0109150 0x7fd2f010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 --2- 172.21.15.39:0/2128542873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f01087d0 0x7fd2f0108c10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 --2- 172.21.15.39:0/2128542873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 -- 172.21.15.39:0/2128542873 >> 172.21.15.39:0/2128542873 conn(0x7fd2f00fe850 msgr2=0x7fd2f0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 -- 172.21.15.39:0/2128542873 shutdown_connections 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 -- 172.21.15.39:0/2128542873 wait complete. 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 Processor -- start 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.830+0000 7fd2f5627640 1 -- start start 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 0x7fd2f0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 0x7fd2f019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112e10 con 0x7fd2f0109150 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112c90 con 0x7fd2f01087d0 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2f5627640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0112f90 con 0x7fd2f0102dc0 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 0x7fd2f019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 0x7fd2f0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:46970/0 (socket says 172.21.15.39:46970) 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2eeffd640 1 -- 172.21.15.39:0/3872027844 learned_addr learned my addr 172.21.15.39:0/3872027844 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/3872027844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 msgr2=0x7fd2f01991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/3872027844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 msgr2=0x7fd2f0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 0x7fd2f0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/3872027844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f019f290 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 0x7fd2f0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.831+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 0x7fd2f019eac0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8007db0 tx=0x7fd2e8010420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.832+0000 7fd2ecff9640 1 -- 172.21.15.39:0/3872027844 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8010d40 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.832+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f019f580 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.832+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f0075380 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.832+0000 7fd2ecff9640 1 -- 172.21.15.39:0/3872027844 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e800e520 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.832+0000 7fd2ecff9640 1 -- 172.21.15.39:0/3872027844 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8020660 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.834+0000 7fd2ecff9640 1 -- 172.21.15.39:0/3872027844 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd2e8016070 con 0x7fd2f0109150 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 Processor -- start 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 -- start start 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824b8e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d824b04ea0 con 0x55d824b8e4d0 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d824af42d0 con 0x55d824b9ad80 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d824af80e0 con 0x55d824b8edf0 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824b8e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:46978/0 (socket says 172.21.15.39:46978) 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824b8e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54238/0 (socket says 172.21.15.39:54238) 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1109561200 learned_addr learned my addr 172.21.15.39:0/1109561200 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.835+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1109561200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 msgr2=0x55d824b9d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b9d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1109561200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 msgr2=0x55d824b8e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824b8e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1109561200 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d824852650 con 0x55d824b8edf0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2ecff9640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 0x7fd2dc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 0x7fd2dc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011650 tx=0x7fd2e0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f437f43b3a307ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2ecff9640 1 -- 172.21.15.39:0/3872027844 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd2e80e93d0 con 0x7fd2f0109150 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2e57fa640 1 -- 172.21.15.39:0/1109561200 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e001e070 con 0x55d824b8edf0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2e57fa640 1 -- 172.21.15.39:0/1109561200 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e000fb70 con 0x55d824b8edf0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.836+0000 7fd2e57fa640 1 -- 172.21.15.39:0/1109561200 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0019c60 con 0x55d824b8edf0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1109561200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 msgr2=0x55d824b9a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 0x7fd2dc0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8031440 tx=0x7fd2d8032f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011650 tx=0x7fd2e0009f90 comp rx=0 tx=0).stop 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1109561200 shutdown_connections 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b9a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1109561200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824b8e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1109561200 >> 172.21.15.39:0/1109561200 conn(0x55d824b8c300 msgr2=0x55d824b8d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1109561200 shutdown_connections 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1109561200 wait complete. 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 -- start start 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.837+0000 7fd2f79fc740 1 Processor -- start 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8e4d0 0x55d824b9a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8edf0 0x55d824b97a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d824955700 con 0x55d824b8edf0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d824a8f160 con 0x55d824b9ad80 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d824b9da00 con 0x55d824b8e4d0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2f79fc740 10 client.0 _ll_register_callbacks cb 0x55d824aa89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8edf0 0x55d824b97a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34476/0 (socket says 172.21.15.39:34476) 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8e4d0 0x55d824b9a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/1094995595 learned_addr learned my addr 172.21.15.39:0/1094995595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8e4d0 msgr2=0x55d824b9a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8e4d0 0x55d824b9a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/1094995595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8edf0 msgr2=0x55d824b97a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8edf0 0x55d824b97a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 -- 172.21.15.39:0/1094995595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d824abcc90 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80af8a0 tx=0x7fd2e80af770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b68849888110d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.838+0000 7fd2d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80b4020 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e000fb70 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd2e80b43c0 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd2e80afba0 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 10 client.25355 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d824ba9410 con 0x55d824b9ad80 2024-09-10T21:56:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e000fb70 con 0x55d824b9ad80 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fd2e80ae870 con 0x55d824b9ad80 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 10 client.25355 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 10 client.25355 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 20 client.25355 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824baa870 0x55d824baccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 4 client.25355 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d824b06df0 con 0x55d824baa870 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.839+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824baa870 0x55d824baccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.840+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824baa870 0x55d824baccd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffce1a63e918a56f server_cookie=4bdb5fc8af6e9ddd in_seq=0 out_seq=0 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.840+0000 7fd2d67fc640 10 client.25355 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1094995595 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d824b06df0 con 0x55d824baa870 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2d67fc640 10 client.25355 handle_command_reply: tid=0 2024-09-10T21:56:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 client.25355 shutdown 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 msgr2=0x55d824b97ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80af8a0 tx=0x7fd2e80af770 comp rx=0 tx=0).stop 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 shutdown_connections 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824baa870 0x55d824baccd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b9ad80 0x55d824b97ff0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8edf0 0x55d824b97a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2d67fc640 0 client.25355 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1094995595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8e4d0 0x55d824b9a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 >> 172.21.15.39:0/1094995595 conn(0x55d824b8c300 msgr2=0x55d824b91e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 shutdown_connections 2024-09-10T21:56:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1094995595 wait complete. 2024-09-10T21:56:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.841+0000 7fd2f79fc740 20 client.25355 trim_cache size 0 max 16384 2024-09-10T21:56:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 Processor -- start 2024-09-10T21:56:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 -- start start 2024-09-10T21:56:20.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 0x55d824b962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b9ad80 0x55d824b94c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000e3d0 con 0x55d824b9ad80 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000ffa0 con 0x55d824b8e4d0 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.855+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000eaa0 con 0x55d824b8edf0 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47000/0 (socket says 172.21.15.39:47000) 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 0x55d824b962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 -- 172.21.15.39:0/2352141319 learned_addr learned my addr 172.21.15.39:0/2352141319 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b9ad80 0x55d824b94c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 -- 172.21.15.39:0/2352141319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 msgr2=0x55d824b962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 0x55d824b962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 -- 172.21.15.39:0/2352141319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b9ad80 msgr2=0x55d824b94c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b9ad80 0x55d824b94c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 -- 172.21.15.39:0/2352141319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d824b92780 con 0x55d824b8edf0 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 0x55d824b962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8033000 tx=0x7fd2d8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8760c4cf26b1273e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e4ff9640 1 -- 172.21.15.39:0/2352141319 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8035040 con 0x55d824b8edf0 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e4ff9640 1 -- 172.21.15.39:0/2352141319 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d80055b0 con 0x55d824b8edf0 2024-09-10T21:56:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.856+0000 7fd2e4ff9640 1 -- 172.21.15.39:0/2352141319 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003850 con 0x55d824b8edf0 2024-09-10T21:56:20.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 -- 172.21.15.39:0/2352141319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 msgr2=0x55d824b96810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8033000 tx=0x7fd2d8009260 comp rx=0 tx=0).stop 2024-09-10T21:56:20.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 -- 172.21.15.39:0/2352141319 shutdown_connections 2024-09-10T21:56:20.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b9ad80 0x55d824b94c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b8edf0 0x55d824b96810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/2352141319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8e4d0 0x55d824b962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 -- 172.21.15.39:0/2352141319 >> 172.21.15.39:0/2352141319 conn(0x55d824b8c300 msgr2=0x55d824b92c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 -- 172.21.15.39:0/2352141319 shutdown_connections 2024-09-10T21:56:20.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.857+0000 7fd2f79fc740 1 -- 172.21.15.39:0/2352141319 wait complete. 2024-09-10T21:56:20.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 -- start start 2024-09-10T21:56:20.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 Processor -- start 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8edf0 0x55d824ba34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 0x55d824b9dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000f840 con 0x55d824b8e4d0 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000f170 con 0x55d824b8edf0 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d000c3b0 con 0x55d824b9ad80 2024-09-10T21:56:20.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2f79fc740 10 client.0 _ll_register_callbacks cb 0x7fd2e80ac1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54264/0 (socket says 172.21.15.39:54264) 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1840749114 learned_addr learned my addr 172.21.15.39:0/1840749114 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8edf0 0x55d824ba34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 0x55d824b9dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 msgr2=0x55d824b9dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 0x55d824b9dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1840749114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8edf0 msgr2=0x55d824ba34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8edf0 0x55d824ba34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2eeffd640 1 -- 172.21.15.39:0/1840749114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d824b9e510 con 0x55d824b8e4d0 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.858+0000 7fd2ef7fe640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 0x55d824b9dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:56:20.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2eeffd640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0019810 tx=0x7fd2e0009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab34194b260f395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:20.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:20.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e002f060 con 0x55d824b8e4d0 2024-09-10T21:56:20.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd2e00050c0 con 0x55d824b8e4d0 2024-09-10T21:56:20.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d80055b0 con 0x55d824b8e4d0 2024-09-10T21:56:20.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd2e001e040 con 0x55d824b8e4d0 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 10 client.15762 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d824c18290 con 0x55d824b8e4d0 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d80055b0 con 0x55d824b8e4d0 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fd2e0029030 con 0x55d824b8e4d0 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 10 client.15762 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 10 client.15762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.859+0000 7fd2f79fc740 20 client.15762 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824c18880 0x55d824c1aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 4 client.15762 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d824b8c0b0 con 0x55d824c18880 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824c18880 0x55d824c1aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2e7fff640 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824c18880 0x55d824c1aca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bc8706eb979bba6 server_cookie=9463228c9f5845dd in_seq=0 out_seq=0 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2d67fc640 10 client.15762 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2d67fc640 1 -- 172.21.15.39:0/1840749114 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d824b8c0b0 con 0x55d824c18880 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2d67fc640 10 client.15762 handle_command_reply: tid=0 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 client.15762 shutdown 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 msgr2=0x55d824ba2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0019810 tx=0x7fd2e0009eb0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 shutdown_connections 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d824c18880 0x55d824c1aca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2d67fc640 0 client.15762 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.860+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d824b9ad80 0x55d824b9dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d824b8edf0 0x55d824ba34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 1 --2- 172.21.15.39:0/1840749114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d824b8e4d0 0x55d824ba2f10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 >> 172.21.15.39:0/1840749114 conn(0x55d824b8c300 msgr2=0x55d824b8ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 shutdown_connections 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 1 -- 172.21.15.39:0/1840749114 wait complete. 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f79fc740 20 client.15762 trim_cache size 0 max 16384 2024-09-10T21:56:20.872 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 msgr2=0x7fd2dc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 0x7fd2dc0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8031440 tx=0x7fd2d8032f40 comp rx=0 tx=0).stop 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 msgr2=0x7fd2f019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 0x7fd2f019eac0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8007db0 tx=0x7fd2e8010420 comp rx=0 tx=0).stop 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 shutdown_connections 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd2dc0b5360 0x7fd2dc0b7820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2f0109150 0x7fd2f019eac0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f01087d0 0x7fd2f0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 --2- 172.21.15.39:0/3872027844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f0102dc0 0x7fd2f01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 >> 172.21.15.39:0/3872027844 conn(0x7fd2f00fe850 msgr2=0x7fd2f0104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 shutdown_connections 2024-09-10T21:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:20.861+0000 7fd2f5627640 1 -- 172.21.15.39:0/3872027844 wait complete. 2024-09-10T21:56:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:20 smithi173 ceph-mon[35294]: pgmap v381: 97 pgs: 97 active+clean; 40 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-09-10T21:56:21.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:20 smithi070 ceph-mon[34909]: pgmap v381: 97 pgs: 97 active+clean; 40 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 991 op/s 2024-09-10T21:56:21.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:56:22.090 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 -- 172.21.15.39:0/4193607152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 msgr2=0x7f831010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 --2- 172.21.15.39:0/4193607152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f831010f950 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8300009900 tx=0x7f830002a410 comp rx=0 tx=0).stop 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 -- 172.21.15.39:0/4193607152 shutdown_connections 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 --2- 172.21.15.39:0/4193607152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f831010f950 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 --2- 172.21.15.39:0/4193607152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83101087d0 0x7f8310108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 --2- 172.21.15.39:0/4193607152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8310102dc0 0x7f83101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 -- 172.21.15.39:0/4193607152 >> 172.21.15.39:0/4193607152 conn(0x7f83100fe870 msgr2=0x7f8310100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 -- 172.21.15.39:0/4193607152 shutdown_connections 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 -- 172.21.15.39:0/4193607152 wait complete. 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.546+0000 7f8316b72640 1 Processor -- start 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 -- start start 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 0x7f83100754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 0x7f83100759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8310112dd0 con 0x7f8310109150 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8310112c50 con 0x7f83101087d0 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f8316b72640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8310112f50 con 0x7f8310102dc0 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831490e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 0x7f83100754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f830ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 0x7f83100759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54280/0 (socket says 172.21.15.39:54280) 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831490e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 0x7f83100754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47024/0 (socket says 172.21.15.39:47024) 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 -- 172.21.15.39:0/2055396180 learned_addr learned my addr 172.21.15.39:0/2055396180 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 -- 172.21.15.39:0/2055396180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 msgr2=0x7f83100754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 0x7f83100754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 -- 172.21.15.39:0/2055396180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 msgr2=0x7f83100759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 0x7f83100759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f831510f640 1 -- 172.21.15.39:0/2055396180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83101a7680 con 0x7f8310109150 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.547+0000 7f830ffff640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 0x7f83100759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f831510f640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8300005940 tx=0x7f8300005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f830dffb640 1 -- 172.21.15.39:0/2055396180 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830003f030 con 0x7f8310109150 2024-09-10T21:56:22.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f830dffb640 1 -- 172.21.15.39:0/2055396180 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83000043d0 con 0x7f8310109150 2024-09-10T21:56:22.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83101a7910 con 0x7f8310109150 2024-09-10T21:56:22.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f830dffb640 1 -- 172.21.15.39:0/2055396180 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300035070 con 0x7f8310109150 2024-09-10T21:56:22.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.548+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101a7df0 con 0x7f8310109150 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f830dffb640 1 -- 172.21.15.39:0/2055396180 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f830003b920 con 0x7f8310109150 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 Processor -- start 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 -- start start 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a14718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1480170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5624a13e7ea0 con 0x5624a147dd80 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5624a13d72d0 con 0x5624a1471df0 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f8318f47740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5624a13db0e0 con 0x5624a14714d0 2024-09-10T21:56:22.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f830ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1480170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f831490e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f831490e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34524/0 (socket says 172.21.15.39:34524) 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.551+0000 7f831490e640 1 -- 172.21.15.39:0/3734571 learned_addr learned my addr 172.21.15.39:0/3734571 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f830ffff640 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a14718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f830dffb640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 0x7f82f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 -- 172.21.15.39:0/3734571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 msgr2=0x5624a14718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a14718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 -- 172.21.15.39:0/3734571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 msgr2=0x5624a1480170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1480170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 -- 172.21.15.39:0/3734571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a1135650 con 0x5624a1471df0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f830ffff640 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a14718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831510f640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 0x7f82f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f831490e640 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83080114f0 tx=0x7f83080119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e24a48ad6ce56d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f82f6ffd640 1 -- 172.21.15.39:0/3734571 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830801e070 con 0x5624a1471df0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f82f6ffd640 1 -- 172.21.15.39:0/3734571 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f830800fad0 con 0x5624a1471df0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f82f6ffd640 1 -- 172.21.15.39:0/3734571 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308019ab0 con 0x5624a1471df0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.552+0000 7f830dffb640 1 -- 172.21.15.39:0/2055396180 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f83001064b0 con 0x7f8310109150 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- 172.21.15.39:0/3734571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 msgr2=0x5624a147d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83080114f0 tx=0x7f83080119b0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f831510f640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 0x7f82f80b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83000c9250 tx=0x7f83000c9310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- 172.21.15.39:0/3734571 shutdown_connections 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1480170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a147d840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 --2- 172.21.15.39:0/3734571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a14718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- 172.21.15.39:0/3734571 >> 172.21.15.39:0/3734571 conn(0x5624a146f300 msgr2=0x5624a14704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- 172.21.15.39:0/3734571 shutdown_connections 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- 172.21.15.39:0/3734571 wait complete. 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.553+0000 7f8318f47740 1 -- start start 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 Processor -- start 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a147d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a147dd80 0x5624a147b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5624a1238700 con 0x5624a1471df0 2024-09-10T21:56:22.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5624a1372160 con 0x5624a147dd80 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5624a1480a00 con 0x5624a14714d0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f8318f47740 10 client.0 _ll_register_callbacks cb 0x5624a138b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54296/0 (socket says 172.21.15.39:54296) 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 -- 172.21.15.39:0/2030850850 learned_addr learned my addr 172.21.15.39:0/2030850850 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f830ffff640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a147dd80 0x5624a147b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f830ffff640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a147d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 -- 172.21.15.39:0/2030850850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 msgr2=0x5624a147d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a147d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.554+0000 7f831490e640 1 -- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a147dd80 msgr2=0x5624a147b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f831490e640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a147dd80 0x5624a147b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f831490e640 1 -- 172.21.15.39:0/2030850850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a139fc90 con 0x5624a1471df0 2024-09-10T21:56:22.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f830ffff640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a147d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f831490e640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83080099d0 tx=0x7f8308009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e58579afa9d5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f82effff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830801e070 con 0x5624a1471df0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8308004a40 con 0x5624a1471df0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f830800fad0 con 0x5624a1471df0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8308004c40 con 0x5624a1471df0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f8318f47740 10 client.15774 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624a148c330 con 0x5624a1471df0 2024-09-10T21:56:22.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.555+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f830800fad0 con 0x5624a1471df0 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f8308005270 con 0x5624a1471df0 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 10 client.15774 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 20 client.15774 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a148d730 0x5624a148fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 4 client.15774 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624a13e9df0 con 0x5624a148d730 2024-09-10T21:56:22.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f830ffff640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a148d730 0x5624a148fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f82effff640 10 client.15774 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:22.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.556+0000 7f830ffff640 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a148d730 0x5624a148fb20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=285357084da0ecf9 server_cookie=26d21cd93d800cd8 in_seq=0 out_seq=0 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.561+0000 7f82effff640 1 -- 172.21.15.39:0/2030850850 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624a13e9df0 con 0x5624a148d730 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.561+0000 7f82effff640 10 client.15774 handle_command_reply: tid=0 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.561+0000 7f8318f47740 1 client.15774 shutdown 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.561+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 msgr2=0x5624a147aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.561+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83080099d0 tx=0x7f8308009330 comp rx=0 tx=0).stop 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 shutdown_connections 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a148d730 0x5624a148fb20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a147dd80 0x5624a147b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a147aa90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 --2- 172.21.15.39:0/2030850850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a147d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f82effff640 0 client.15774 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 >> 172.21.15.39:0/2030850850 conn(0x5624a146f300 msgr2=0x5624a1474e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 shutdown_connections 2024-09-10T21:56:22.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 1 -- 172.21.15.39:0/2030850850 wait complete. 2024-09-10T21:56:22.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.562+0000 7f8318f47740 20 client.15774 trim_cache size 0 max 16384 2024-09-10T21:56:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 Processor -- start 2024-09-10T21:56:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 -- start start 2024-09-10T21:56:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a1489c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1477ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f83101b0540 con 0x5624a147dd80 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83101b2110 con 0x5624a1471df0 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f8318f47740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f83101b0c10 con 0x5624a14714d0 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f830ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f831490e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a1489c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f830ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47046/0 (socket says 172.21.15.39:47046) 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f830ffff640 1 -- 172.21.15.39:0/3291337715 learned_addr learned my addr 172.21.15.39:0/3291337715 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.580+0000 7f830ffff640 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1477ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 -- 172.21.15.39:0/3291337715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 msgr2=0x5624a1489c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a1489c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 -- 172.21.15.39:0/3291337715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 msgr2=0x5624a1477ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1477ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 -- 172.21.15.39:0/3291337715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a146a990 con 0x5624a14714d0 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f830ffff640 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8304009e80 tx=0x7f8304004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ba09e922dcc9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f82f67fc640 1 -- 172.21.15.39:0/3291337715 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304013c80 con 0x5624a14714d0 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f82f67fc640 1 -- 172.21.15.39:0/3291337715 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8304013520 con 0x5624a14714d0 2024-09-10T21:56:22.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.581+0000 7f82f67fc640 1 -- 172.21.15.39:0/3291337715 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83040047a0 con 0x5624a14714d0 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- 172.21.15.39:0/3291337715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 msgr2=0x5624a1470a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8304009e80 tx=0x7f8304004730 comp rx=0 tx=0).stop 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- 172.21.15.39:0/3291337715 shutdown_connections 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a147dd80 0x5624a1477ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a1471df0 0x5624a1489c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 --2- 172.21.15.39:0/3291337715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a14714d0 0x5624a1470a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- 172.21.15.39:0/3291337715 >> 172.21.15.39:0/3291337715 conn(0x5624a146f300 msgr2=0x5624a1470350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- 172.21.15.39:0/3291337715 shutdown_connections 2024-09-10T21:56:22.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- 172.21.15.39:0/3291337715 wait complete. 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.582+0000 7f8318f47740 1 -- start start 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 Processor -- start 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 0x5624a14864d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a14819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 0x5624a1481f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f83101b19b0 con 0x5624a1471df0 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83101b12e0 con 0x5624a14714d0 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f83101ae520 con 0x5624a147dd80 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.583+0000 7f8318f47740 10 client.0 _ll_register_callbacks cb 0x7f830801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f830ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 0x5624a14864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a14819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f830ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 0x5624a14864d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34544/0 (socket says 172.21.15.39:34544) 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f830ffff640 1 -- 172.21.15.39:0/560836013 learned_addr learned my addr 172.21.15.39:0/560836013 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f830ffff640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 0x5624a1481f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 -- 172.21.15.39:0/560836013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 msgr2=0x5624a1481f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 0x5624a1481f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 -- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 msgr2=0x5624a14864d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 0x5624a14864d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 -- 172.21.15.39:0/560836013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a14827c0 con 0x5624a1471df0 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f830ffff640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 0x5624a1481f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f831490e640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a14819f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8308002230 tx=0x7f8308004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15bd48be25229a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f82effff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:22.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830801e050 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8308004fe0 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.584+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624a13e58a0 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f830800fad0 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 10 client.15780 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624a14fa620 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5624a13e58a0 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f83080244c0 con 0x5624a1471df0 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 10 client.15780 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 20 client.15780 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a14face0 0x5624a14fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:22.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 4 client.15780 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:56:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624a13e2cd0 con 0x5624a14face0 2024-09-10T21:56:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.585+0000 7f830ffff640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a14face0 0x5624a14fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.586+0000 7f830ffff640 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a14face0 0x5624a14fd100 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710365dd681d86c server_cookie=d0a8373864e5465a in_seq=0 out_seq=0 2024-09-10T21:56:22.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.586+0000 7f82effff640 10 client.15780 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f82effff640 1 -- 172.21.15.39:0/560836013 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624a13e2cd0 con 0x5624a14face0 2024-09-10T21:56:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f82effff640 10 client.15780 handle_command_reply: tid=0 2024-09-10T21:56:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 client.15780 shutdown 2024-09-10T21:56:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 msgr2=0x5624a14819f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a14819f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8308002230 tx=0x7f8308004bb0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 shutdown_connections 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624a14face0 0x5624a14fd100 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624a147dd80 0x5624a1481f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5624a1471df0 0x5624a14819f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 --2- 172.21.15.39:0/560836013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624a14714d0 0x5624a14864d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f82effff640 0 client.15780 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 >> 172.21.15.39:0/560836013 conn(0x5624a146f300 msgr2=0x5624a147c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 shutdown_connections 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 1 -- 172.21.15.39:0/560836013 wait complete. 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.590+0000 7f8318f47740 20 client.15780 trim_cache size 0 max 16384 2024-09-10T21:56:22.595 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:56:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 msgr2=0x7f82f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 0x7f82f80b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83000c9250 tx=0x7f83000c9310 comp rx=0 tx=0).stop 2024-09-10T21:56:22.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 msgr2=0x7f8310075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8300005940 tx=0x7f8300005e20 comp rx=0 tx=0).stop 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 shutdown_connections 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f82f80b52e0 0x7f82f80b77a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8310109150 0x7f8310075f20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83101087d0 0x7f83100759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 --2- 172.21.15.39:0/2055396180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8310102dc0 0x7f83100754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 >> 172.21.15.39:0/2055396180 conn(0x7f83100fe870 msgr2=0x7f8310100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 shutdown_connections 2024-09-10T21:56:22.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:22.591+0000 7f8316b72640 1 -- 172.21.15.39:0/2055396180 wait complete. 2024-09-10T21:56:22.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:22 smithi039 ceph-mon[30872]: pgmap v382: 97 pgs: 97 active+clean; 40 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 917 op/s 2024-09-10T21:56:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:22 smithi173 ceph-mon[35294]: pgmap v382: 97 pgs: 97 active+clean; 40 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 917 op/s 2024-09-10T21:56:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:22 smithi070 ceph-mon[34909]: pgmap v382: 97 pgs: 97 active+clean; 40 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 917 op/s 2024-09-10T21:56:24.350 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:56:24.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:56:24.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:24 smithi173 ceph-mon[35294]: pgmap v383: 97 pgs: 97 active+clean; 42 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-10T21:56:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:25.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:24 smithi070 ceph-mon[34909]: pgmap v383: 97 pgs: 97 active+clean; 42 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-10T21:56:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:24 smithi039 ceph-mon[30872]: pgmap v383: 97 pgs: 97 active+clean; 42 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-10T21:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 -- 172.21.15.39:0/812586477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac101c90 msgr2=0x7fb7ac102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 --2- 172.21.15.39:0/812586477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac101c90 0x7fb7ac102070 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009900 tx=0x7fb79c02a410 comp rx=0 tx=0).stop 2024-09-10T21:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 -- 172.21.15.39:0/812586477 shutdown_connections 2024-09-10T21:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 --2- 172.21.15.39:0/812586477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac108020 0x7fb7ac10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 --2- 172.21.15.39:0/812586477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac1076a0 0x7fb7ac107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 --2- 172.21.15.39:0/812586477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac101c90 0x7fb7ac102070 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 -- 172.21.15.39:0/812586477 >> 172.21.15.39:0/812586477 conn(0x7fb7ac0fd700 msgr2=0x7fb7ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 -- 172.21.15.39:0/812586477 shutdown_connections 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.651+0000 7fb7b193a640 1 -- 172.21.15.39:0/812586477 wait complete. 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 Processor -- start 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 -- start start 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 0x7fb7ac1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac1076a0 0x7fb7ac199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac111ce0 con 0x7fb7ac108020 2024-09-10T21:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac111b60 con 0x7fb7ac101c90 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7b193a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac111e60 con 0x7fb7ac1076a0 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 0x7fb7ac1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.652+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54342/0 (socket says 172.21.15.39:54342) 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 0x7fb7ac1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34560/0 (socket says 172.21.15.39:34560) 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/954003955 learned_addr learned my addr 172.21.15.39:0/954003955 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac1076a0 0x7fb7ac199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/954003955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac1076a0 msgr2=0x7fb7ac199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac1076a0 0x7fb7ac199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/954003955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 msgr2=0x7fb7ac1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 0x7fb7ac1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/954003955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac19f380 con 0x7fb7ac108020 2024-09-10T21:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400eb10 tx=0x7fb7a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7b0938640 1 -- 172.21.15.39:0/954003955 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004b20 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac19f670 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7b0938640 1 -- 172.21.15.39:0/954003955 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a4004cc0 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7b0938640 1 -- 172.21.15.39:0/954003955 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4010670 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.653+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac103730 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b0938640 1 -- 172.21.15.39:0/954003955 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb7a4005020 con 0x7fb7ac108020 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 Processor -- start 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 -- start start 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f1db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ba3e85e60 con 0x561ba3f0eee0 2024-09-10T21:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba3e75290 con 0x561ba3f1b790 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.656+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ba3e790a0 con 0x561ba3f0f800 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47088/0 (socket says 172.21.15.39:47088) 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54356/0 (socket says 172.21.15.39:54356) 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 -- 172.21.15.39:0/2667797362 learned_addr learned my addr 172.21.15.39:0/2667797362 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f1db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 -- 172.21.15.39:0/2667797362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 msgr2=0x561ba3f1db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f1db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 -- 172.21.15.39:0/2667797362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 msgr2=0x561ba3f0f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aaffd640 1 -- 172.21.15.39:0/2667797362 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba3bd3930 con 0x561ba3f0f800 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.657+0000 7fb7b0938640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 0x7fb7940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 0x7fb7940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb79c033000 tx=0x7fb79c005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf4aee9aa3e6719 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb7b0938640 1 -- 172.21.15.39:0/954003955 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a40e6210 con 0x7fb7ac108020 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb791ffb640 1 -- 172.21.15.39:0/2667797362 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c049070 con 0x561ba3f0f800 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb791ffb640 1 -- 172.21.15.39:0/2667797362 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79c032da0 con 0x561ba3f0f800 2024-09-10T21:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.658+0000 7fb791ffb640 1 -- 172.21.15.39:0/2667797362 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c035070 con 0x561ba3f0f800 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2667797362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 msgr2=0x561ba3f1b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 0x7fb7940b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x561ba3f0ee90 tx=0x7fb7a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb79c033000 tx=0x7fb79c005e40 comp rx=0 tx=0).stop 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2667797362 shutdown_connections 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f1db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0f800 0x561ba3f1b250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2667797362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0eee0 0x561ba3f0f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2667797362 >> 172.21.15.39:0/2667797362 conn(0x561ba3f0cd10 msgr2=0x561ba3f0deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2667797362 shutdown_connections 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2667797362 wait complete. 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.659+0000 7fb7b3d0f740 1 -- start start 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 Processor -- start 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 0x561ba3f18d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 0x561ba3f19260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ba3cd6890 con 0x561ba3f1b790 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba3e0fd40 con 0x561ba3f0f800 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ba3f1e3e0 con 0x561ba3f0eee0 2024-09-10T21:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7b3d0f740 10 client.0 _ll_register_callbacks cb 0x561ba3e73c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 0x561ba3f19260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7aa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 0x561ba3f18d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47104/0 (socket says 172.21.15.39:47104) 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7aaffd640 1 -- 172.21.15.39:0/1474451928 learned_addr learned my addr 172.21.15.39:0/1474451928 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.660+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/1474451928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 msgr2=0x561ba3f187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 msgr2=0x561ba3f18d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 0x561ba3f18d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/1474451928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba3f27840 con 0x561ba3f1b790 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 0x561ba3f18d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 0x561ba3f19260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40a9bf0 tx=0x7fb7a40ac750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea910f5c08ce4756 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40a80f0 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a40b5a80 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb79c032da0 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7a4005540 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7b3d0f740 10 client.15792 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ba3f2a250 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79c032da0 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.661+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fb7a40a82d0 con 0x561ba3f1b790 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 10 client.15792 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 20 client.15792 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f2b800 0x561ba3f2dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 4 client.15792 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ba3e87db0 con 0x561ba3f2b800 2024-09-10T21:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f2b800 0x561ba3f2dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb78affd640 10 client.15792 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.662+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f2b800 0x561ba3f2dc40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6defb85872a24c18 server_cookie=ce5438cd3d6cb663 in_seq=0 out_seq=0 2024-09-10T21:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.669+0000 7fb78affd640 1 -- 172.21.15.39:0/1474451928 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ba3e87db0 con 0x561ba3f2b800 2024-09-10T21:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.669+0000 7fb78affd640 10 client.15792 handle_command_reply: tid=0 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.669+0000 7fb7b3d0f740 1 client.15792 shutdown 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 msgr2=0x561ba3f19260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 0x561ba3f19260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40a9bf0 tx=0x7fb7a40ac750 comp rx=0 tx=0).stop 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 shutdown_connections 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f2b800 0x561ba3f2dc40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f1b790 0x561ba3f19260 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f0f800 0x561ba3f18d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/1474451928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 >> 172.21.15.39:0/1474451928 conn(0x561ba3f0cd10 msgr2=0x561ba3f0bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb78affd640 0 client.15792 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 shutdown_connections 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/1474451928 wait complete. 2024-09-10T21:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.670+0000 7fb7b3d0f740 20 client.15792 trim_cache size 0 max 16384 2024-09-10T21:56:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.691+0000 7fb7b3d0f740 1 Processor -- start 2024-09-10T21:56:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 -- start start 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f33510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1ac0f0 con 0x561ba3f0f800 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1adcc0 con 0x561ba3f1b790 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1ac7c0 con 0x561ba3f0eee0 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7aa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f33510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7aa7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54376/0 (socket says 172.21.15.39:54376) 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7aa7fc640 1 -- 172.21.15.39:0/670169869 learned_addr learned my addr 172.21.15.39:0/670169869 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.692+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/670169869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 msgr2=0x561ba3f159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/670169869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 msgr2=0x561ba3f15f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/670169869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba3f0cb40 con 0x561ba3f1b790 2024-09-10T21:56:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f33510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40a8f00 tx=0x7fb7a40ac880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8212563f7b71bdd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7917fa640 1 -- 172.21.15.39:0/670169869 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40a80f0 con 0x561ba3f1b790 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7917fa640 1 -- 172.21.15.39:0/670169869 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a40e5040 con 0x561ba3f1b790 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.693+0000 7fb7917fa640 1 -- 172.21.15.39:0/670169869 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40ac2d0 con 0x561ba3f1b790 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/670169869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 msgr2=0x561ba3f33510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f33510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40a8f00 tx=0x7fb7a40ac880 comp rx=0 tx=0).stop 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/670169869 shutdown_connections 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f33510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f15f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/670169869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/670169869 >> 172.21.15.39:0/670169869 conn(0x561ba3f0cd10 msgr2=0x561ba3f13a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/670169869 shutdown_connections 2024-09-10T21:56:25.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.695+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/670169869 wait complete. 2024-09-10T21:56:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.696+0000 7fb7b3d0f740 1 -- start start 2024-09-10T21:56:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.696+0000 7fb7b3d0f740 1 Processor -- start 2024-09-10T21:56:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.696+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.696+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f1f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.696+0000 7fb7b3d0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1ad560 con 0x561ba3f0f800 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1ace90 con 0x561ba3f1b790 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7b3d0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1aa0d0 con 0x561ba3f0eee0 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f1f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34590/0 (socket says 172.21.15.39:34590) 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/2748645002 learned_addr learned my addr 172.21.15.39:0/2748645002 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7aa7fc640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f1f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7b3d0f740 10 client.0 _ll_register_callbacks cb 0x7fb7a40a8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/2748645002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 msgr2=0x561ba3f1f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f1f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/2748645002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 msgr2=0x561ba3f1f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f1f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/2748645002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba3f90ef0 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb7ab7fe640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ce2b0 tx=0x7fb7a40ac750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f776025deb569924 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.697+0000 7fb78affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a408a030 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a4005340 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7a40e5040 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7a40a8fd0 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 10 client.25397 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ba3f90ef0 con 0x561ba3f1b790 2024-09-10T21:56:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a40e5040 con 0x561ba3f1b790 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fb7a40b25f0 con 0x561ba3f1b790 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 10 client.25397 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 10 client.25397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 20 client.25397 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f98690 0x561ba3f9aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 4 client.25397 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.698+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561ba3e83860 con 0x561ba3f98690 2024-09-10T21:56:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.699+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f98690 0x561ba3f9aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.699+0000 7fb7aaffd640 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f98690 0x561ba3f9aab0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a4e25d2d7fadbe server_cookie=75967fa580d45733 in_seq=0 out_seq=0 2024-09-10T21:56:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.699+0000 7fb78affd640 10 client.25397 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:25.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb78affd640 1 -- 172.21.15.39:0/2748645002 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561ba3e83860 con 0x561ba3f98690 2024-09-10T21:56:25.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb78affd640 10 client.25397 handle_command_reply: tid=0 2024-09-10T21:56:25.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 client.25397 shutdown 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 msgr2=0x561ba3f907b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ce2b0 tx=0x7fb7a40ac750 comp rx=0 tx=0).stop 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 shutdown_connections 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba3f98690 0x561ba3f9aab0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba3f1b790 0x561ba3f907b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba3f0f800 0x561ba3f1f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 --2- 172.21.15.39:0/2748645002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba3f0eee0 0x561ba3f1f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb78affd640 0 client.25397 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 >> 172.21.15.39:0/2748645002 conn(0x561ba3f0cd10 msgr2=0x561ba3f19e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 shutdown_connections 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 1 -- 172.21.15.39:0/2748645002 wait complete. 2024-09-10T21:56:25.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.752+0000 7fb7b3d0f740 20 client.25397 trim_cache size 0 max 16384 2024-09-10T21:56:25.756 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:56:25.756 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:56:25.756 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "cdad3e47-0931-4e6b-b03c-92695a6a8296", 2024-09-10T21:56:25.756 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:56:25.756 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 msgr2=0x7fb7940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 0x7fb7940b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x561ba3f0ee90 tx=0x7fb7a0005850 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 msgr2=0x7fb7ac19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400eb10 tx=0x7fb7a400c2d0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 shutdown_connections 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7940b52e0 0x7fb7940b77a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac108020 0x7fb7ac19ebb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7ac1076a0 0x7fb7ac199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 --2- 172.21.15.39:0/954003955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7ac101c90 0x7fb7ac1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 >> 172.21.15.39:0/954003955 conn(0x7fb7ac0fd700 msgr2=0x7fb7ac105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 shutdown_connections 2024-09-10T21:56:25.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:25.753+0000 7fb7b193a640 1 -- 172.21.15.39:0/954003955 wait complete. 2024-09-10T21:56:26.500 INFO:tasks.workunit.client.0.smithi039.stdout: 38 540358 545 305197 563 268115 1425 2024-09-10T21:56:26.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:56:26.957 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:26 smithi070 ceph-mon[34909]: pgmap v384: 97 pgs: 97 active+clean; 42 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.6 MiB/s wr, 914 op/s 2024-09-10T21:56:26.957 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:26 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:56:26.957 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:26 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:26.958 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:26 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:56:26.958 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:26 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:56:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:26 smithi173 ceph-mon[35294]: pgmap v384: 97 pgs: 97 active+clean; 42 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.6 MiB/s wr, 914 op/s 2024-09-10T21:56:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:26 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:56:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:26 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:26 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:56:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:26 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:56:27.032 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:27.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:26 smithi039 ceph-mon[30872]: pgmap v384: 97 pgs: 97 active+clean; 42 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.6 MiB/s wr, 914 op/s 2024-09-10T21:56:27.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:26 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:56:27.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:26 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:26 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:56:27.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:26 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 -- 172.21.15.39:0/2844836191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f011c1f0 msgr2=0x7f33f011e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 --2- 172.21.15.39:0/2844836191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f011c1f0 0x7f33f011e5e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009ca0 tx=0x7f33e802a8f0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 -- 172.21.15.39:0/2844836191 shutdown_connections 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 --2- 172.21.15.39:0/2844836191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f011c1f0 0x7f33f011e5e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 --2- 172.21.15.39:0/2844836191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 --2- 172.21.15.39:0/2844836191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f006eb80 0x7f33f006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.683+0000 7f33f6e09640 1 -- 172.21.15.39:0/2844836191 >> 172.21.15.39:0/2844836191 conn(0x7f33f006dce0 msgr2=0x7f33f006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.686+0000 7f33f6e09640 1 -- 172.21.15.39:0/2844836191 shutdown_connections 2024-09-10T21:56:27.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.687+0000 7f33f6e09640 1 -- 172.21.15.39:0/2844836191 wait complete. 2024-09-10T21:56:27.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.688+0000 7f33f6e09640 1 Processor -- start 2024-09-10T21:56:27.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.688+0000 7f33f6e09640 1 -- start start 2024-09-10T21:56:27.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.688+0000 7f33f6e09640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.688+0000 7f33f6e09640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.688+0000 7f33f6e09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f011c1f0 0x7f33f0115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f6e09640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33f010dd20 con 0x7f33f011c1f0 2024-09-10T21:56:27.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f6e09640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f010dba0 con 0x7f33f006eb80 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f6e09640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33f010dea0 con 0x7f33f006f4a0 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34594/0 (socket says 172.21.15.39:34594) 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33effff640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 -- 172.21.15.39:0/1342998091 learned_addr learned my addr 172.21.15.39:0/1342998091 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 -- 172.21.15.39:0/1342998091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 msgr2=0x7f33f011bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 -- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f011c1f0 msgr2=0x7f33f0115940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f011c1f0 0x7f33f0115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.689+0000 7f33f4ba5640 1 -- 172.21.15.39:0/1342998091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f0116200 con 0x7f33f006eb80 2024-09-10T21:56:27.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.690+0000 7f33effff640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.690+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00d950 tx=0x7f33dc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.690+0000 7f33edffb640 1 -- 172.21.15.39:0/1342998091 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc017070 con 0x7f33f006eb80 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.690+0000 7f33edffb640 1 -- 172.21.15.39:0/1342998091 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33dc009c30 con 0x7f33f006eb80 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.690+0000 7f33edffb640 1 -- 172.21.15.39:0/1342998091 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00f620 con 0x7f33f006eb80 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.691+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f01164f0 con 0x7f33f006eb80 2024-09-10T21:56:27.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.691+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f01bd200 con 0x7f33f006eb80 2024-09-10T21:56:27.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.698+0000 7f33f91de740 1 Processor -- start 2024-09-10T21:56:27.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 -- start start 2024-09-10T21:56:27.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55626a766e50 con 0x55626a7f09c0 2024-09-10T21:56:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55626a756280 con 0x55626a7f00a0 2024-09-10T21:56:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.700+0000 7f33f91de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55626a75a090 con 0x55626a7fc950 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.701+0000 7f33f53a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.701+0000 7f33f53a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34598/0 (socket says 172.21.15.39:34598) 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.701+0000 7f33f53a6640 1 -- 172.21.15.39:0/3832049964 learned_addr learned my addr 172.21.15.39:0/3832049964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.701+0000 7f33edffb640 1 -- 172.21.15.39:0/1342998091 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f33dc005060 con 0x7f33f006eb80 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.702+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33edffb640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 0x7f33e00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33f53a6640 1 -- 172.21.15.39:0/3832049964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 msgr2=0x55626a7fed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33f53a6640 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33f53a6640 1 -- 172.21.15.39:0/3832049964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 msgr2=0x55626a7fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33f53a6640 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7fc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33f53a6640 1 -- 172.21.15.39:0/3832049964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626a4b4650 con 0x55626a7f00a0 2024-09-10T21:56:27.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.703+0000 7f33edffb640 1 -- 172.21.15.39:0/1342998091 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f33dc0e53b0 con 0x7f33f006eb80 2024-09-10T21:56:27.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.707+0000 7f33f53a6640 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009bf0 tx=0x7f33e80315a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418509400431b64e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.708+0000 7f33daffd640 1 -- 172.21.15.39:0/3832049964 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e80319e0 con 0x55626a7f00a0 2024-09-10T21:56:27.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.708+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 0x7f33e00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.709+0000 7f33daffd640 1 -- 172.21.15.39:0/3832049964 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e8036040 con 0x55626a7f00a0 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.709+0000 7f33f91de740 1 -- 172.21.15.39:0/3832049964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 msgr2=0x55626a7f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.709+0000 7f33f91de740 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009bf0 tx=0x7f33e80315a0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f91de740 1 -- 172.21.15.39:0/3832049964 shutdown_connections 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f91de740 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f91de740 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f91de740 1 --2- 172.21.15.39:0/3832049964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7f0480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f91de740 1 -- 172.21.15.39:0/3832049964 >> 172.21.15.39:0/3832049964 conn(0x55626a7eded0 msgr2=0x55626a7ef070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.714+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 0x7f33e00b7930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098e0 tx=0x7f33e80315a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.717+0000 7f33f91de740 1 -- 172.21.15.39:0/3832049964 shutdown_connections 2024-09-10T21:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.719+0000 7f33f91de740 1 -- 172.21.15.39:0/3832049964 wait complete. 2024-09-10T21:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.720+0000 7f33f91de740 1 -- start start 2024-09-10T21:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.720+0000 7f33f91de740 1 Processor -- start 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f00a0 0x55626a7fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f09c0 0x55626a7f9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55626a5b7700 con 0x55626a7f00a0 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55626a6f1110 con 0x55626a7fc950 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55626a7ff610 con 0x55626a7f09c0 2024-09-10T21:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.721+0000 7f33f91de740 10 client.0 _ll_register_callbacks cb 0x55626a70a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:27.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.723+0000 7f33f53a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.723+0000 7f33f53a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34600/0 (socket says 172.21.15.39:34600) 2024-09-10T21:56:27.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.723+0000 7f33f53a6640 1 -- 172.21.15.39:0/867641249 learned_addr learned my addr 172.21.15.39:0/867641249 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:27.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.723+0000 7f33effff640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f09c0 0x55626a7f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 -- 172.21.15.39:0/867641249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f09c0 msgr2=0x55626a7f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f09c0 0x55626a7f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 -- 172.21.15.39:0/867641249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f00a0 msgr2=0x55626a7fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f00a0 0x55626a7fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 -- 172.21.15.39:0/867641249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626a71ec40 con 0x55626a7fc950 2024-09-10T21:56:27.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33f53a6640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009ca0 tx=0x7f33e8030be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd720d229fc4b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.726+0000 7f33cffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:27.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e805e060 con 0x55626a7fc950 2024-09-10T21:56:27.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e8036040 con 0x55626a7fc950 2024-09-10T21:56:27.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f33e8047620 con 0x55626a7fc950 2024-09-10T21:56:27.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f33e80319e0 con 0x55626a7fc950 2024-09-10T21:56:27.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33f91de740 10 client.25409 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:27.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.727+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55626a80aea0 con 0x55626a7fc950 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e8036040 con 0x55626a7fc950 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f33e80645e0 con 0x55626a7fc950 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 10 client.25409 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 20 client.25409 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a80c460 0x55626a80e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 4 client.25409 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:27.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.729+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626a768da0 con 0x55626a80c460 2024-09-10T21:56:27.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.734+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a80c460 0x55626a80e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.750+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a80c460 0x55626a80e900 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b473c45566f5a39 server_cookie=6448b117afa3e667 in_seq=0 out_seq=0 2024-09-10T21:56:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.750+0000 7f33cffff640 10 client.25409 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:27.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33cffff640 1 -- 172.21.15.39:0/867641249 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55626a768da0 con 0x55626a80c460 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33cffff640 10 client.25409 handle_command_reply: tid=0 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 client.25409 shutdown 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 msgr2=0x55626a7f9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009ca0 tx=0x7f33e8030be0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 shutdown_connections 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a80c460 0x55626a80e900 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7fc950 0x55626a7f9aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f09c0 0x55626a7f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 --2- 172.21.15.39:0/867641249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f00a0 0x55626a7fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.753+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 >> 172.21.15.39:0/867641249 conn(0x55626a7eded0 msgr2=0x55626a7f3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.754+0000 7f33cffff640 0 client.25409 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.754+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 shutdown_connections 2024-09-10T21:56:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.754+0000 7f33f91de740 1 -- 172.21.15.39:0/867641249 wait complete. 2024-09-10T21:56:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.754+0000 7f33f91de740 20 client.25409 trim_cache size 0 max 16384 2024-09-10T21:56:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 Processor -- start 2024-09-10T21:56:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 -- start start 2024-09-10T21:56:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7ece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c5930 con 0x55626a7f09c0 2024-09-10T21:56:27.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c7500 con 0x55626a7f00a0 2024-09-10T21:56:27.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.791+0000 7f33f91de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c6000 con 0x55626a7fc950 2024-09-10T21:56:27.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:27 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:56:27.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:27 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:56:27.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:27 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:27 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:27 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.793+0000 7f33effff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.793+0000 7f33effff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54424/0 (socket says 172.21.15.39:54424) 2024-09-10T21:56:27.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.793+0000 7f33effff640 1 -- 172.21.15.39:0/1454870494 learned_addr learned my addr 172.21.15.39:0/1454870494 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:27.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.793+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.793+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.794+0000 7f33f53a6640 1 -- 172.21.15.39:0/1454870494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 msgr2=0x55626a7ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.794+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7ece10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.794+0000 7f33f53a6640 1 -- 172.21.15.39:0/1454870494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 msgr2=0x55626a7f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.794+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.794+0000 7f33f53a6640 1 -- 172.21.15.39:0/1454870494 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626a7e9570 con 0x55626a7fc950 2024-09-10T21:56:27.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.799+0000 7f33f53a6640 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7f6cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33e8064a30 tx=0x7f33e802adf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587983584157a26f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.802+0000 7f33da7fc640 1 -- 172.21.15.39:0/1454870494 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8030900 con 0x55626a7fc950 2024-09-10T21:56:27.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.802+0000 7f33da7fc640 1 -- 172.21.15.39:0/1454870494 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e8069020 con 0x55626a7fc950 2024-09-10T21:56:27.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.802+0000 7f33da7fc640 1 -- 172.21.15.39:0/1454870494 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8047880 con 0x55626a7fc950 2024-09-10T21:56:27.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.803+0000 7f33f91de740 1 -- 172.21.15.39:0/1454870494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 msgr2=0x55626a7f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.803+0000 7f33f91de740 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7f6cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33e8064a30 tx=0x7f33e802adf0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.805+0000 7f33f91de740 1 -- 172.21.15.39:0/1454870494 shutdown_connections 2024-09-10T21:56:27.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.805+0000 7f33f91de740 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7fc950 0x55626a7f6cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.805+0000 7f33f91de740 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7f09c0 0x55626a7f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.805+0000 7f33f91de740 1 --2- 172.21.15.39:0/1454870494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f00a0 0x55626a7ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.805+0000 7f33f91de740 1 -- 172.21.15.39:0/1454870494 >> 172.21.15.39:0/1454870494 conn(0x55626a7eded0 msgr2=0x55626a7ec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.806+0000 7f33f91de740 1 -- 172.21.15.39:0/1454870494 shutdown_connections 2024-09-10T21:56:27.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.806+0000 7f33f91de740 1 -- 172.21.15.39:0/1454870494 wait complete. 2024-09-10T21:56:27.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.807+0000 7f33f91de740 1 -- start start 2024-09-10T21:56:27.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.807+0000 7f33f91de740 1 Processor -- start 2024-09-10T21:56:27.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f09c0 0x55626a8003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7fc950 0x55626a8008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c6da0 con 0x55626a7fc950 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c66d0 con 0x55626a7f09c0 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01c3910 con 0x55626a7f00a0 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.808+0000 7f33f91de740 10 client.0 _ll_register_callbacks cb 0x7f33e8041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.809+0000 7f33f4ba5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.809+0000 7f33f4ba5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47176/0 (socket says 172.21.15.39:47176) 2024-09-10T21:56:27.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.809+0000 7f33f4ba5640 1 -- 172.21.15.39:0/127256905 learned_addr learned my addr 172.21.15.39:0/127256905 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:27.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f53a6640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7fc950 0x55626a8008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f4ba5640 1 -- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f09c0 msgr2=0x55626a8003b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:56:27.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f09c0 0x55626a8003b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f4ba5640 1 -- 172.21.15.39:0/127256905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7fc950 msgr2=0x55626a8008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:27.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7fc950 0x55626a8008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.810+0000 7f33f4ba5640 1 -- 172.21.15.39:0/127256905 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626a800eb0 con 0x55626a7f00a0 2024-09-10T21:56:27.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.811+0000 7f33f4ba5640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0abb10 tx=0x7f33dc010c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92eeef813da2e232 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:27.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.814+0000 7f33cffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:56:27.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.814+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0b0070 con 0x55626a7f00a0 2024-09-10T21:56:27.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.814+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f33dc005380 con 0x55626a7f00a0 2024-09-10T21:56:27.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.815+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e8069020 con 0x55626a7f00a0 2024-09-10T21:56:27.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.817+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f33dc020040 con 0x55626a7f00a0 2024-09-10T21:56:27.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.819+0000 7f33f91de740 10 client.25426 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:27.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.819+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55626a8791b0 con 0x55626a7f00a0 2024-09-10T21:56:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.821+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e8069020 con 0x55626a7f00a0 2024-09-10T21:56:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.821+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f33dc0aade0 con 0x55626a7f00a0 2024-09-10T21:56:27.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 10 client.25426 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:27.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:27.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 20 client.25426 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:27.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a879970 0x55626a87bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:27.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 4 client.25426 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:56:27.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.823+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55626a764850 con 0x55626a879970 2024-09-10T21:56:27.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.824+0000 7f33effff640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a879970 0x55626a87bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.831+0000 7f33effff640 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a879970 0x55626a87bd90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5161c7200f2a4953 server_cookie=7df80333535610d8 in_seq=0 out_seq=0 2024-09-10T21:56:27.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.832+0000 7f33cffff640 10 client.25426 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:27.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.835+0000 7f33cffff640 1 -- 172.21.15.39:0/127256905 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1147 (crc 0 0 0) 0x55626a764850 con 0x55626a879970 2024-09-10T21:56:27.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.835+0000 7f33cffff640 10 client.25426 handle_command_reply: tid=0 2024-09-10T21:56:27.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.835+0000 7f33f91de740 1 client.25426 shutdown 2024-09-10T21:56:27.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.836+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 msgr2=0x55626a804e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.836+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0abb10 tx=0x7f33dc010c40 comp rx=0 tx=0).stop 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 shutdown_connections 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55626a879970 0x55626a87bd90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55626a7fc950 0x55626a8008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55626a7f09c0 0x55626a8003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 --2- 172.21.15.39:0/127256905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55626a7f00a0 0x55626a804e40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 >> 172.21.15.39:0/127256905 conn(0x55626a7eded0 msgr2=0x55626a7fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.837+0000 7f33cffff640 0 client.25426 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:27.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.838+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 shutdown_connections 2024-09-10T21:56:27.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.838+0000 7f33f91de740 1 -- 172.21.15.39:0/127256905 wait complete. 2024-09-10T21:56:27.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.838+0000 7f33f91de740 20 client.25426 trim_cache size 0 max 16384 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (4715 inodes in the stack)", 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "cdad3e47-0931-4e6b-b03c-92695a6a8296", 2024-09-10T21:56:27.842 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:27.843 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:27.844 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 msgr2=0x7f33e00b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 0x7f33e00b7930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098e0 tx=0x7f33e80315a0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 msgr2=0x7f33f011b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00d950 tx=0x7f33dc00de10 comp rx=0 tx=0).stop 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 shutdown_connections 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f33e00b5470 0x7f33e00b7930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f011c1f0 0x7f33f0115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f006f4a0 0x7f33f011bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 --2- 172.21.15.39:0/1342998091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f006eb80 0x7f33f011b600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.841+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 >> 172.21.15.39:0/1342998091 conn(0x7f33f006dce0 msgr2=0x7f33f011c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.842+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 shutdown_connections 2024-09-10T21:56:27.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:27.842+0000 7f33f6e09640 1 -- 172.21.15.39:0/1342998091 wait complete. 2024-09-10T21:56:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:27 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:56:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:27 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:56:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:27 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:27 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:27.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:27 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:28.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:27 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:56:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:27 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:56:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:27 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:27 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:28.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:27 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:28.514 INFO:tasks.cephfs.filesystem:scrub status for tag:cdad3e47-0931-4e6b-b03c-92695a6a8296 - {'path': '/', 'tag': 'cdad3e47-0931-4e6b-b03c-92695a6a8296', 'options': 'recursive,force'} 2024-09-10T21:56:28.809 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:28 smithi039 ceph-mon[30872]: pgmap v385: 97 pgs: 97 active+clean; 46 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.0 MiB/s wr, 948 op/s 2024-09-10T21:56:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:28 smithi173 ceph-mon[35294]: pgmap v385: 97 pgs: 97 active+clean; 46 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.0 MiB/s wr, 948 op/s 2024-09-10T21:56:29.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:28 smithi070 ceph-mon[34909]: pgmap v385: 97 pgs: 97 active+clean; 46 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.0 MiB/s wr, 948 op/s 2024-09-10T21:56:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3715298358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 msgr2=0x7fc8c4107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3715298358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c4107f80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009900 tx=0x7fc8b402a410 comp rx=0 tx=0).stop 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3715298358 shutdown_connections 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3715298358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c41086c0 0x7fc8c410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3715298358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c4107f80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3715298358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c406bfb0 0x7fc8c4105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3715298358 >> 172.21.15.39:0/3715298358 conn(0x7fc8c40fd150 msgr2=0x7fc8c40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3715298358 shutdown_connections 2024-09-10T21:56:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3715298358 wait complete. 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 Processor -- start 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.938+0000 7fc8cb80f640 1 -- start start 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c406bfb0 0x7fc8c4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c41086c0 0x7fc8c4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c410e5f0 con 0x7fc8c4105b10 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c410e470 con 0x7fc8c406bfb0 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c410e770 con 0x7fc8c41086c0 2024-09-10T21:56:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35250/0 (socket says 172.21.15.39:35250) 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 -- 172.21.15.39:0/3774380224 learned_addr learned my addr 172.21.15.39:0/3774380224 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c406bfb0 0x7fc8c4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c41086c0 0x7fc8c4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 -- 172.21.15.39:0/3774380224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c41086c0 msgr2=0x7fc8c4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c41086c0 0x7fc8c4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 -- 172.21.15.39:0/3774380224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c406bfb0 msgr2=0x7fc8c4198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c406bfb0 0x7fc8c4198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 -- 172.21.15.39:0/3774380224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c419a8b0 con 0x7fc8c4105b10 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005940 tx=0x7fc8b4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8ba7fc640 1 -- 172.21.15.39:0/3774380224 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b403f030 con 0x7fc8c4105b10 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8ba7fc640 1 -- 172.21.15.39:0/3774380224 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b4003aa0 con 0x7fc8c4105b10 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.939+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c419ab40 con 0x7fc8c4105b10 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.940+0000 7fc8ba7fc640 1 -- 172.21.15.39:0/3774380224 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4035070 con 0x7fc8c4105b10 2024-09-10T21:56:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.940+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c41a1270 con 0x7fc8c4105b10 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.942+0000 7fc8ce5df740 1 Processor -- start 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.942+0000 7fc8ce5df740 1 -- start start 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 0x55f5add2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f5adc966f0 con 0x55f5add27190 2024-09-10T21:56:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5adc85b20 con 0x55f5add24860 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f5adc89930 con 0x55f5add29bd0 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8ba7fc640 1 -- 172.21.15.39:0/3774380224 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc8b40035f0 con 0x7fc8c4105b10 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c9dac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35252/0 (socket says 172.21.15.39:35252) 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c9dac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58314/0 (socket says 172.21.15.39:58314) 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 -- 172.21.15.39:0/2001899697 learned_addr learned my addr 172.21.15.39:0/2001899697 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 0x55f5add2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 -- 172.21.15.39:0/2001899697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 msgr2=0x55f5add2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 0x55f5add2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 -- 172.21.15.39:0/2001899697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 msgr2=0x55f5add26c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 -- 172.21.15.39:0/2001899697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5adc4b530 con 0x55f5add27190 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 0x55f5add2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000ad00 tx=0x7fc8c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4305170cfa8ada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8af7fe640 1 -- 172.21.15.39:0/2001899697 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c001d070 con 0x55f5add27190 2024-09-10T21:56:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8af7fe640 1 -- 172.21.15.39:0/2001899697 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c0018af0 con 0x55f5add27190 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.943+0000 7fc8af7fe640 1 -- 172.21.15.39:0/2001899697 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0010b30 con 0x55f5add27190 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ba7fc640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 0x7fc8b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 0x7fc8b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ba7fc640 1 -- 172.21.15.39:0/3774380224 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8b4105fc0 con 0x7fc8c4105b10 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 0x7fc8b00b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4199af0 tx=0x7fc8bc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2001899697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 msgr2=0x55f5add29580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000ad00 tx=0x7fc8c000f790 comp rx=0 tx=0).stop 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2001899697 shutdown_connections 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add29bd0 0x55f5add2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add29580 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2001899697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add26c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2001899697 >> 172.21.15.39:0/2001899697 conn(0x55f5add1f9b0 msgr2=0x55f5add20740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2001899697 shutdown_connections 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.944+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2001899697 wait complete. 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 -- start start 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 Processor -- start 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add2ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add29bd0 0x55f5add2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f5adbbdab0 con 0x55f5add27190 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5adc2b730 con 0x55f5add29bd0 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f5add2cbb0 con 0x55f5add24860 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8ce5df740 10 client.0 _ll_register_callbacks cb 0x55f5adc7f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35258/0 (socket says 172.21.15.39:35258) 2024-09-10T21:56:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8c8daa640 1 -- 172.21.15.39:0/616345914 learned_addr learned my addr 172.21.15.39:0/616345914 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.945+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add29bd0 0x55f5add2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add2ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 -- 172.21.15.39:0/616345914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 msgr2=0x55f5add2ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add2ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 -- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add29bd0 msgr2=0x55f5add2f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add29bd0 0x55f5add2f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 -- 172.21.15.39:0/616345914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ad9e7790 con 0x55f5add27190 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add2ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40cc7c0 tx=0x7fc8b40c8790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0474955ef24f6de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4049040 con 0x55f5add27190 2024-09-10T21:56:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8b40c8aa0 con 0x55f5add27190 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c0018af0 con 0x55f5add27190 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8b40cbfa0 con 0x55f5add27190 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8ce5df740 10 client.15822 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5ada60620 con 0x55f5add27190 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c0018af0 con 0x55f5add27190 2024-09-10T21:56:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.946+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fc8b41080e0 con 0x55f5add27190 2024-09-10T21:56:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 20 client.15822 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5add39770 0x55f5add3bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 4 client.15822 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5adc98640 con 0x55f5add39770 2024-09-10T21:56:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5add39770 0x55f5add3bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5add39770 0x55f5add3bc10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a07c31fdf58f5 server_cookie=d42bc5d7bae82290 in_seq=0 out_seq=0 2024-09-10T21:56:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.947+0000 7fc8acff9640 10 client.15822 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8acff9640 1 -- 172.21.15.39:0/616345914 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5adc98640 con 0x55f5add39770 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8acff9640 10 client.15822 handle_command_reply: tid=0 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 client.15822 shutdown 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 msgr2=0x55f5add2e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40cc7c0 tx=0x7fc8b40c8790 comp rx=0 tx=0).stop 2024-09-10T21:56:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 shutdown_connections 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5add39770 0x55f5add3bc10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add29bd0 0x55f5add2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add27190 0x55f5add2e570 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/616345914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add2ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8acff9640 0 client.15822 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 >> 172.21.15.39:0/616345914 conn(0x55f5add1f9b0 msgr2=0x55f5add1ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 shutdown_connections 2024-09-10T21:56:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 1 -- 172.21.15.39:0/616345914 wait complete. 2024-09-10T21:56:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.949+0000 7fc8ce5df740 20 client.15822 trim_cache size 0 max 16384 2024-09-10T21:56:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 Processor -- start 2024-09-10T21:56:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 -- start start 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add24230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41a9e90 con 0x55f5add29bd0 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41aba60 con 0x55f5add27190 2024-09-10T21:56:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41aa560 con 0x55f5add24860 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c9dac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add24230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58336/0 (socket says 172.21.15.39:58336) 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 -- 172.21.15.39:0/2380900209 learned_addr learned my addr 172.21.15.39:0/2380900209 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c9dac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add24230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35272/0 (socket says 172.21.15.39:35272) 2024-09-10T21:56:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 -- 172.21.15.39:0/2380900209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 msgr2=0x55f5add23cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add23cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 -- 172.21.15.39:0/2380900209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 msgr2=0x55f5add24230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add24230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.966+0000 7fc8c8daa640 1 -- 172.21.15.39:0/2380900209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5add2dca0 con 0x55f5add27190 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.967+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b4fd0 tx=0x7fc8b402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22dcfaff2851b1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.967+0000 7fc8aeffd640 1 -- 172.21.15.39:0/2380900209 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4049070 con 0x55f5add27190 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.967+0000 7fc8aeffd640 1 -- 172.21.15.39:0/2380900209 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b40ccf30 con 0x55f5add27190 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.967+0000 7fc8aeffd640 1 -- 172.21.15.39:0/2380900209 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b41080c0 con 0x55f5add27190 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2380900209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 msgr2=0x55f5add361c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b4fd0 tx=0x7fc8b402a410 comp rx=0 tx=0).stop 2024-09-10T21:56:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2380900209 shutdown_connections 2024-09-10T21:56:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add27190 0x55f5add361c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2380900209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add24860 0x55f5add23cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2380900209 >> 172.21.15.39:0/2380900209 conn(0x55f5add1f9b0 msgr2=0x55f5add29fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2380900209 shutdown_connections 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2380900209 wait complete. 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- start start 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 Processor -- start 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add27190 0x55f5add34950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add34e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41ab300 con 0x55f5add29bd0 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41aac30 con 0x55f5add24860 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.968+0000 7fc8ce5df740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41a7e70 con 0x55f5add27190 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8ce5df740 10 client.0 _ll_register_callbacks cb 0x7fc8b40039a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add34e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c95ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c95ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58344/0 (socket says 172.21.15.39:58344) 2024-09-10T21:56:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c95ab640 1 -- 172.21.15.39:0/2103704474 learned_addr learned my addr 172.21.15.39:0/2103704474 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c8daa640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add27190 0x55f5add34950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.984 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 -- 172.21.15.39:0/2103704474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add27190 msgr2=0x55f5add34950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add27190 0x55f5add34950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 -- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 msgr2=0x55f5add35c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 -- 172.21.15.39:0/2103704474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5add35450 con 0x55f5add29bd0 2024-09-10T21:56:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8c9dac640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add34e90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55f5add2ec20 tx=0x7fc8bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b163272103c3e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8acff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc003970 con 0x55f5add29bd0 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8bc003b10 con 0x55f5add29bd0 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b40ccf30 con 0x55f5add29bd0 2024-09-10T21:56:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc003d10 con 0x55f5add29bd0 2024-09-10T21:56:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8ce5df740 10 client.15828 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.969+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5adda6720 con 0x55f5add29bd0 2024-09-10T21:56:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b40ccf30 con 0x55f5add29bd0 2024-09-10T21:56:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fc8bc004660 con 0x55f5add29bd0 2024-09-10T21:56:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 10 client.15828 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 20 client.15828 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5adda70b0 0x55f5adda94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 4 client.15828 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5adc940f0 con 0x55f5adda70b0 2024-09-10T21:56:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5adda70b0 0x55f5adda94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8c95ab640 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5adda70b0 0x55f5adda94d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feadafa1ff188233 server_cookie=21fbcc39ac4b1b47 in_seq=0 out_seq=0 2024-09-10T21:56:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:29.970+0000 7fc8acff9640 10 client.15828 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:30.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:30 smithi173 ceph-mon[35294]: pgmap v386: 97 pgs: 97 active+clean; 91 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T21:56:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:30 smithi070 ceph-mon[34909]: pgmap v386: 97 pgs: 97 active+clean; 91 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T21:56:31.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:30 smithi039 ceph-mon[30872]: pgmap v386: 97 pgs: 97 active+clean; 91 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 1.03k op/s 2024-09-10T21:56:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.469+0000 7fc8acff9640 1 -- 172.21.15.39:0/2103704474 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5adc940f0 con 0x55f5adda70b0 2024-09-10T21:56:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.469+0000 7fc8acff9640 10 client.15828 handle_command_reply: tid=0 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.469+0000 7fc8ce5df740 1 client.15828 shutdown 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 msgr2=0x55f5add34e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add34e90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55f5add2ec20 tx=0x7fc8bc004a40 comp rx=0 tx=0).stop 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 shutdown_connections 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f5adda70b0 0x55f5adda94d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5add29bd0 0x55f5add34e90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f5add27190 0x55f5add34950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8acff9640 0 client.15828 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 --2- 172.21.15.39:0/2103704474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5add24860 0x55f5add35c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 >> 172.21.15.39:0/2103704474 conn(0x55f5add1f9b0 msgr2=0x55f5add1e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 shutdown_connections 2024-09-10T21:56:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 1 -- 172.21.15.39:0/2103704474 wait complete. 2024-09-10T21:56:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8ce5df740 20 client.15828 trim_cache size 0 max 16384 2024-09-10T21:56:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:56:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:56:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:56:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 msgr2=0x7fc8b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 0x7fc8b00b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4199af0 tx=0x7fc8bc009500 comp rx=0 tx=0).stop 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 msgr2=0x7fc8c41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.470+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005940 tx=0x7fc8b4031a50 comp rx=0 tx=0).stop 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 shutdown_connections 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8b00b52e0 0x7fc8b00b77a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8c41086c0 0x7fc8c4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8c4105b10 0x7fc8c41993c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 --2- 172.21.15.39:0/3774380224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8c406bfb0 0x7fc8c4198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 >> 172.21.15.39:0/3774380224 conn(0x7fc8c40fd150 msgr2=0x7fc8c4103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 shutdown_connections 2024-09-10T21:56:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:32.471+0000 7fc8cb80f640 1 -- 172.21.15.39:0/3774380224 wait complete. 2024-09-10T21:56:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:32 smithi173 ceph-mon[35294]: pgmap v387: 97 pgs: 97 active+clean; 99 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 754 op/s 2024-09-10T21:56:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:32 smithi070 ceph-mon[34909]: pgmap v387: 97 pgs: 97 active+clean; 99 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 754 op/s 2024-09-10T21:56:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:32 smithi039 ceph-mon[30872]: pgmap v387: 97 pgs: 97 active+clean; 99 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 754 op/s 2024-09-10T21:56:34.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:34 smithi173 ceph-mon[35294]: pgmap v388: 97 pgs: 97 active+clean; 141 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.59k op/s 2024-09-10T21:56:35.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:34 smithi070 ceph-mon[34909]: pgmap v388: 97 pgs: 97 active+clean; 141 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.59k op/s 2024-09-10T21:56:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:34 smithi039 ceph-mon[30872]: pgmap v388: 97 pgs: 97 active+clean; 141 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.59k op/s 2024-09-10T21:56:36.500 INFO:tasks.workunit.client.0.smithi039.stdout: 38 35684 6 21992 2 21464 8 2024-09-10T21:56:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:36 smithi173 ceph-mon[35294]: pgmap v389: 97 pgs: 97 active+clean; 139 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 1.66k op/s 2024-09-10T21:56:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:36 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:37.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:36 smithi070 ceph-mon[34909]: pgmap v389: 97 pgs: 97 active+clean; 139 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 1.66k op/s 2024-09-10T21:56:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:36 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:37.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:36 smithi039 ceph-mon[30872]: pgmap v389: 97 pgs: 97 active+clean; 139 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 1.66k op/s 2024-09-10T21:56:37.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:36 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:56:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:38 smithi173 ceph-mon[35294]: pgmap v390: 97 pgs: 97 active+clean; 126 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.88k op/s 2024-09-10T21:56:39.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:38 smithi070 ceph-mon[34909]: pgmap v390: 97 pgs: 97 active+clean; 126 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.88k op/s 2024-09-10T21:56:39.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:38 smithi039 ceph-mon[30872]: pgmap v390: 97 pgs: 97 active+clean; 126 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.88k op/s 2024-09-10T21:56:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:40 smithi173 ceph-mon[35294]: pgmap v391: 97 pgs: 97 active+clean; 126 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.96k op/s 2024-09-10T21:56:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:40 smithi070 ceph-mon[34909]: pgmap v391: 97 pgs: 97 active+clean; 126 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.96k op/s 2024-09-10T21:56:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:40 smithi039 ceph-mon[30872]: pgmap v391: 97 pgs: 97 active+clean; 126 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 1.96k op/s 2024-09-10T21:56:41.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:41 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:56:41.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:41 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:56:42.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:41 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:56:42.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:41 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:56:42.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:41 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:56:42.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:41 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:56:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:42 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:56:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:42 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:56:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:42 smithi173 ceph-mon[35294]: pgmap v392: 97 pgs: 97 active+clean; 126 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 1.56k op/s 2024-09-10T21:56:43.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:42 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:56:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:42 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:56:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:42 smithi070 ceph-mon[34909]: pgmap v392: 97 pgs: 97 active+clean; 126 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 1.56k op/s 2024-09-10T21:56:43.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:42 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:56:43.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:42 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:56:43.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:42 smithi039 ceph-mon[30872]: pgmap v392: 97 pgs: 97 active+clean; 126 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 1.56k op/s 2024-09-10T21:56:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:44 smithi173 ceph-mon[35294]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.1 MiB/s wr, 1.52k op/s 2024-09-10T21:56:45.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:44 smithi070 ceph-mon[34909]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.1 MiB/s wr, 1.52k op/s 2024-09-10T21:56:45.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:44 smithi039 ceph-mon[30872]: pgmap v393: 97 pgs: 97 active+clean; 132 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.1 MiB/s wr, 1.52k op/s 2024-09-10T21:56:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 -- 172.21.15.39:0/3617487649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c06bf30 msgr2=0x7f3d1c1055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 --2- 172.21.15.39:0/3617487649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c1055e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009900 tx=0x7f3d1802a410 comp rx=0 tx=0).stop 2024-09-10T21:56:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 -- 172.21.15.39:0/3617487649 shutdown_connections 2024-09-10T21:56:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 --2- 172.21.15.39:0/3617487649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 0x7f3d1c10ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 --2- 172.21.15.39:0/3617487649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c105b20 0x7f3d1c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 --2- 172.21.15.39:0/3617487649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c1055e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 -- 172.21.15.39:0/3617487649 >> 172.21.15.39:0/3617487649 conn(0x7f3d1c0fd170 msgr2=0x7f3d1c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 -- 172.21.15.39:0/3617487649 shutdown_connections 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.562+0000 7f3d23639640 1 -- 172.21.15.39:0/3617487649 wait complete. 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 Processor -- start 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 -- start start 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 0x7f3d1c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10e630 con 0x7f3d1c105b20 2024-09-10T21:56:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10e4b0 con 0x7f3d1c06bf30 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d23639640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10e7b0 con 0x7f3d1c1086b0 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d20bd4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d20bd4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55978/0 (socket says 172.21.15.39:55978) 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d20bd4640 1 -- 172.21.15.39:0/2727220515 learned_addr learned my addr 172.21.15.39:0/2727220515 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.563+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 0x7f3d1c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 -- 172.21.15.39:0/2727220515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 msgr2=0x7f3d1c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 0x7f3d1c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 -- 172.21.15.39:0/2727220515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 msgr2=0x7f3d1c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 -- 172.21.15.39:0/2727220515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c19a8f0 con 0x7f3d1c105b20 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e9c0 tx=0x7f3d0c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d127fc640 1 -- 172.21.15.39:0/2727220515 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00cd80 con 0x7f3d1c105b20 2024-09-10T21:56:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d127fc640 1 -- 172.21.15.39:0/2727220515 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0c0054d0 con 0x7f3d1c105b20 2024-09-10T21:56:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c19abe0 con 0x7f3d1c105b20 2024-09-10T21:56:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d127fc640 1 -- 172.21.15.39:0/2727220515 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c010430 con 0x7f3d1c105b20 2024-09-10T21:56:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.564+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c1a12b0 con 0x7f3d1c105b20 2024-09-10T21:56:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d127fc640 1 -- 172.21.15.39:0/2727220515 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3d0c004fd0 con 0x7f3d1c105b20 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d2640b740 1 Processor -- start 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d2640b740 1 -- start start 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e31990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.567+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 0x563048e344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d2640b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563048d9a6f0 con 0x563048e2cc70 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d2640b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563048d89b20 con 0x563048e31fe0 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d2640b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563048d8d930 con 0x563048e2f5a0 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55980/0 (socket says 172.21.15.39:55980) 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1112334238 learned_addr learned my addr 172.21.15.39:0/1112334238 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 0x563048e344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d213d5640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e31990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1112334238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 msgr2=0x563048e31990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e31990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1112334238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 msgr2=0x563048e344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 0x563048e344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1112334238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048d4f530 con 0x563048e2cc70 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d127fc640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 0x7f3d080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 0x563048e344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009f80 tx=0x7f3d14010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9942e56988bdb5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 0x7f3d080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d127fc640 1 -- 172.21.15.39:0/2727220515 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3d0c0e6090 con 0x7f3d1c105b20 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.568+0000 7f3d077fe640 1 -- 172.21.15.39:0/1112334238 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14003b70 con 0x563048e2cc70 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d077fe640 1 -- 172.21.15.39:0/1112334238 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d14003d10 con 0x563048e2cc70 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d077fe640 1 -- 172.21.15.39:0/1112334238 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14011ac0 con 0x563048e2cc70 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 -- 172.21.15.39:0/1112334238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 msgr2=0x563048e2f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 0x7f3d080b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000c00 tx=0x7f3d180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009f80 tx=0x7f3d14010860 comp rx=0 tx=0).stop 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 -- 172.21.15.39:0/1112334238 shutdown_connections 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e31fe0 0x563048e344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e31990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1112334238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2cc70 0x563048e2f060 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 -- 172.21.15.39:0/1112334238 >> 172.21.15.39:0/1112334238 conn(0x563048e27dc0 msgr2=0x563048e28b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 -- 172.21.15.39:0/1112334238 shutdown_connections 2024-09-10T21:56:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.569+0000 7f3d2640b740 1 -- 172.21.15.39:0/1112334238 wait complete. 2024-09-10T21:56:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 -- start start 2024-09-10T21:56:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 Processor -- start 2024-09-10T21:56:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e37570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563048cc1ab0 con 0x563048e31fe0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563048d2f730 con 0x563048e2cc70 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563048e34fc0 con 0x563048e2f5a0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d2640b740 10 client.0 _ll_register_callbacks cb 0x563048d836b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d213d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d20bd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d21bd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e37570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d213d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47326/0 (socket says 172.21.15.39:47326) 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d213d5640 1 -- 172.21.15.39:0/2106462915 learned_addr learned my addr 172.21.15.39:0/2106462915 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.570+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:57472/0 (socket says 172.21.15.39:57472) 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 -- 172.21.15.39:0/2106462915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 msgr2=0x563048e369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 -- 172.21.15.39:0/2106462915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 msgr2=0x563048e37570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e37570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 -- 172.21.15.39:0/2106462915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563048aeb790 con 0x563048e2cc70 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d213d5640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d18033000 tx=0x7f3d18009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47bc6a2d26cd0830 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1804d030 con 0x563048e2cc70 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3d180046c0 con 0x563048e2cc70 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d14003d10 con 0x563048e2cc70 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3d18035040 con 0x563048e2cc70 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d2640b740 10 client.25439 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563048b64620 con 0x563048e2cc70 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.571+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d14003d10 con 0x563048e2cc70 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f3d1803db00 con 0x563048e2cc70 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 10 client.25439 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 20 client.25439 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048e41c50 0x563048e440b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 4 client.25439 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563048d9c640 con 0x563048e41c50 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048e41c50 0x563048e440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d04ff9640 10 client.25439 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.572+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048e41c50 0x563048e440b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c5698aa812b56a server_cookie=c326889e210fb056 in_seq=0 out_seq=0 2024-09-10T21:56:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d04ff9640 1 -- 172.21.15.39:0/2106462915 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563048d9c640 con 0x563048e41c50 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d04ff9640 10 client.25439 handle_command_reply: tid=0 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 client.25439 shutdown 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 msgr2=0x563048e36300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d18033000 tx=0x7f3d18009260 comp rx=0 tx=0).stop 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 shutdown_connections 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048e41c50 0x563048e440b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e37570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 --2- 172.21.15.39:0/2106462915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e36300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 >> 172.21.15.39:0/2106462915 conn(0x563048e27dc0 msgr2=0x563048e2f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d04ff9640 0 client.25439 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 shutdown_connections 2024-09-10T21:56:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 1 -- 172.21.15.39:0/2106462915 wait complete. 2024-09-10T21:56:45.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.574+0000 7f3d2640b740 20 client.25439 trim_cache size 0 max 16384 2024-09-10T21:56:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 Processor -- start 2024-09-10T21:56:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 -- start start 2024-09-10T21:56:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e43c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 0x563048e28b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a7d00 con 0x563048e2f5a0 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a98d0 con 0x563048e2cc70 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d2640b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a83d0 con 0x563048e31fe0 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56010/0 (socket says 172.21.15.39:56010) 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 -- 172.21.15.39:0/1908537296 learned_addr learned my addr 172.21.15.39:0/1908537296 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d213d5640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e43c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 0x563048e28b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 -- 172.21.15.39:0/1908537296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 msgr2=0x563048e28b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 0x563048e28b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 -- 172.21.15.39:0/1908537296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 msgr2=0x563048e43c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e43c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 -- 172.21.15.39:0/1908537296 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048e2f3d0 con 0x563048e2f5a0 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 0x563048e28b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0e3ba0 tx=0x7f3d0c0e9b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f40f54be64e8655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d06ffd640 1 -- 172.21.15.39:0/1908537296 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0a8eb0 con 0x563048e2f5a0 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d06ffd640 1 -- 172.21.15.39:0/1908537296 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0c0046c0 con 0x563048e2f5a0 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.590+0000 7f3d06ffd640 1 -- 172.21.15.39:0/1908537296 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0abfd0 con 0x563048e2f5a0 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- 172.21.15.39:0/1908537296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 msgr2=0x563048e28620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0e3ba0 tx=0x7f3d0c0e9b70 comp rx=0 tx=0).stop 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- 172.21.15.39:0/1908537296 shutdown_connections 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e31fe0 0x563048e28b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e2f5a0 0x563048e28620 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1908537296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- 172.21.15.39:0/1908537296 >> 172.21.15.39:0/1908537296 conn(0x563048e27dc0 msgr2=0x563048e2c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- 172.21.15.39:0/1908537296 shutdown_connections 2024-09-10T21:56:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- 172.21.15.39:0/1908537296 wait complete. 2024-09-10T21:56:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.591+0000 7f3d2640b740 1 -- start start 2024-09-10T21:56:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 Processor -- start 2024-09-10T21:56:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e3dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e3c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a9170 con 0x563048e31fe0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a8aa0 con 0x563048e2cc70 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a5ce0 con 0x563048e2f5a0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d2640b740 10 client.0 _ll_register_callbacks cb 0x7f3d18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56014/0 (socket says 172.21.15.39:56014) 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d213d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e3dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1055290773 learned_addr learned my addr 172.21.15.39:0/1055290773 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d20bd4640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e3c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1055290773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 msgr2=0x563048e3c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e3c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 msgr2=0x563048e3dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e3dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.592+0000 7f3d21bd6640 1 -- 172.21.15.39:0/1055290773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563048e3d490 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d21bd6640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009f20 tx=0x7f3d14009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1342e3becc1dae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1402d060 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3d14011980 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563048d980f0 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3d14009c00 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 10 client.15846 fetch_fsmap learned FSMap version 29 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563048eaebc0 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563048d980f0 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f3d14028460 con 0x563048e31fe0 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 10 client.15846 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T21:56:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 20 client.15846 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048eaf1a0 0x563048eb15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 4 client.15846 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.593+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563048d95520 con 0x563048eaf1a0 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.594+0000 7f3d213d5640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048eaf1a0 0x563048eb15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.594+0000 7f3d04ff9640 10 client.15846 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:45.594+0000 7f3d213d5640 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048eaf1a0 0x563048eb15c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77dc2a744f87244 server_cookie=7bdb1c586cd9425f in_seq=0 out_seq=0 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d04ff9640 1 -- 172.21.15.39:0/1055290773 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563048d95520 con 0x563048eaf1a0 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d04ff9640 10 client.15846 handle_command_reply: tid=0 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 client.15846 shutdown 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 msgr2=0x563048e3ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009f20 tx=0x7f3d14009a00 comp rx=0 tx=0).stop 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 shutdown_connections 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563048eaf1a0 0x563048eb15c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563048e31fe0 0x563048e3ce50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048e2f5a0 0x563048e3c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 --2- 172.21.15.39:0/1055290773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563048e2cc70 0x563048e3dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.073+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 >> 172.21.15.39:0/1055290773 conn(0x563048e27dc0 msgr2=0x563048e30ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d04ff9640 0 client.15846 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 shutdown_connections 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d2640b740 1 -- 172.21.15.39:0/1055290773 wait complete. 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d2640b740 20 client.15846 trim_cache size 0 max 16384 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:56:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 msgr2=0x7f3d080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 0x7f3d080b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000c00 tx=0x7f3d180314a0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 msgr2=0x7f3d1c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e9c0 tx=0x7f3d0c00ee80 comp rx=0 tx=0).stop 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 shutdown_connections 2024-09-10T21:56:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3d080b52e0 0x7f3d080b77a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d1c1086b0 0x7f3d1c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d1c105b20 0x7f3d1c199400 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 --2- 172.21.15.39:0/2727220515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d1c06bf30 0x7f3d1c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 >> 172.21.15.39:0/2727220515 conn(0x7f3d1c0fd170 msgr2=0x7f3d1c103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 shutdown_connections 2024-09-10T21:56:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:46.074+0000 7f3d23639640 1 -- 172.21.15.39:0/2727220515 wait complete. 2024-09-10T21:56:46.500 INFO:tasks.workunit.client.0.smithi039.stdout: 38 32865 59 19611 48 18647 137 2024-09-10T21:56:46.990 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:46 smithi039 ceph-mon[30872]: pgmap v394: 97 pgs: 97 active+clean; 139 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 820 op/s 2024-09-10T21:56:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:46 smithi173 ceph-mon[35294]: pgmap v394: 97 pgs: 97 active+clean; 139 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 820 op/s 2024-09-10T21:56:47.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:46 smithi070 ceph-mon[34909]: pgmap v394: 97 pgs: 97 active+clean; 139 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 820 op/s 2024-09-10T21:56:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:48 smithi039 ceph-mon[30872]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 725 op/s 2024-09-10T21:56:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:48 smithi173 ceph-mon[35294]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 725 op/s 2024-09-10T21:56:49.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:48 smithi070 ceph-mon[34909]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 725 op/s 2024-09-10T21:56:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:50 smithi173 ceph-mon[35294]: pgmap v396: 97 pgs: 97 active+clean; 122 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 531 op/s 2024-09-10T21:56:51.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:50 smithi070 ceph-mon[34909]: pgmap v396: 97 pgs: 97 active+clean; 122 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 531 op/s 2024-09-10T21:56:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:50 smithi039 ceph-mon[30872]: pgmap v396: 97 pgs: 97 active+clean; 122 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 531 op/s 2024-09-10T21:56:52.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:52 smithi070 ceph-mon[34909]: pgmap v397: 97 pgs: 97 active+clean; 117 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 412 op/s 2024-09-10T21:56:52.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:52 smithi039 ceph-mon[30872]: pgmap v397: 97 pgs: 97 active+clean; 117 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 412 op/s 2024-09-10T21:56:52.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:52 smithi173 ceph-mon[35294]: pgmap v397: 97 pgs: 97 active+clean; 117 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 412 op/s 2024-09-10T21:56:54.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:54 smithi070 ceph-mon[34909]: pgmap v398: 97 pgs: 97 active+clean; 121 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 477 op/s 2024-09-10T21:56:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:54 smithi039 ceph-mon[30872]: pgmap v398: 97 pgs: 97 active+clean; 121 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 477 op/s 2024-09-10T21:56:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:54 smithi173 ceph-mon[35294]: pgmap v398: 97 pgs: 97 active+clean; 121 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 477 op/s 2024-09-10T21:56:56.500 INFO:tasks.workunit.client.0.smithi039.stdout: 47 893358 562 557187 414 479845 1586 2024-09-10T21:56:56.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:56 smithi070 ceph-mon[34909]: pgmap v399: 97 pgs: 97 active+clean; 125 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-10T21:56:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:56 smithi039 ceph-mon[30872]: pgmap v399: 97 pgs: 97 active+clean; 125 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-10T21:56:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:56 smithi173 ceph-mon[35294]: pgmap v399: 97 pgs: 97 active+clean; 125 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-10T21:56:57.836 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:57 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:57.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:57 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:57.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:57 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:56:58.516 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:56:58.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:56:58 smithi070 ceph-mon[34909]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-09-10T21:56:58.926 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:56:58 smithi039 ceph-mon[30872]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-09-10T21:56:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:56:58 smithi173 ceph-mon[35294]: pgmap v400: 97 pgs: 97 active+clean; 130 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-09-10T21:56:59.018 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:56:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 -- 172.21.15.39:0/967438234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 msgr2=0x7f40ac102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 --2- 172.21.15.39:0/967438234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac102e80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f409c009930 tx=0x7f409c02a420 comp rx=0 tx=0).stop 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 -- 172.21.15.39:0/967438234 shutdown_connections 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 --2- 172.21.15.39:0/967438234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1033c0 0x7f40ac109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 --2- 172.21.15.39:0/967438234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac102e80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 --2- 172.21.15.39:0/967438234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1018b0 0x7f40ac101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 -- 172.21.15.39:0/967438234 >> 172.21.15.39:0/967438234 conn(0x7f40ac0fd150 msgr2=0x7f40ac0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 -- 172.21.15.39:0/967438234 shutdown_connections 2024-09-10T21:56:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.174+0000 7f40b336b640 1 -- 172.21.15.39:0/967438234 wait complete. 2024-09-10T21:56:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 Processor -- start 2024-09-10T21:56:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 -- start start 2024-09-10T21:56:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac19ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1033c0 0x7f40ac1a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac10d520 con 0x7f40ac102a00 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac10d3a0 con 0x7f40ac1018b0 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.175+0000 7f40b336b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac10d6a0 con 0x7f40ac1033c0 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b0906640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac19ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b0906640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac19ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53212/0 (socket says 172.21.15.39:53212) 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53628/0 (socket says 172.21.15.39:53628) 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b0906640 1 -- 172.21.15.39:0/367829840 learned_addr learned my addr 172.21.15.39:0/367829840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1908640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1033c0 0x7f40ac1a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 -- 172.21.15.39:0/367829840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1033c0 msgr2=0x7f40ac1a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1033c0 0x7f40ac1a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 -- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 msgr2=0x7f40ac19ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac19ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 -- 172.21.15.39:0/367829840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac1a2be0 con 0x7f40ac1018b0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b1107640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9f0 tx=0x7f40a800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40a27fc640 1 -- 172.21.15.39:0/367829840 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a800ccc0 con 0x7f40ac1018b0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac1a2ed0 con 0x7f40ac1018b0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40a27fc640 1 -- 172.21.15.39:0/367829840 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a8005020 con 0x7f40ac1018b0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.176+0000 7f40a27fc640 1 -- 172.21.15.39:0/367829840 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8004a00 con 0x7f40ac1018b0 2024-09-10T21:56:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.177+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac1a32e0 con 0x7f40ac1018b0 2024-09-10T21:56:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 Processor -- start 2024-09-10T21:56:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 -- start start 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40a27fc640 1 -- 172.21.15.39:0/367829840 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f40a8004ba0 con 0x7f40ac1018b0 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139d190 0x55b58139f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 0x55b5813a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b58130c6f0 con 0x55b58139a860 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5812fbb20 con 0x55b58139fbd0 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b6215740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b5812ff930 con 0x55b58139d190 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b1908640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b0906640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 0x55b5813a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b1908640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53220/0 (socket says 172.21.15.39:53220) 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.179+0000 7f40b1908640 1 -- 172.21.15.39:0/1158575208 learned_addr learned my addr 172.21.15.39:0/1158575208 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b1107640 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139d190 0x55b58139f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 -- 172.21.15.39:0/1158575208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139d190 msgr2=0x55b58139f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139d190 0x55b58139f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 -- 172.21.15.39:0/1158575208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 msgr2=0x55b58139cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 -- 172.21.15.39:0/1158575208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5812c1530 con 0x55b58139fbd0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b1908640 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b0906640 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 0x55b5813a2090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f409c000c00 tx=0x7f409c005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b5d2835f4829583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40a27fc640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 0x7f40980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40977fe640 1 -- 172.21.15.39:0/1158575208 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c040070 con 0x55b58139fbd0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40977fe640 1 -- 172.21.15.39:0/1158575208 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c004030 con 0x55b58139fbd0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40977fe640 1 -- 172.21.15.39:0/1158575208 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c035040 con 0x55b58139fbd0 2024-09-10T21:56:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40b1908640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 0x7f40980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.180+0000 7f40a27fc640 1 -- 172.21.15.39:0/367829840 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f40a80e5b70 con 0x7f40ac1018b0 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- 172.21.15.39:0/1158575208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 msgr2=0x55b5813a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b1908640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 0x7f40980b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f40a4011890 tx=0x7f40a4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 0x55b5813a2090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f409c000c00 tx=0x7f409c005e30 comp rx=0 tx=0).stop 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- 172.21.15.39:0/1158575208 shutdown_connections 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139fbd0 0x55b5813a2090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139d190 0x55b58139f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 --2- 172.21.15.39:0/1158575208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139a860 0x55b58139cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- 172.21.15.39:0/1158575208 >> 172.21.15.39:0/1158575208 conn(0x55b5813959b0 msgr2=0x55b581396740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- 172.21.15.39:0/1158575208 shutdown_connections 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- 172.21.15.39:0/1158575208 wait complete. 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 -- start start 2024-09-10T21:56:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.181+0000 7f40b6215740 1 Processor -- start 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b5813a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b581233ab0 con 0x55b58139d190 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5812a1730 con 0x55b58139a860 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b5813a2b50 con 0x55b58139fbd0 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b6215740 10 client.0 _ll_register_callbacks cb 0x55b5812f56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b0906640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b5813a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53648/0 (socket says 172.21.15.39:53648) 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 -- 172.21.15.39:0/1229246101 learned_addr learned my addr 172.21.15.39:0/1229246101 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1908640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 -- 172.21.15.39:0/1229246101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 msgr2=0x55b5813a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 -- 172.21.15.39:0/1229246101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 msgr2=0x55b5813a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b5813a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 -- 172.21.15.39:0/1229246101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b58105d790 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b0906640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b5813a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f40b1107640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40a80ac2d0 tx=0x7f40a80e9210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65927b6ed182e9df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.182+0000 7f4094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a801c040 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f40a80054f0 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f409c004030 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40a80abab0 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 10 client.25457 fetch_fsmap learned FSMap version 30 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5810d6620 con 0x55b58139a860 2024-09-10T21:56:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c004030 con 0x55b58139a860 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f40a80d3130 con 0x55b58139a860 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 10 client.25457 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 10 client.25457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 20 client.25457 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b5813af7c0 0x55b5813b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 4 client.25457 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b58130e640 con 0x55b5813af7c0 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.183+0000 7f40b0906640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b5813af7c0 0x55b5813b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.184+0000 7f4094ff9640 10 client.25457 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.192 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.184+0000 7f40b0906640 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b5813af7c0 0x55b5813b1c40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f7261ee9f39883 server_cookie=f66b3ce39b2bd329 in_seq=0 out_seq=0 2024-09-10T21:56:59.193 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f4094ff9640 1 -- 172.21.15.39:0/1229246101 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b58130e640 con 0x55b5813af7c0 2024-09-10T21:56:59.193 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f4094ff9640 10 client.25457 handle_command_reply: tid=0 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 client.25457 shutdown 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 msgr2=0x55b5813a3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40a80ac2d0 tx=0x7f40a80e9210 comp rx=0 tx=0).stop 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 shutdown_connections 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b5813af7c0 0x55b5813b1c40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b5813a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 --2- 172.21.15.39:0/1229246101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a3e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f4094ff9640 0 client.25457 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 >> 172.21.15.39:0/1229246101 conn(0x55b5813959b0 msgr2=0x55b581394bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 shutdown_connections 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.188+0000 7f40b6215740 1 -- 172.21.15.39:0/1229246101 wait complete. 2024-09-10T21:56:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.189+0000 7f40b6215740 20 client.25457 trim_cache size 0 max 16384 2024-09-10T21:56:59.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.203+0000 7f40b6215740 1 Processor -- start 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.203+0000 7f40b6215740 1 -- start start 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1ac120 con 0x55b58139d190 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1add20 con 0x55b58139a860 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b6215740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1ac7f0 con 0x55b58139fbd0 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53234/0 (socket says 172.21.15.39:53234) 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b1107640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53656/0 (socket says 172.21.15.39:53656) 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 -- 172.21.15.39:0/3488842418 learned_addr learned my addr 172.21.15.39:0/3488842418 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b1908640 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 -- 172.21.15.39:0/3488842418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 msgr2=0x55b5813a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 -- 172.21.15.39:0/3488842418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 msgr2=0x55b5813a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 -- 172.21.15.39:0/3488842418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5813a53e0 con 0x55b58139d190 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b1107640 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.204+0000 7f40b0906640 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f409c005c40 tx=0x7f409c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3dc64c44583f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f4096ffd640 1 -- 172.21.15.39:0/3488842418 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c040040 con 0x55b58139d190 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f4096ffd640 1 -- 172.21.15.39:0/3488842418 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c009520 con 0x55b58139d190 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f4096ffd640 1 -- 172.21.15.39:0/3488842418 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c035040 con 0x55b58139d190 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 -- 172.21.15.39:0/3488842418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 msgr2=0x55b58139ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f409c005c40 tx=0x7f409c009260 comp rx=0 tx=0).stop 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 -- 172.21.15.39:0/3488842418 shutdown_connections 2024-09-10T21:56:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139fbd0 0x55b5813a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139d190 0x55b58139ffb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 --2- 172.21.15.39:0/3488842418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139a860 0x55b5813a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 -- 172.21.15.39:0/3488842418 >> 172.21.15.39:0/3488842418 conn(0x55b5813959b0 msgr2=0x55b581396650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 -- 172.21.15.39:0/3488842418 shutdown_connections 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.205+0000 7f40b6215740 1 -- 172.21.15.39:0/3488842418 wait complete. 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 -- start start 2024-09-10T21:56:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 Processor -- start 2024-09-10T21:56:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139a860 0x55b5813a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 0x55b5813a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1ad590 con 0x55b58139fbd0 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1acec0 con 0x55b58139d190 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1aa100 con 0x55b58139a860 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b6215740 10 client.0 _ll_register_callbacks cb 0x7f40a800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b1908640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b1908640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53248/0 (socket says 172.21.15.39:53248) 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b0906640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 0x55b5813a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b1908640 1 -- 172.21.15.39:0/13977896 learned_addr learned my addr 172.21.15.39:0/13977896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.206+0000 7f40b1107640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139a860 0x55b5813a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 -- 172.21.15.39:0/13977896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139a860 msgr2=0x55b5813a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139a860 0x55b5813a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 -- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 msgr2=0x55b5813a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 0x55b5813a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 -- 172.21.15.39:0/13977896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b58139cfc0 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b0906640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 0x55b5813a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b1908640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f40a4003f50 tx=0x7f40a4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea765caa57a5cb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a402d070 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f40a4004b20 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f409c009520 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40a4004d20 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b6215740 10 client.15864 fetch_fsmap learned FSMap version 30 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5813abad0 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c009520 con 0x55b58139fbd0 2024-09-10T21:56:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f40a4030030 con 0x55b58139fbd0 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.207+0000 7f40b6215740 10 client.15864 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b6215740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b6215740 20 client.15864 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b58141cbe0 0x55b58141f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b6215740 4 client.15864 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b58130a0f0 con 0x55b58141cbe0 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b1107640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b58141cbe0 0x55b58141f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f4094ff9640 10 client.15864 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:56:59.208+0000 7f40b1107640 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b58141cbe0 0x55b58141f000 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614272179d98ad4d server_cookie=9294353f361944c1 in_seq=0 out_seq=0 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 -- 172.21.15.39:0/2175061595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 msgr2=0x7f9cbc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 --2- 172.21.15.39:0/2175061595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc10f550 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ca0 tx=0x7f9cb402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 -- 172.21.15.39:0/2175061595 shutdown_connections 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 --2- 172.21.15.39:0/2175061595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc10f550 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 --2- 172.21.15.39:0/2175061595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc104550 0x7f9cbc10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 --2- 172.21.15.39:0/2175061595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc103b50 0x7f9cbc103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 -- 172.21.15.39:0/2175061595 >> 172.21.15.39:0/2175061595 conn(0x7f9cbc0fd700 msgr2=0x7f9cbc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 -- 172.21.15.39:0/2175061595 shutdown_connections 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.536+0000 7f9cc3def640 1 -- 172.21.15.39:0/2175061595 wait complete. 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 Processor -- start 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 -- start start 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc104550 0x7f9cbc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc112d60 con 0x7f9cbc10d100 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc112be0 con 0x7f9cbc103b50 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc3def640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc112ee0 con 0x7f9cbc104550 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc1b8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc238c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc1b8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53696/0 (socket says 172.21.15.39:53696) 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc1b8b640 1 -- 172.21.15.39:0/1563292189 learned_addr learned my addr 172.21.15.39:0/1563292189 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.537+0000 7f9cc138a640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc104550 0x7f9cbc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 -- 172.21.15.39:0/1563292189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc104550 msgr2=0x7f9cbc199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc104550 0x7f9cbc199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 -- 172.21.15.39:0/1563292189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 msgr2=0x7f9cbc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 -- 172.21.15.39:0/1563292189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc19f2b0 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc238c640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc19eae0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9cb402ade0 tx=0x7f9cb4031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cb2ffd640 1 -- 172.21.15.39:0/1563292189 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4003b70 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cb2ffd640 1 -- 172.21.15.39:0/1563292189 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb4031910 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc19f540 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cb2ffd640 1 -- 172.21.15.39:0/1563292189 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb402f950 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.538+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1a5c60 con 0x7f9cbc10d100 2024-09-10T21:56:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.541+0000 7f9cc61c4740 1 Processor -- start 2024-09-10T21:56:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.541+0000 7f9cb2ffd640 1 -- 172.21.15.39:0/1563292189 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9cb4004040 con 0x7f9cbc10d100 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.541+0000 7f9cc61c4740 1 -- start start 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 0x55761f187410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f189d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55761f0f1e50 con 0x55761f187950 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55761f0e1280 con 0x55761f17b0a0 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55761f0e5090 con 0x55761f17b9c0 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53706/0 (socket says 172.21.15.39:53706) 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 -- 172.21.15.39:0/3873126504 learned_addr learned my addr 172.21.15.39:0/3873126504 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 0x55761f187410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f189d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 -- 172.21.15.39:0/3873126504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 msgr2=0x55761f187410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 0x55761f187410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 -- 172.21.15.39:0/3873126504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 msgr2=0x55761f189d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f189d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc138a640 1 -- 172.21.15.39:0/3873126504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55761ee3f650 con 0x55761f17b0a0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 0x55761f187410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.542+0000 7f9cb2ffd640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 0x7f9ca80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 0x7f9ca80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9cc138a640 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0058c0 tx=0x7f9cac005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4efc6a4e02b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9cb2ffd640 1 -- 172.21.15.39:0/1563292189 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9cb4106e20 con 0x7f9cbc10d100 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9ca7fff640 1 -- 172.21.15.39:0/3873126504 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac004030 con 0x55761f17b0a0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9ca7fff640 1 -- 172.21.15.39:0/3873126504 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cac005020 con 0x55761f17b0a0 2024-09-10T21:56:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.543+0000 7f9ca7fff640 1 -- 172.21.15.39:0/3873126504 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac004c00 con 0x55761f17b0a0 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- 172.21.15.39:0/3873126504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 msgr2=0x55761f17b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 0x7f9ca80b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55761f179db0 tx=0x7f9cb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0058c0 tx=0x7f9cac005850 comp rx=0 tx=0).stop 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- 172.21.15.39:0/3873126504 shutdown_connections 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f189d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b9c0 0x55761f187410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/3873126504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b0a0 0x55761f17b480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- 172.21.15.39:0/3873126504 >> 172.21.15.39:0/3873126504 conn(0x55761f178ed0 msgr2=0x55761f17a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- 172.21.15.39:0/3873126504 shutdown_connections 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- 172.21.15.39:0/3873126504 wait complete. 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 -- start start 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.544+0000 7f9cc61c4740 1 Processor -- start 2024-09-10T21:56:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f1846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f187950 0x55761f184cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55761ef42700 con 0x55761f17b0a0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55761f07c110 con 0x55761f17b9c0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55761f18a5d0 con 0x55761f187950 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc61c4740 10 client.0 _ll_register_callbacks cb 0x55761f095990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc1b8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc1b8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53286/0 (socket says 172.21.15.39:53286) 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc1b8b640 1 -- 172.21.15.39:0/4058269045 learned_addr learned my addr 172.21.15.39:0/4058269045 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc238c640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f187950 0x55761f184cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.545+0000 7f9cc138a640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f1846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 -- 172.21.15.39:0/4058269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f187950 msgr2=0x55761f184cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f187950 0x55761f184cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 -- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 msgr2=0x55761f1846a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f1846a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 -- 172.21.15.39:0/4058269045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55761f0a9c40 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ff70 tx=0x7f9cb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85685ca8f797983d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9ca57fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb802e060 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9cb8018030 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cac005020 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cb8009cf0 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc61c4740 10 client.15876 fetch_fsmap learned FSMap version 30 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.546+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55761f196000 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cac005020 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9cb8034a10 con 0x55761f17b0a0 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 10 client.15876 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:56:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 20 client.15876 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f197590 0x55761f1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 4 client.15876 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55761f0f3da0 con 0x55761f197590 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc138a640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f197590 0x55761f1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9ca57fa640 10 client.15876 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.547+0000 7f9cc138a640 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f197590 0x55761f1999f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36bef291897e215 server_cookie=dec2acee02c9cc5 in_seq=0 out_seq=0 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.549+0000 7f9ca57fa640 1 -- 172.21.15.39:0/4058269045 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55761f0f3da0 con 0x55761f197590 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.549+0000 7f9ca57fa640 10 client.15876 handle_command_reply: tid=0 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.549+0000 7f9cc61c4740 1 client.15876 shutdown 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.549+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 msgr2=0x55761f187250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.549+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ff70 tx=0x7f9cb8004730 comp rx=0 tx=0).stop 2024-09-10T21:56:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 shutdown_connections 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f197590 0x55761f1999f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f187950 0x55761f184cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f1846a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/4058269045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b0a0 0x55761f187250 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9ca57fa640 0 client.15876 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 >> 172.21.15.39:0/4058269045 conn(0x55761f178ed0 msgr2=0x55761f17ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 shutdown_connections 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 1 -- 172.21.15.39:0/4058269045 wait complete. 2024-09-10T21:56:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.550+0000 7f9cc61c4740 20 client.15876 trim_cache size 0 max 16384 2024-09-10T21:56:59.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 Processor -- start 2024-09-10T21:56:59.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 -- start start 2024-09-10T21:56:59.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f17a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f187950 0x55761f173e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ae280 con 0x55761f17b9c0 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1afe80 con 0x55761f187950 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.570+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ae950 con 0x55761f17b0a0 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53298/0 (socket says 172.21.15.39:53298) 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 -- 172.21.15.39:0/2650190103 learned_addr learned my addr 172.21.15.39:0/2650190103 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc238c640 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f187950 0x55761f173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f17a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 -- 172.21.15.39:0/2650190103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 msgr2=0x55761f17a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f17a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 -- 172.21.15.39:0/2650190103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f187950 msgr2=0x55761f173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f187950 0x55761f173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 -- 172.21.15.39:0/2650190103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55761f183620 con 0x55761f17b9c0 2024-09-10T21:56:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9cc138a640 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0117f0 tx=0x7f9cac009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e7573dd48ad73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.571+0000 7f9ca77fe640 1 -- 172.21.15.39:0/2650190103 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac011250 con 0x55761f17b9c0 2024-09-10T21:56:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9ca77fe640 1 -- 172.21.15.39:0/2650190103 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cac0044f0 con 0x55761f17b9c0 2024-09-10T21:56:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9ca77fe640 1 -- 172.21.15.39:0/2650190103 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00fd00 con 0x55761f17b9c0 2024-09-10T21:56:59.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 -- 172.21.15.39:0/2650190103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 msgr2=0x55761f193830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0117f0 tx=0x7f9cac009fd0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 -- 172.21.15.39:0/2650190103 shutdown_connections 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f187950 0x55761f173e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f17b9c0 0x55761f193830 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/2650190103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f17a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 -- 172.21.15.39:0/2650190103 >> 172.21.15.39:0/2650190103 conn(0x55761f178ed0 msgr2=0x55761f179f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 -- 172.21.15.39:0/2650190103 shutdown_connections 2024-09-10T21:56:59.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.572+0000 7f9cc61c4740 1 -- 172.21.15.39:0/2650190103 wait complete. 2024-09-10T21:56:59.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.573+0000 7f9cc61c4740 1 -- start start 2024-09-10T21:56:59.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.573+0000 7f9cc61c4740 1 Processor -- start 2024-09-10T21:56:59.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.573+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f2016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f18f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1af6f0 con 0x55761f187950 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1af020 con 0x55761f17b9c0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ac260 con 0x55761f17b0a0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc238c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f18f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53734/0 (socket says 172.21.15.39:53734) 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc238c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f18f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53308/0 (socket says 172.21.15.39:53308) 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 -- 172.21.15.39:0/786335588 learned_addr learned my addr 172.21.15.39:0/786335588 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f2016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc61c4740 10 client.0 _ll_register_callbacks cb 0x7f9cb8012e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:56:59.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 -- 172.21.15.39:0/786335588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 msgr2=0x55761f2016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f2016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 -- 172.21.15.39:0/786335588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 msgr2=0x55761f18f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f18f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 -- 172.21.15.39:0/786335588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55761f174570 con 0x55761f17b9c0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f2016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9cc138a640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009940 tx=0x7f9cac009d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c149b79a985c451 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.574+0000 7f9ca57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac03b030 con 0x55761f17b9c0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cac0044f0 con 0x55761f17b9c0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9cac005b90 con 0x55761f17b9c0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cac004040 con 0x55761f17b9c0 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 10 client.25481 fetch_fsmap learned FSMap version 30 2024-09-10T21:56:59.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55761f17b7f0 con 0x55761f17b9c0 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cac0044f0 con 0x55761f17b9c0 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9cac0035f0 con 0x55761f17b9c0 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 10 client.25481 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 20 client.25481 populate_metadata read hostname 'smithi039' 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f181460 0x55761f181870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 4 client.25481 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.575+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55761f0ef850 con 0x55761f181460 2024-09-10T21:56:59.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.576+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f181460 0x55761f181870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:56:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.576+0000 7f9cc1b8b640 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f181460 0x55761f181870 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b79f2dfd8893296 server_cookie=aecd4e6c167cafb6 in_seq=0 out_seq=0 2024-09-10T21:56:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.576+0000 7f9ca57fa640 10 client.25481 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9ca57fa640 1 -- 172.21.15.39:0/786335588 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55761f0ef850 con 0x55761f181460 2024-09-10T21:56:59.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9ca57fa640 10 client.25481 handle_command_reply: tid=0 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 client.25481 shutdown 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 msgr2=0x55761f201c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009940 tx=0x7f9cac009d00 comp rx=0 tx=0).stop 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 shutdown_connections 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55761f181460 0x55761f181870 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55761f187950 0x55761f18f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55761f17b9c0 0x55761f201c10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 --2- 172.21.15.39:0/786335588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55761f17b0a0 0x55761f2016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 >> 172.21.15.39:0/786335588 conn(0x55761f178ed0 msgr2=0x55761f185cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9ca57fa640 0 client.25481 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 shutdown_connections 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 1 -- 172.21.15.39:0/786335588 wait complete. 2024-09-10T21:56:59.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.578+0000 7f9cc61c4740 20 client.25481 trim_cache size 0 max 16384 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:59.586 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:56:59.587 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:56:59.588 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 msgr2=0x7f9ca80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 0x7f9ca80b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55761f179db0 tx=0x7f9cb8005f90 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 msgr2=0x7f9cbc19eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc19eae0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9cb402ade0 tx=0x7f9cb4031660 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 shutdown_connections 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9ca80b52e0 0x7f9ca80b77a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cbc10d100 0x7f9cbc19eae0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc104550 0x7f9cbc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 --2- 172.21.15.39:0/1563292189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cbc103b50 0x7f9cbc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 >> 172.21.15.39:0/1563292189 conn(0x7f9cbc0fd700 msgr2=0x7f9cbc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 shutdown_connections 2024-09-10T21:56:59.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:56:59.579+0000 7f9cc3def640 1 -- 172.21.15.39:0/1563292189 wait complete. 2024-09-10T21:57:00.273 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:57:00.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:57:00.650 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:00.904 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:00 smithi039 ceph-mon[30872]: pgmap v401: 97 pgs: 97 active+clean; 129 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-10T21:57:00.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:00 smithi070 ceph-mon[34909]: pgmap v401: 97 pgs: 97 active+clean; 129 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-10T21:57:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:00 smithi173 ceph-mon[35294]: pgmap v401: 97 pgs: 97 active+clean; 129 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 -- 172.21.15.39:0/3204133281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc01045b0 msgr2=0x7f1dc010cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/3204133281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc01045b0 0x7f1dc010cb90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009900 tx=0x7f1db402a410 comp rx=0 tx=0).stop 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 -- 172.21.15.39:0/3204133281 shutdown_connections 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/3204133281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc010d160 0x7f1dc010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/3204133281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc01045b0 0x7f1dc010cb90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/3204133281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc0103bb0 0x7f1dc0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 -- 172.21.15.39:0/3204133281 >> 172.21.15.39:0/3204133281 conn(0x7f1dc00fd700 msgr2=0x7f1dc00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.134+0000 7f1dc68c7640 1 -- 172.21.15.39:0/3204133281 shutdown_connections 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.135+0000 7f1dc68c7640 1 -- 172.21.15.39:0/3204133281 wait complete. 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.135+0000 7f1dc68c7640 1 Processor -- start 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.135+0000 7f1dc68c7640 1 -- start start 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0103bb0 0x7f1dc0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 0x7f1dc0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc0112da0 con 0x7f1dc010d160 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc0112c20 con 0x7f1dc01045b0 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc0112f20 con 0x7f1dc0103bb0 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60026/0 (socket says 172.21.15.39:60026) 2024-09-10T21:57:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 -- 172.21.15.39:0/1743228663 learned_addr learned my addr 172.21.15.39:0/1743228663 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbf7fe640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 0x7f1dc0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbffff640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0103bb0 0x7f1dc0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 -- 172.21.15.39:0/1743228663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0103bb0 msgr2=0x7f1dc0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0103bb0 0x7f1dc0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 -- 172.21.15.39:0/1743228663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 msgr2=0x7f1dc0199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 0x7f1dc0199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 -- 172.21.15.39:0/1743228663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc019f3e0 con 0x7f1dc010d160 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbf7fe640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 0x7f1dc0199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc4e64640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1db800cce0 tx=0x7f1db800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db800f450 con 0x7f1dc010d160 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc019f6d0 con 0x7f1dc010d160 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db800faa0 con 0x7f1dc010d160 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.136+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8018b70 con 0x7f1dc010d160 2024-09-10T21:57:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.137+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc01a5d90 con 0x7f1dc010d160 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.137+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc0103f90 con 0x7f1dc010d160 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.139+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1db800f5f0 con 0x7f1dc010d160 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.140+0000 7f1dbd7fa640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 0x7f1da80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.140+0000 7f1dbffff640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 0x7f1da80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.140+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1db80e62d0 con 0x7f1dc010d160 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.140+0000 7f1dbffff640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 0x7f1da80b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009bd0 tx=0x7f1db0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.143+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1db8014030 con 0x7f1dc010d160 2024-09-10T21:57:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.297+0000 7f4094ff9640 1 -- 172.21.15.39:0/13977896 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b58130a0f0 con 0x55b58141cbe0 2024-09-10T21:57:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.297+0000 7f4094ff9640 10 client.15864 handle_command_reply: tid=0 2024-09-10T21:57:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.297+0000 7f40b6215740 1 client.15864 shutdown 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 msgr2=0x55b5813a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f40a4003f50 tx=0x7f40a4004ab0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 shutdown_connections 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b58141cbe0 0x55b58141f000 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b58139fbd0 0x55b5813a9fb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b58139d190 0x55b5813a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 --2- 172.21.15.39:0/13977896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b58139a860 0x55b5813a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 >> 172.21.15.39:0/13977896 conn(0x55b5813959b0 msgr2=0x55b5813a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f4094ff9640 0 client.15864 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 shutdown_connections 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 1 -- 172.21.15.39:0/13977896 wait complete. 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.298+0000 7f40b6215740 20 client.15864 trim_cache size 0 max 16384 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:57:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:57:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.299+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 msgr2=0x7f40980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.299+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 0x7f40980b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f40a4011890 tx=0x7f40a4009500 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.299+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 msgr2=0x7f40ac06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.299+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9f0 tx=0x7f40a800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 shutdown_connections 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f40980b52e0 0x7f40980b77a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40ac1033c0 0x7f40ac1a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40ac102a00 0x7f40ac19ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 --2- 172.21.15.39:0/367829840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ac1018b0 0x7f40ac06bc20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 >> 172.21.15.39:0/367829840 conn(0x7f40ac0fd150 msgr2=0x7f40ac105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 shutdown_connections 2024-09-10T21:57:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:01.300+0000 7f40b336b640 1 -- 172.21.15.39:0/367829840 wait complete. 2024-09-10T21:57:01.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.373+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dc0108200 con 0x7f1dc010d160 2024-09-10T21:57:01.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.374+0000 7f1dbd7fa640 1 -- 172.21.15.39:0/1743228663 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11980 (secure 0 0 0) 0x7f1db80ad230 con 0x7f1dc010d160 2024-09-10T21:57:01.375 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:57:01.376 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"btime":"2024-09-10T21:56:56:565338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:56:55.941400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-09-10T21:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 msgr2=0x7f1da80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 0x7f1da80b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009bd0 tx=0x7f1db0005f90 comp rx=0 tx=0).stop 2024-09-10T21:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 msgr2=0x7f1dc019ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1db800cce0 tx=0x7f1db800a620 comp rx=0 tx=0).stop 2024-09-10T21:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 shutdown_connections 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1da80b52e0 0x7f1da80b77a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc010d160 0x7f1dc019ec10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc01045b0 0x7f1dc0199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 --2- 172.21.15.39:0/1743228663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0103bb0 0x7f1dc0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 >> 172.21.15.39:0/1743228663 conn(0x7f1dc00fd700 msgr2=0x7f1dc00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 shutdown_connections 2024-09-10T21:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:01.376+0000 7f1dc68c7640 1 -- 172.21.15.39:0/1743228663 wait complete. 2024-09-10T21:57:01.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:01 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1743228663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:01.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:01 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1743228663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:01.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:01 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1743228663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:02.214 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:57:02.502 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:02.608 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:02 smithi039 ceph-mon[30872]: pgmap v402: 97 pgs: 97 active+clean; 134 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 207 op/s 2024-09-10T21:57:02.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:02 smithi070 ceph-mon[34909]: pgmap v402: 97 pgs: 97 active+clean; 134 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 207 op/s 2024-09-10T21:57:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:02 smithi173 ceph-mon[35294]: pgmap v402: 97 pgs: 97 active+clean; 134 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 207 op/s 2024-09-10T21:57:04.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:03.998+0000 7fb58e067640 1 -- 172.21.15.39:0/3860237645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58811c0a0 msgr2=0x7fb58811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:03.998+0000 7fb58e067640 1 --2- 172.21.15.39:0/3860237645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58811c0a0 0x7fb58811e490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb58001ad10 tx=0x7fb58003b990 comp rx=0 tx=0).stop 2024-09-10T21:57:04.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.004+0000 7fb58e067640 1 -- 172.21.15.39:0/3860237645 shutdown_connections 2024-09-10T21:57:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.004+0000 7fb58e067640 1 --2- 172.21.15.39:0/3860237645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58811c0a0 0x7fb58811e490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.004+0000 7fb58e067640 1 --2- 172.21.15.39:0/3860237645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb58810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.004+0000 7fb58e067640 1 --2- 172.21.15.39:0/3860237645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58810a150 0x7fb5881111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.004+0000 7fb58e067640 1 -- 172.21.15.39:0/3860237645 >> 172.21.15.39:0/3860237645 conn(0x7fb58806cb40 msgr2=0x7fb58806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.011+0000 7fb58e067640 1 -- 172.21.15.39:0/3860237645 shutdown_connections 2024-09-10T21:57:04.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.012+0000 7fb58e067640 1 -- 172.21.15.39:0/3860237645 wait complete. 2024-09-10T21:57:04.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.014+0000 7fb58e067640 1 Processor -- start 2024-09-10T21:57:04.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.019+0000 7fb58e067640 1 -- start start 2024-09-10T21:57:04.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.020+0000 7fb58e067640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58810a150 0x7fb58811b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.020+0000 7fb58e067640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.020+0000 7fb58e067640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58811c0a0 0x7fb588117df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.021+0000 7fb586ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.021+0000 7fb586ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60534/0 (socket says 172.21.15.39:60534) 2024-09-10T21:57:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.021+0000 7fb586ffd640 1 -- 172.21.15.39:0/403646941 learned_addr learned my addr 172.21.15.39:0/403646941 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:04.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.021+0000 7fb587fff640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58811c0a0 0x7fb588117df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.021+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881141c0 con 0x7fb58811c0a0 2024-09-10T21:57:04.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.022+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb588114040 con 0x7fb58810a530 2024-09-10T21:57:04.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.022+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb588114340 con 0x7fb58810a150 2024-09-10T21:57:04.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 -- 172.21.15.39:0/403646941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58810a150 msgr2=0x7fb58811b670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:57:04.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58810a150 0x7fb58811b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 -- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58811c0a0 msgr2=0x7fb588117df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58811c0a0 0x7fb588117df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb588118460 con 0x7fb58810a530 2024-09-10T21:57:04.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.023+0000 7fb586ffd640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb57000b3c0 tx=0x7fb57000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.030+0000 7fb584ff9640 1 -- 172.21.15.39:0/403646941 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570011830 con 0x7fb58810a530 2024-09-10T21:57:04.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.030+0000 7fb584ff9640 1 -- 172.21.15.39:0/403646941 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb570016070 con 0x7fb58810a530 2024-09-10T21:57:04.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.030+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5881abf10 con 0x7fb58810a530 2024-09-10T21:57:04.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.030+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5881ac2b0 con 0x7fb58810a530 2024-09-10T21:57:04.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.033+0000 7fb584ff9640 1 -- 172.21.15.39:0/403646941 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570010d90 con 0x7fb58810a530 2024-09-10T21:57:04.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.041+0000 7fb59043c740 1 Processor -- start 2024-09-10T21:57:04.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.043+0000 7fb59043c740 1 -- start start 2024-09-10T21:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c06a34dea0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c06a33d2d0 con 0x55c06a3d72d0 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.044+0000 7fb59043c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c06a3410e0 con 0x55c06a3e3b80 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.046+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.047+0000 7fb584ff9640 1 -- 172.21.15.39:0/403646941 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb57001b4a0 con 0x7fb58810a530 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.048+0000 7fb587fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.049+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60050/0 (socket says 172.21.15.39:60050) 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.049+0000 7fb5877fe640 1 -- 172.21.15.39:0/4155372406 learned_addr learned my addr 172.21.15.39:0/4155372406 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.049+0000 7fb5877fe640 1 -- 172.21.15.39:0/4155372406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 msgr2=0x55c06a3e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.051+0000 7fb586ffd640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.059+0000 7fb5877fe640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.059+0000 7fb5877fe640 1 -- 172.21.15.39:0/4155372406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 msgr2=0x55c06a3d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.059+0000 7fb5877fe640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.059+0000 7fb5877fe640 1 -- 172.21.15.39:0/4155372406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06a09b650 con 0x55c06a3d7bf0 2024-09-10T21:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.059+0000 7fb5877fe640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb578009770 tx=0x7fb578009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dce35f6236f7a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.060+0000 7fb584ff9640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 0x7fb5740b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.060+0000 7fb57dffb640 1 -- 172.21.15.39:0/4155372406 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578015020 con 0x55c06a3d7bf0 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.060+0000 7fb57dffb640 1 -- 172.21.15.39:0/4155372406 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb578011420 con 0x55c06a3d7bf0 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.060+0000 7fb57dffb640 1 -- 172.21.15.39:0/4155372406 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780105c0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.061+0000 7fb584ff9640 1 -- 172.21.15.39:0/403646941 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb5700e5250 con 0x7fb58810a530 2024-09-10T21:57:04.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.061+0000 7fb586ffd640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.062+0000 7fb59043c740 1 -- 172.21.15.39:0/4155372406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 msgr2=0x55c06a3e3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.062+0000 7fb59043c740 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb578009770 tx=0x7fb578009c30 comp rx=0 tx=0).stop 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb587fff640 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb59043c740 1 -- 172.21.15.39:0/4155372406 shutdown_connections 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb59043c740 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb59043c740 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e3640 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb59043c740 1 --2- 172.21.15.39:0/4155372406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb59043c740 1 -- 172.21.15.39:0/4155372406 >> 172.21.15.39:0/4155372406 conn(0x55c06a3d5100 msgr2=0x55c06a3d62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.063+0000 7fb587fff640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 0x7fb5740b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.064+0000 7fb59043c740 1 -- 172.21.15.39:0/4155372406 shutdown_connections 2024-09-10T21:57:04.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.064+0000 7fb59043c740 1 -- 172.21.15.39:0/4155372406 wait complete. 2024-09-10T21:57:04.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.064+0000 7fb587fff640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 0x7fb5740b7a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb58001aa70 tx=0x7fb58001a9e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.065+0000 7fb59043c740 1 -- start start 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.065+0000 7fb59043c740 1 Processor -- start 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60054/0 (socket says 172.21.15.39:60054) 2024-09-10T21:57:04.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb5877fe640 1 -- 172.21.15.39:0/1307208853 learned_addr learned my addr 172.21.15.39:0/1307208853 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c06a19e700 con 0x55c06a3d72d0 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c06a2d8160 con 0x55c06a3d7bf0 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.067+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c06a3e6800 con 0x55c06a3e3b80 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb59043c740 10 client.0 _ll_register_callbacks cb 0x55c06a2f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb587fff640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb586ffd640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb586ffd640 1 -- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 msgr2=0x55c06a3e0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb586ffd640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb586ffd640 1 -- 172.21.15.39:0/1307208853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 msgr2=0x55c06a3e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.068+0000 7fb586ffd640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.069+0000 7fb586ffd640 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06a305c90 con 0x55c06a3d7bf0 2024-09-10T21:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.070+0000 7fb586ffd640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb57000bd80 tx=0x7fb5700ab8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be581cf31c4bc953 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.070+0000 7fb5877fe640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.070+0000 7fb566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:04.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.074+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b0020 con 0x55c06a3d7bf0 2024-09-10T21:57:04.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.074+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb578011420 con 0x55c06a3d7bf0 2024-09-10T21:57:04.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.074+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb570010630 con 0x55c06a3d7bf0 2024-09-10T21:57:04.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.077+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb5700ac0c0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.077+0000 7fb59043c740 10 client.25493 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:04.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.077+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c06a3f1fb0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.082+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb578011420 con 0x55c06a3d7bf0 2024-09-10T21:57:04.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.082+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb57001b7c0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 10 client.25493 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 10 client.25493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:57:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 20 client.25493 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a3f33c0 0x55c06a3f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 4 client.25493 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c06a34fdf0 con 0x55c06a3f33c0 2024-09-10T21:57:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.086+0000 7fb5877fe640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a3f33c0 0x55c06a3f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.091+0000 7fb566ffd640 10 client.25493 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:04.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.091+0000 7fb5877fe640 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a3f33c0 0x55c06a3f5810 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a631b1e5787d5a1 server_cookie=191e131a26787094 in_seq=0 out_seq=0 2024-09-10T21:57:04.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.095+0000 7fb566ffd640 1 -- 172.21.15.39:0/1307208853 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c06a34fdf0 con 0x55c06a3f33c0 2024-09-10T21:57:04.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.095+0000 7fb566ffd640 10 client.25493 handle_command_reply: tid=0 2024-09-10T21:57:04.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.095+0000 7fb59043c740 1 client.25493 shutdown 2024-09-10T21:57:04.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.096+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 msgr2=0x55c06a3e0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.096+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb57000bd80 tx=0x7fb5700ab8c0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 shutdown_connections 2024-09-10T21:57:04.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a3f33c0 0x55c06a3f5810 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 --2- 172.21.15.39:0/1307208853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 >> 172.21.15.39:0/1307208853 conn(0x55c06a3d5100 msgr2=0x55c06a3dac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.099+0000 7fb566ffd640 0 client.25493 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:04.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.100+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 shutdown_connections 2024-09-10T21:57:04.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.100+0000 7fb59043c740 1 -- 172.21.15.39:0/1307208853 wait complete. 2024-09-10T21:57:04.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.100+0000 7fb59043c740 20 client.25493 trim_cache size 0 max 16384 2024-09-10T21:57:04.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.136+0000 7fb59043c740 1 Processor -- start 2024-09-10T21:57:04.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.140+0000 7fb59043c740 1 -- start start 2024-09-10T21:57:04.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.140+0000 7fb59043c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.140+0000 7fb59043c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.142+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.142+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60564/0 (socket says 172.21.15.39:60564) 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb5877fe640 1 -- 172.21.15.39:0/602259344 learned_addr learned my addr 172.21.15.39:0/602259344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb59043c740 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb56800e540 con 0x55c06a3d7bf0 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb568010140 con 0x55c06a3d72d0 2024-09-10T21:57:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb56800ec10 con 0x55c06a3e3b80 2024-09-10T21:57:04.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.143+0000 7fb586ffd640 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb587fff640 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 -- 172.21.15.39:0/602259344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 msgr2=0x55c06a3e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 -- 172.21.15.39:0/602259344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 msgr2=0x55c06a3d4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 -- 172.21.15.39:0/602259344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06a3e1a10 con 0x55c06a3d7bf0 2024-09-10T21:57:04.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.144+0000 7fb586ffd640 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5700a7f90 tx=0x7fb570009150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fbdc282677cd71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.145+0000 7fb57d7fa640 1 -- 172.21.15.39:0/602259344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b0040 con 0x55c06a3d7bf0 2024-09-10T21:57:04.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.145+0000 7fb57d7fa640 1 -- 172.21.15.39:0/602259344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5700c6070 con 0x55c06a3d7bf0 2024-09-10T21:57:04.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.145+0000 7fb57d7fa640 1 -- 172.21.15.39:0/602259344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700ab9c0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 msgr2=0x55c06a3e0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5700a7f90 tx=0x7fb570009150 comp rx=0 tx=0).stop 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 shutdown_connections 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d7bf0 0x55c06a3e0710 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 --2- 172.21.15.39:0/602259344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d72d0 0x55c06a3d4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.157+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 >> 172.21.15.39:0/602259344 conn(0x55c06a3d5100 msgr2=0x55c06a3defc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.164+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 shutdown_connections 2024-09-10T21:57:04.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.167+0000 7fb59043c740 1 -- 172.21.15.39:0/602259344 wait complete. 2024-09-10T21:57:04.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.167+0000 7fb59043c740 1 -- start start 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.167+0000 7fb59043c740 1 Processor -- start 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.168+0000 7fb59043c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb59043c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb59043c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb586ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb586ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60580/0 (socket says 172.21.15.39:60580) 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb586ffd640 1 -- 172.21.15.39:0/2484378111 learned_addr learned my addr 172.21.15.39:0/2484378111 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb56800f9b0 con 0x55c06a3d72d0 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb587fff640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb5877fe640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.169+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb56800f2e0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb56800c520 con 0x55c06a3e3b80 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 -- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 msgr2=0x55c06a3e8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 -- 172.21.15.39:0/2484378111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 msgr2=0x55c06a3ebd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3ebd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06a3e9160 con 0x55c06a3d7bf0 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.170+0000 7fb586ffd640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb57001bc70 tx=0x7fb5700ab3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c78fef33d705dc93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb566ffd640 1 -- 172.21.15.39:0/2484378111 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b0240 con 0x55c06a3d7bf0 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb566ffd640 1 -- 172.21.15.39:0/2484378111 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb570010630 con 0x55c06a3d7bf0 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb566ffd640 10 client.0 inactive, discarding osd_map(73..73 src has 1..73) 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb59043c740 10 client.0 _ll_register_callbacks cb 0x7fb570010f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.171+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5700c6070 con 0x55c06a3d7bf0 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.172+0000 7fb566ffd640 1 -- 172.21.15.39:0/2484378111 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb5700b04a0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.172+0000 7fb59043c740 10 client.25499 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:04.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.172+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c06a4609e0 con 0x55c06a3d7bf0 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb566ffd640 1 -- 172.21.15.39:0/2484378111 <== mon.2 v2:172.21.15.70:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb5700b9050 con 0x55c06a3d7bf0 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 10 client.25499 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 10 client.25499 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 20 client.25499 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a460e70 0x55c06a463290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 4 client.25499 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.182+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb5700c6070 con 0x55c06a460e70 2024-09-10T21:57:04.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.183+0000 7fb5877fe640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a460e70 0x55c06a463290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:04.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.197+0000 7fb5877fe640 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a460e70 0x55c06a463290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cc35ca428e10226 server_cookie=9a9bef1cfc715f84 in_seq=0 out_seq=0 2024-09-10T21:57:04.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.197+0000 7fb566ffd640 10 client.25499 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:04.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.200+0000 7fb566ffd640 1 -- 172.21.15.39:0/2484378111 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb5700c6070 con 0x55c06a460e70 2024-09-10T21:57:04.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.200+0000 7fb566ffd640 10 client.25499 handle_command_reply: tid=0 2024-09-10T21:57:04.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.200+0000 7fb59043c740 1 client.25499 shutdown 2024-09-10T21:57:04.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 msgr2=0x55c06a3ec240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb57001bc70 tx=0x7fb5700ab3d0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 shutdown_connections 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55c06a460e70 0x55c06a463290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb566ffd640 0 client.25499 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c06a3e3b80 0x55c06a3e8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c06a3d7bf0 0x55c06a3ec240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 --2- 172.21.15.39:0/2484378111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06a3d72d0 0x55c06a3ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.204+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 >> 172.21.15.39:0/2484378111 conn(0x55c06a3d5100 msgr2=0x55c06a3e1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.205+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 shutdown_connections 2024-09-10T21:57:04.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.208+0000 7fb59043c740 1 -- 172.21.15.39:0/2484378111 wait complete. 2024-09-10T21:57:04.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.208+0000 7fb59043c740 20 client.25499 trim_cache size 0 max 16384 2024-09-10T21:57:04.210 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 msgr2=0x7fb5740b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 0x7fb5740b7a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb58001aa70 tx=0x7fb58001a9e0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 msgr2=0x7fb5881178b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb57000b3c0 tx=0x7fb57000b880 comp rx=0 tx=0).stop 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 shutdown_connections 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb5740b55b0 0x7fb5740b7a70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58811c0a0 0x7fb588117df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58810a530 0x7fb5881178b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 --2- 172.21.15.39:0/403646941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58810a150 0x7fb58811b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:04.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.210+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 >> 172.21.15.39:0/403646941 conn(0x7fb58806cb40 msgr2=0x7fb5880716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:04.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.211+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 shutdown_connections 2024-09-10T21:57:04.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:04.211+0000 7fb58e067640 1 -- 172.21.15.39:0/403646941 wait complete. 2024-09-10T21:57:04.838 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:04 smithi039 ceph-mon[30872]: pgmap v403: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 950 op/s 2024-09-10T21:57:04.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:04 smithi070 ceph-mon[34909]: pgmap v403: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 950 op/s 2024-09-10T21:57:04.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:57:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:04 smithi173 ceph-mon[35294]: pgmap v403: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 950 op/s 2024-09-10T21:57:05.986 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:06.500 INFO:tasks.workunit.client.0.smithi039.stdout: 53 763383 468 473846 302 435818 1396 2024-09-10T21:57:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 -- 172.21.15.39:0/1142924098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618109170 msgr2=0x7f061810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 --2- 172.21.15.39:0/1142924098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618109170 0x7f061810f970 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0610009ca0 tx=0x7f061002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 -- 172.21.15.39:0/1142924098 shutdown_connections 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 --2- 172.21.15.39:0/1142924098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618109170 0x7f061810f970 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 --2- 172.21.15.39:0/1142924098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f0618108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 --2- 172.21.15.39:0/1142924098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618102de0 0x7f06181031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 -- 172.21.15.39:0/1142924098 >> 172.21.15.39:0/1142924098 conn(0x7f06180fe870 msgr2=0x7f0618100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 -- 172.21.15.39:0/1142924098 shutdown_connections 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 -- 172.21.15.39:0/1142924098 wait complete. 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.540+0000 7f061f043640 1 Processor -- start 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 -- start start 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 0x7f06180754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f06180759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618109170 0x7f0618075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0618112e40 con 0x7f0618102de0 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0618112cc0 con 0x7f0618109170 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061f043640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0618112fc0 con 0x7f06181087f0 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061cddf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 0x7f06180754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061cddf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 0x7f06180754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60092/0 (socket says 172.21.15.39:60092) 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f06180759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061cddf640 1 -- 172.21.15.39:0/3201658772 learned_addr learned my addr 172.21.15.39:0/3201658772 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f061d5e0640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618109170 0x7f0618075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 -- 172.21.15.39:0/3201658772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618109170 msgr2=0x7f0618075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618109170 0x7f0618075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 -- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 msgr2=0x7f06180754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 0x7f06180754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 -- 172.21.15.39:0/3201658772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06181a7670 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.541+0000 7f0617fff640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f06180759e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f060400e9f0 tx=0x7f060400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.542+0000 7f0615ffb640 1 -- 172.21.15.39:0/3201658772 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060400ccc0 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.542+0000 7f0615ffb640 1 -- 172.21.15.39:0/3201658772 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0604005020 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.542+0000 7f0615ffb640 1 -- 172.21.15.39:0/3201658772 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604004a00 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.542+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06181a7960 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.542+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06181a7e50 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.545+0000 7f0615ffb640 1 -- 172.21.15.39:0/3201658772 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0604004ba0 con 0x7f06181087f0 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.545+0000 7f0621418740 1 Processor -- start 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 -- start start 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f061cddf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f061cddf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60094/0 (socket says 172.21.15.39:60094) 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f061cddf640 1 -- 172.21.15.39:0/978929923 learned_addr learned my addr 172.21.15.39:0/978929923 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d200762ea0 con 0x55d2007ecdf0 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0617fff640 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d2007522d0 con 0x55d2007ec4d0 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2007560e0 con 0x55d2007f8d80 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f0615ffb640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 0x7f06080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.546+0000 7f061d5e0640 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 -- 172.21.15.39:0/978929923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 msgr2=0x55d2007fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 -- 172.21.15.39:0/978929923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 msgr2=0x55d2007ec8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007ec8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 -- 172.21.15.39:0/978929923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2004b0650 con 0x55d2007ecdf0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f0615ffb640 1 -- 172.21.15.39:0/3201658772 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f06040e5b70 con 0x7f06181087f0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061d5e0640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 0x7f06080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f061cddf640 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f060c009dc0 tx=0x7f060c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439bd46148ba52fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f0602ffd640 1 -- 172.21.15.39:0/978929923 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c005220 con 0x55d2007ecdf0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f0602ffd640 1 -- 172.21.15.39:0/978929923 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f060c004c50 con 0x55d2007ecdf0 2024-09-10T21:57:06.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.547+0000 7f0602ffd640 1 -- 172.21.15.39:0/978929923 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0197d0 con 0x55d2007ecdf0 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 msgr2=0x55d2007f8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f061d5e0640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 0x7f06080b77a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0618077560 tx=0x7f0610040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f060c009dc0 tx=0x7f060c011810 comp rx=0 tx=0).stop 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 shutdown_connections 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f8840 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 --2- 172.21.15.39:0/978929923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007ec8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 >> 172.21.15.39:0/978929923 conn(0x55d2007ea300 msgr2=0x55d2007eb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 shutdown_connections 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.548+0000 7f0621418740 1 -- 172.21.15.39:0/978929923 wait complete. 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 -- start start 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 Processor -- start 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007f8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 0x55d2007f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007f8d80 0x55d2007f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d2005b3700 con 0x55d2007f8d80 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d2006ed160 con 0x55d2007ec4d0 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2007fba00 con 0x55d2007ecdf0 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0621418740 10 client.0 _ll_register_callbacks cb 0x55d2007069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f061cddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f061d5e0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007f8d80 0x55d2007f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.549+0000 7f0617fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 0x55d2007f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f061cddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60614/0 (socket says 172.21.15.39:60614) 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f061cddf640 1 -- 172.21.15.39:0/3356765032 learned_addr learned my addr 172.21.15.39:0/3356765032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 -- 172.21.15.39:0/3356765032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 msgr2=0x55d2007f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 -- 172.21.15.39:0/3356765032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007f8d80 msgr2=0x55d2007f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007f8d80 0x55d2007f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 -- 172.21.15.39:0/3356765032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20071ac90 con 0x55d2007ecdf0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0617fff640 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 0x55d2007f5ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06040e36d0 tx=0x7f06040abd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6ae9d7ca949619 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f05f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060401c040 con 0x55d2007ecdf0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f06040d30e0 con 0x55d2007ecdf0 2024-09-10T21:57:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.550+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f060c004c50 con 0x55d2007ecdf0 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f06040d32e0 con 0x55d2007ecdf0 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 10 client.25510 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d200807320 con 0x55d2007ecdf0 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f060c004c50 con 0x55d2007ecdf0 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f06040b5440 con 0x55d2007ecdf0 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 10 client.25510 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 10 client.25510 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 20 client.25510 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200808730 0x55d20080ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 4 client.25510 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d200764df0 con 0x55d200808730 2024-09-10T21:57:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.551+0000 7f061cddf640 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200808730 0x55d20080ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.552+0000 7f05f7fff640 10 client.25510 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.552+0000 7f061cddf640 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200808730 0x55d20080ab40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=58cdef268ce93651 server_cookie=e3dcff74749e310b in_seq=0 out_seq=0 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f05f7fff640 1 -- 172.21.15.39:0/3356765032 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d200764df0 con 0x55d200808730 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f05f7fff640 10 client.25510 handle_command_reply: tid=0 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 client.25510 shutdown 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 msgr2=0x55d2007f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 0x55d2007f5ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06040e36d0 tx=0x7f06040abd50 comp rx=0 tx=0).stop 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 shutdown_connections 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007f8d80 0x55d2007f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ecdf0 0x55d2007f5ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200808730 0x55d20080ab40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 --2- 172.21.15.39:0/3356765032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f05f7fff640 0 client.25510 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:06.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 >> 172.21.15.39:0/3356765032 conn(0x55d2007ea300 msgr2=0x55d2007efea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 shutdown_connections 2024-09-10T21:57:06.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 1 -- 172.21.15.39:0/3356765032 wait complete. 2024-09-10T21:57:06.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.553+0000 7f0621418740 20 client.25510 trim_cache size 0 max 16384 2024-09-10T21:57:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.568+0000 7f0621418740 1 Processor -- start 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 -- start start 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06181b0520 con 0x55d2007ecdf0 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06181b2120 con 0x55d2007ec4d0 2024-09-10T21:57:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0621418740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06181b0bf0 con 0x55d2007f8d80 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60618/0 (socket says 172.21.15.39:60618) 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 -- 172.21.15.39:0/2155534766 learned_addr learned my addr 172.21.15.39:0/2155534766 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f0617fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061d5e0640 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 -- 172.21.15.39:0/2155534766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 msgr2=0x55d2007f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 -- 172.21.15.39:0/2155534766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 msgr2=0x55d2007f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061cddf640 1 -- 172.21.15.39:0/2155534766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2007ead80 con 0x55d2007ec4d0 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.569+0000 7f061d5e0640 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.570+0000 7f061cddf640 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f060c009ce0 tx=0x7f060c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af02264ab03fd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.570+0000 7f06027fc640 1 -- 172.21.15.39:0/2155534766 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c031070 con 0x55d2007ec4d0 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.570+0000 7f06027fc640 1 -- 172.21.15.39:0/2155534766 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f060c0044d0 con 0x55d2007ec4d0 2024-09-10T21:57:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.570+0000 7f06027fc640 1 -- 172.21.15.39:0/2155534766 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c019790 con 0x55d2007ec4d0 2024-09-10T21:57:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- 172.21.15.39:0/2155534766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 msgr2=0x55d2007e9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f060c009ce0 tx=0x7f060c011810 comp rx=0 tx=0).stop 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- 172.21.15.39:0/2155534766 shutdown_connections 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007f8d80 0x55d2007f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 --2- 172.21.15.39:0/2155534766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007ec4d0 0x55d2007e9c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- 172.21.15.39:0/2155534766 >> 172.21.15.39:0/2155534766 conn(0x55d2007ea300 msgr2=0x55d2007f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- 172.21.15.39:0/2155534766 shutdown_connections 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- 172.21.15.39:0/2155534766 wait complete. 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.572+0000 7f0621418740 1 -- start start 2024-09-10T21:57:06.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.573+0000 7f0621418740 1 Processor -- start 2024-09-10T21:57:06.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f061cddf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0617fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007f8d80 0x55d20086e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0617fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60126/0 (socket says 172.21.15.39:60126) 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06181b1990 con 0x55d2007ecdf0 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0617fff640 1 -- 172.21.15.39:0/3838736639 learned_addr learned my addr 172.21.15.39:0/3838736639 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06181b12c0 con 0x55d2007f8d80 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f061cddf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:44402/0 (socket says 172.21.15.39:44402) 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f061d5e0640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007f8d80 0x55d20086e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06181ae500 con 0x55d2007ec4d0 2024-09-10T21:57:06.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.574+0000 7f0621418740 10 client.0 _ll_register_callbacks cb 0x7f06040ac200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 -- 172.21.15.39:0/3838736639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007f8d80 msgr2=0x55d20086e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007f8d80 0x55d20086e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 -- 172.21.15.39:0/3838736639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 msgr2=0x55d2007fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20086ed60 con 0x55d2007ec4d0 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f061cddf640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f060c003f00 tx=0x7f060c009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72c47179b3162f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:06.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f05f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c03b020 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f060c003800 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.575+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f060c0044d0 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f060c031070 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 10 client.25516 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d200876140 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f060c0044d0 con 0x55d2007ec4d0 2024-09-10T21:57:06.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f060c019c30 con 0x55d2007ec4d0 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 10 client.25516 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 10 client.25516 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 20 client.25516 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200876660 0x55d200878a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 4 client.25516 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2007608a0 con 0x55d200876660 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.576+0000 7f0617fff640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200876660 0x55d200878a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f0617fff640 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200876660 0x55d200878a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc37795bcb26fd71 server_cookie=ae5d3faa1e8b252f in_seq=0 out_seq=0 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f05f7fff640 10 client.25516 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f05f7fff640 1 -- 172.21.15.39:0/3838736639 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2007608a0 con 0x55d200876660 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f05f7fff640 10 client.25516 handle_command_reply: tid=0 2024-09-10T21:57:06.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f0621418740 1 client.25516 shutdown 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 msgr2=0x55d2007fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.577+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f060c003f00 tx=0x7f060c009790 comp rx=0 tx=0).stop 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 shutdown_connections 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x55d200876660 0x55d200878a50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2007f8d80 0x55d20086e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d2007ecdf0 0x55d2007fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 --2- 172.21.15.39:0/3838736639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2007ec4d0 0x55d2007fd5b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 >> 172.21.15.39:0/3838736639 conn(0x55d2007ea300 msgr2=0x55d2007f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f05f7fff640 0 client.25516 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 shutdown_connections 2024-09-10T21:57:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 1 -- 172.21.15.39:0/3838736639 wait complete. 2024-09-10T21:57:06.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.578+0000 7f0621418740 20 client.25516 trim_cache size 0 max 16384 2024-09-10T21:57:06.584 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 msgr2=0x7f06080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 0x7f06080b77a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0618077560 tx=0x7f0610040040 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 msgr2=0x7f06180759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f06180759e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f060400e9f0 tx=0x7f060400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 shutdown_connections 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06080b52e0 0x7f06080b77a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0618109170 0x7f0618075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06181087f0 0x7f06180759e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 --2- 172.21.15.39:0/3201658772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0618102de0 0x7f06180754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:06.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 >> 172.21.15.39:0/3201658772 conn(0x7f06180fe870 msgr2=0x7f0618100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:06.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 shutdown_connections 2024-09-10T21:57:06.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:06.579+0000 7f061f043640 1 -- 172.21.15.39:0/3201658772 wait complete. 2024-09-10T21:57:06.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:06 smithi070 ceph-mon[34909]: pgmap v404: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.8 MiB/s wr, 1.04k op/s 2024-09-10T21:57:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:06 smithi039 ceph-mon[30872]: pgmap v404: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.8 MiB/s wr, 1.04k op/s 2024-09-10T21:57:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:06 smithi173 ceph-mon[35294]: pgmap v404: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.8 MiB/s wr, 1.04k op/s 2024-09-10T21:57:07.617 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:57:07.618 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.618 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.618 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:57:07.618 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:57:07.618 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:07 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:57:07.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:07 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:57:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:07 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:57:08.080 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/2786767916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 msgr2=0x7ffa4810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/2786767916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa4810f550 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009ca0 tx=0x7ffa4002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/2786767916 shutdown_connections 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/2786767916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa4810f550 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/2786767916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48104530 0x7ffa4810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/2786767916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48103b30 0x7ffa48103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/2786767916 >> 172.21.15.39:0/2786767916 conn(0x7ffa480fd700 msgr2=0x7ffa480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/2786767916 shutdown_connections 2024-09-10T21:57:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.593+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/2786767916 wait complete. 2024-09-10T21:57:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 Processor -- start 2024-09-10T21:57:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 -- start start 2024-09-10T21:57:08.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 0x7ffa481019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa48102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48112d20 con 0x7ffa4810d0e0 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48112ba0 con 0x7ffa48103b30 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.594+0000 7ffa4d7fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48112ea0 con 0x7ffa48104530 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa48102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 0x7ffa481019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:44418/0 (socket says 172.21.15.39:44418) 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 -- 172.21.15.39:0/3164288769 learned_addr learned my addr 172.21.15.39:0/3164288769 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 -- 172.21.15.39:0/3164288769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 msgr2=0x7ffa481019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 0x7ffa481019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 -- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 msgr2=0x7ffa48102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa48102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 -- 172.21.15.39:0/3164288769 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa481a7690 con 0x7ffa48104530 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 0x7ffa481019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e9f0 tx=0x7ffa3c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa2ffff640 1 -- 172.21.15.39:0/3164288769 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00cd80 con 0x7ffa48104530 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa481a7980 con 0x7ffa48104530 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.595+0000 7ffa2ffff640 1 -- 172.21.15.39:0/3164288769 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c0108e0 con 0x7ffa48104530 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.596+0000 7ffa2ffff640 1 -- 172.21.15.39:0/3164288769 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c018980 con 0x7ffa48104530 2024-09-10T21:57:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.596+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa481a7f10 con 0x7ffa48104530 2024-09-10T21:57:08.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 Processor -- start 2024-09-10T21:57:08.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 -- start start 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa2ffff640 1 -- 172.21.15.39:0/3164288769 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ffa3c010430 con 0x7ffa48104530 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bfa79a0 0x55c56bfa9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c56bf11ea0 con 0x55c56bf9ba10 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c56bf012d0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c56bf050e0 con 0x55c56bfa79a0 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60642/0 (socket says 172.21.15.39:60642) 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa477fe640 1 -- 172.21.15.39:0/1317515900 learned_addr learned my addr 172.21.15.39:0/1317515900 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.599+0000 7ffa467fc640 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bfa79a0 0x55c56bfa9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 -- 172.21.15.39:0/1317515900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bfa79a0 msgr2=0x55c56bfa9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bfa79a0 0x55c56bfa9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 -- 172.21.15.39:0/1317515900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 msgr2=0x55c56bfa7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 -- 172.21.15.39:0/1317515900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c56bc5f650 con 0x55c56bf9b0f0 2024-09-10T21:57:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa477fe640 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa40035000 tx=0x7ffa40005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bd64738728ed8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa2ffff640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 0x7ffa300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa2d7fa640 1 -- 172.21.15.39:0/1317515900 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40031cf0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa2d7fa640 1 -- 172.21.15.39:0/1317515900 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa40036030 con 0x55c56bf9b0f0 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 0x7ffa300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa2d7fa640 1 -- 172.21.15.39:0/1317515900 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400042a0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.600+0000 7ffa2ffff640 1 -- 172.21.15.39:0/3164288769 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ffa3c0e5ea0 con 0x7ffa48104530 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/1317515900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 msgr2=0x55c56bf9b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 0x7ffa300b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c56bf99e00 tx=0x7ffa3800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa40035000 tx=0x7ffa40005fa0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/1317515900 shutdown_connections 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bfa79a0 0x55c56bfa9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/1317515900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bf9b4d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/1317515900 >> 172.21.15.39:0/1317515900 conn(0x55c56bf98f20 msgr2=0x55c56bf9a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/1317515900 shutdown_connections 2024-09-10T21:57:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.601+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/1317515900 wait complete. 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 -- start start 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 Processor -- start 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfa7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56bfa4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c56bd62700 con 0x55c56bf9ba10 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c56be9c160 con 0x55c56bfa79a0 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c56bfaa440 con 0x55c56bf9b0f0 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa4fbd0740 10 client.0 _ll_register_callbacks cb 0x55c56beb59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.602+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60146/0 (socket says 172.21.15.39:60146) 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 -- 172.21.15.39:0/3350583751 learned_addr learned my addr 172.21.15.39:0/3350583751 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfa7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa477fe640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56bfa4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 -- 172.21.15.39:0/3350583751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 msgr2=0x55c56bfa7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfa7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 -- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 msgr2=0x55c56bfa4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56bfa4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 -- 172.21.15.39:0/3350583751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c56bec9c90 con 0x55c56bf9ba10 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0a8c90 tx=0x7ffa3c0e3950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b65e3c0cf03ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0ac490 con 0x55c56bf9ba10 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ffa3c0a8010 con 0x55c56bf9ba10 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa40036030 con 0x55c56bf9ba10 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.603+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffa3c0abe30 con 0x55c56bf9ba10 2024-09-10T21:57:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 10 client.15930 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c56bfb5dc0 con 0x55c56bf9ba10 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa40036030 con 0x55c56bf9ba10 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ffa3c0ab390 con 0x55c56bf9ba10 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 10 client.15930 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 10 client.15930 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 20 client.15930 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56bfb7220 0x55c56bfb9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 4 client.15930 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c56bf13df0 con 0x55c56bfb7220 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.604+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56bfb7220 0x55c56bfb9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.605+0000 7ffa2aff5640 10 client.15930 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.605+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56bfb7220 0x55c56bfb9610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c97a5135d4ed391e server_cookie=5153c9c5e279ff41 in_seq=0 out_seq=0 2024-09-10T21:57:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa2aff5640 1 -- 172.21.15.39:0/3350583751 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c56bf13df0 con 0x55c56bfb7220 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa2aff5640 10 client.15930 handle_command_reply: tid=0 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 client.15930 shutdown 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 msgr2=0x55c56bfa46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0a8c90 tx=0x7ffa3c0e3950 comp rx=0 tx=0).stop 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 shutdown_connections 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56bfb7220 0x55c56bfb9610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56bfa4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfa46a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3350583751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 >> 172.21.15.39:0/3350583751 conn(0x55c56bf98f20 msgr2=0x55c56bf9eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa2aff5640 0 client.15930 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 shutdown_connections 2024-09-10T21:57:08.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3350583751 wait complete. 2024-09-10T21:57:08.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.606+0000 7ffa4fbd0740 20 client.15930 trim_cache size 0 max 16384 2024-09-10T21:57:08.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.620+0000 7ffa4fbd0740 1 Processor -- start 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.620+0000 7ffa4fbd0740 1 -- start start 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bfb36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 0x55c56bfa18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481b0540 con 0x55c56bfa79a0 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481b2140 con 0x55c56bf9b0f0 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481b0c10 con 0x55c56bf9ba10 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 0x55c56bfa18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bfb36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 0x55c56bfa18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60154/0 (socket says 172.21.15.39:60154) 2024-09-10T21:57:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bfb36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:60654/0 (socket says 172.21.15.39:60654) 2024-09-10T21:57:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa477fe640 1 -- 172.21.15.39:0/3588349416 learned_addr learned my addr 172.21.15.39:0/3588349416 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:44444/0 (socket says 172.21.15.39:44444) 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 -- 172.21.15.39:0/3588349416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 msgr2=0x55c56bfb36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bfb36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 -- 172.21.15.39:0/3588349416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 msgr2=0x55c56bfa18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 0x55c56bfa18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 -- 172.21.15.39:0/3588349416 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c56bfa5530 con 0x55c56bf9ba10 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.621+0000 7ffa467fc640 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0097b0 tx=0x7ffa3c0ab870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d472953a0f1e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.622+0000 7ffa2cff9640 1 -- 172.21.15.39:0/3588349416 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0ac010 con 0x55c56bf9ba10 2024-09-10T21:57:08.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.622+0000 7ffa2cff9640 1 -- 172.21.15.39:0/3588349416 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c0b10f0 con 0x55c56bf9ba10 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.622+0000 7ffa2cff9640 1 -- 172.21.15.39:0/3588349416 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0a8270 con 0x55c56bf9ba10 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3588349416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 msgr2=0x55c56bfa63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0097b0 tx=0x7ffa3c0ab870 comp rx=0 tx=0).stop 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3588349416 shutdown_connections 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bfa79a0 0x55c56bfa18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9ba10 0x55c56bfa63e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/3588349416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bf9b0f0 0x55c56bfb36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3588349416 >> 172.21.15.39:0/3588349416 conn(0x55c56bf98f20 msgr2=0x55c56bfa5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3588349416 shutdown_connections 2024-09-10T21:57:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/3588349416 wait complete. 2024-09-10T21:57:08.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 -- start start 2024-09-10T21:57:08.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 Processor -- start 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.623+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa4fbd0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56c0230e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481b19b0 con 0x55c56bf9ba10 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481b12e0 con 0x55c56bfa79a0 2024-09-10T21:57:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa4fbd0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481ae520 con 0x55c56bf9b0f0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:44458/0 (socket says 172.21.15.39:44458) 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 -- 172.21.15.39:0/2343779528 learned_addr learned my addr 172.21.15.39:0/2343779528 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa477fe640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56c0230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa4fbd0740 10 client.0 _ll_register_callbacks cb 0x7ffa3c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 -- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 msgr2=0x55c56c0230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56c0230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 -- 172.21.15.39:0/2343779528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 msgr2=0x55c56bfac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 -- 172.21.15.39:0/2343779528 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c56c0236c0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa467fc640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa46ffd640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa38011550 tx=0x7ffa380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5176fb0b709b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.624+0000 7ffa2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38004020 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa3c0b10f0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7ffa38017030 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffa380041c0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 10 client.25534 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c56c024a50 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c0b10f0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ffa3801e4e0 con 0x55c56bf9b0f0 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 10 client.25534 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 10 client.25534 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 20 client.25534 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56c0251a0 0x55c56c0275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 4 client.25534 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c56bf0f8a0 con 0x55c56c0251a0 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.625+0000 7ffa467fc640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56c0251a0 0x55c56c0275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa467fc640 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56c0251a0 0x55c56c0275c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=856734f5dff143d8 server_cookie=3703f579edc31eff in_seq=0 out_seq=0 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa2aff5640 10 client.25534 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa2aff5640 1 -- 172.21.15.39:0/2343779528 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c56bf0f8a0 con 0x55c56c0251a0 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa2aff5640 10 client.25534 handle_command_reply: tid=0 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 client.25534 shutdown 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 msgr2=0x55c56bfabdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa38011550 tx=0x7ffa380046c0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 shutdown_connections 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55c56c0251a0 0x55c56c0275c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c56bfa79a0 0x55c56c0230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c56bf9ba10 0x55c56bfac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa2aff5640 0 client.25534 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 --2- 172.21.15.39:0/2343779528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c56bf9b0f0 0x55c56bfabdd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 >> 172.21.15.39:0/2343779528 conn(0x55c56bf98f20 msgr2=0x55c56bfa64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 shutdown_connections 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.626+0000 7ffa4fbd0740 1 -- 172.21.15.39:0/2343779528 wait complete. 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4fbd0740 20 client.25534 trim_cache size 0 max 16384 2024-09-10T21:57:08.633 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 msgr2=0x7ffa300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 0x7ffa300b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c56bf99e00 tx=0x7ffa3800b390 comp rx=0 tx=0).stop 2024-09-10T21:57:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 msgr2=0x7ffa48101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e9f0 tx=0x7ffa3c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 shutdown_connections 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7ffa300b5360 0x7ffa300b7820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4810d0e0 0x7ffa48102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa48104530 0x7ffa48101ef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 --2- 172.21.15.39:0/3164288769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa48103b30 0x7ffa481019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 >> 172.21.15.39:0/3164288769 conn(0x7ffa480fd700 msgr2=0x7ffa480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.627+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 shutdown_connections 2024-09-10T21:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:08.628+0000 7ffa4d7fb640 1 -- 172.21.15.39:0/3164288769 wait complete. 2024-09-10T21:57:09.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:09 smithi039 ceph-mon[30872]: pgmap v405: 97 pgs: 97 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 1.05k op/s 2024-09-10T21:57:09.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:09 smithi070 ceph-mon[34909]: pgmap v405: 97 pgs: 97 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 1.05k op/s 2024-09-10T21:57:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:09 smithi173 ceph-mon[35294]: pgmap v405: 97 pgs: 97 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 1.05k op/s 2024-09-10T21:57:09.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:57:10.038 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 -- 172.21.15.39:0/1269953664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 msgr2=0x7f1c54111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1269953664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c54111830 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009ca0 tx=0x7f1c4c02a950 comp rx=0 tx=0).stop 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 -- 172.21.15.39:0/1269953664 shutdown_connections 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1269953664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c54111830 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1269953664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c541021b0 0x7f1c5410ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1269953664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c54101890 0x7f1c54101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.776+0000 7f1c5b140640 1 -- 172.21.15.39:0/1269953664 >> 172.21.15.39:0/1269953664 conn(0x7f1c540fd700 msgr2=0x7f1c540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.777+0000 7f1c5b140640 1 -- 172.21.15.39:0/1269953664 shutdown_connections 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.777+0000 7f1c5b140640 1 -- 172.21.15.39:0/1269953664 wait complete. 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.777+0000 7f1c5b140640 1 Processor -- start 2024-09-10T21:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.777+0000 7f1c5b140640 1 -- start start 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.777+0000 7f1c5b140640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c5b140640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c541021b0 0x7f1c5419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c5b140640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c541a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c5b140640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54114f40 con 0x7f1c5410f440 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c5b140640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54114dc0 con 0x7f1c54101890 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c5b140640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541150c0 con 0x7f1c541021b0 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37210/0 (socket says 172.21.15.39:37210) 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 -- 172.21.15.39:0/1988249970 learned_addr learned my addr 172.21.15.39:0/1988249970 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c541a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c53fff640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c541021b0 0x7f1c5419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 -- 172.21.15.39:0/1988249970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c541021b0 msgr2=0x7f1c5419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c541021b0 0x7f1c5419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 -- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 msgr2=0x7f1c541a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c541a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.778+0000 7f1c58edc640 1 -- 172.21.15.39:0/1988249970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c541a15a0 con 0x7f1c54101890 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c58edc640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800e9f0 tx=0x7f1c4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c51ffb640 1 -- 172.21.15.39:0/1988249970 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800cd80 con 0x7f1c54101890 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c51ffb640 1 -- 172.21.15.39:0/1988249970 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c480108e0 con 0x7f1c54101890 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c51ffb640 1 -- 172.21.15.39:0/1988249970 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48018980 con 0x7f1c54101890 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c541a1890 con 0x7f1c54101890 2024-09-10T21:57:10.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.779+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c541a7f50 con 0x7f1c54101890 2024-09-10T21:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.782+0000 7f1c51ffb640 1 -- 172.21.15.39:0/1988249970 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1c48010430 con 0x7f1c54101890 2024-09-10T21:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.782+0000 7f1c5d515740 1 Processor -- start 2024-09-10T21:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.782+0000 7f1c5d515740 1 -- start start 2024-09-10T21:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d0554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d061460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0619a0 0x558c8d063d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c8cfcbea0 con 0x558c8d0619a0 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c8cfbb2d0 con 0x558c8d055a10 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c5d515740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c8cfbf0e0 con 0x558c8d0550f0 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c596dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d0554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c596dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d0554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45200/0 (socket says 172.21.15.39:45200) 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c596dd640 1 -- 172.21.15.39:0/2697249144 learned_addr learned my addr 172.21.15.39:0/2697249144 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d061460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c53fff640 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0619a0 0x558c8d063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 -- 172.21.15.39:0/2697249144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 msgr2=0x558c8d0554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d0554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 -- 172.21.15.39:0/2697249144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0619a0 msgr2=0x558c8d063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0619a0 0x558c8d063d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.783+0000 7f1c58edc640 1 -- 172.21.15.39:0/2697249144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c8cd19650 con 0x558c8d055a10 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c51ffb640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 0x7f1c440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d061460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c480e3960 tx=0x7f1c480ee570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e584719522268b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 0x7f1c440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c3effd640 1 -- 172.21.15.39:0/2697249144 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480a8d80 con 0x558c8d055a10 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c3effd640 1 -- 172.21.15.39:0/2697249144 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c480ac240 con 0x558c8d055a10 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c3effd640 1 -- 172.21.15.39:0/2697249144 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48072220 con 0x558c8d055a10 2024-09-10T21:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.784+0000 7f1c51ffb640 1 -- 172.21.15.39:0/1988249970 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1c480e5f10 con 0x7f1c54101890 2024-09-10T21:57:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 -- 172.21.15.39:0/2697249144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 msgr2=0x558c8d061460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 0x7f1c440b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009ca0 tx=0x7f1c4c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d061460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c480e3960 tx=0x7f1c480ee570 comp rx=0 tx=0).stop 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 -- 172.21.15.39:0/2697249144 shutdown_connections 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0619a0 0x558c8d063d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d061460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2697249144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d0554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 -- 172.21.15.39:0/2697249144 >> 172.21.15.39:0/2697249144 conn(0x558c8d052f20 msgr2=0x558c8d0540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 -- 172.21.15.39:0/2697249144 shutdown_connections 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.785+0000 7f1c5d515740 1 -- 172.21.15.39:0/2697249144 wait complete. 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.786+0000 7f1c5d515740 1 -- start start 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.786+0000 7f1c5d515740 1 Processor -- start 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0550f0 0x558c8d061240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c8ce1c700 con 0x558c8d055a10 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c8cf56160 con 0x558c8d0550f0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c8d064620 con 0x558c8d0619a0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c5d515740 10 client.0 _ll_register_callbacks cb 0x558c8cf6f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45212/0 (socket says 172.21.15.39:45212) 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 -- 172.21.15.39:0/2058933536 learned_addr learned my addr 172.21.15.39:0/2058933536 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0550f0 0x558c8d061240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c53fff640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 -- 172.21.15.39:0/2058933536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0550f0 msgr2=0x558c8d061240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0550f0 0x558c8d061240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 -- 172.21.15.39:0/2058933536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 msgr2=0x558c8d05e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c596dd640 1 -- 172.21.15.39:0/2058933536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c8cf83c90 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.787+0000 7f1c53fff640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c596dd640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005e30 tx=0x7f1c4c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c6660d8995bfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c33fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c034040 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1c4c004450 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c480ac240 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c004650 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c5d515740 10 client.25546 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.788+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558c8d06ff40 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c480ac240 con 0x558c8d0619a0 2024-09-10T21:57:10.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1c4c030440 con 0x558c8d0619a0 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 10 client.25546 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 10 client.25546 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 20 client.25546 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 4 client.25546 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c8cfcddf0 con 0x558c8d071460 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.789+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.790+0000 7f1c33fff640 10 client.25546 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.790+0000 7f1c58edc640 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d073870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9a5ee6e92fc430f server_cookie=45f42db5abfa6551 in_seq=0 out_seq=0 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.790+0000 7f1c33fff640 1 -- 172.21.15.39:0/2058933536 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c8cfcddf0 con 0x558c8d071460 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.790+0000 7f1c33fff640 10 client.25546 handle_command_reply: tid=0 2024-09-10T21:57:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.790+0000 7f1c5d515740 1 client.25546 shutdown 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 msgr2=0x558c8d05ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c005e30 tx=0x7f1c4c0095c0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 shutdown_connections 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d073870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c33fff640 0 client.25546 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d05ec50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 --2- 172.21.15.39:0/2058933536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0550f0 0x558c8d061240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 >> 172.21.15.39:0/2058933536 conn(0x558c8d052f20 msgr2=0x558c8d058a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 shutdown_connections 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 1 -- 172.21.15.39:0/2058933536 wait complete. 2024-09-10T21:57:10.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.791+0000 7f1c5d515740 20 client.25546 trim_cache size 0 max 16384 2024-09-10T21:57:10.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 Processor -- start 2024-09-10T21:57:10.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 -- start start 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0619a0 0x558c8d05d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541ac210 con 0x558c8d055a10 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541ade10 con 0x558c8d0619a0 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c5d515740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541ac8e0 con 0x558c8d0550f0 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45228/0 (socket says 172.21.15.39:45228) 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c58edc640 1 -- 172.21.15.39:0/3394362226 learned_addr learned my addr 172.21.15.39:0/3394362226 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54978/0 (socket says 172.21.15.39:54978) 2024-09-10T21:57:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.808+0000 7f1c596dd640 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0619a0 0x558c8d05d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 -- 172.21.15.39:0/3394362226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0619a0 msgr2=0x558c8d05d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0619a0 0x558c8d05d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 -- 172.21.15.39:0/3394362226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 msgr2=0x558c8d05cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 -- 172.21.15.39:0/3394362226 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c8d059400 con 0x558c8d0550f0 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c53fff640 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c58edc640 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c480a8d00 tx=0x7f1c480e9950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0507b22c65f616 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c3e7fc640 1 -- 172.21.15.39:0/3394362226 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48072220 con 0x558c8d0550f0 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c3e7fc640 1 -- 172.21.15.39:0/3394362226 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c480e9720 con 0x558c8d0550f0 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.809+0000 7f1c3e7fc640 1 -- 172.21.15.39:0/3394362226 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48072450 con 0x558c8d0550f0 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 -- 172.21.15.39:0/3394362226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 msgr2=0x558c8d06d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c480a8d00 tx=0x7f1c480e9950 comp rx=0 tx=0).stop 2024-09-10T21:57:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 -- 172.21.15.39:0/3394362226 shutdown_connections 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d0619a0 0x558c8d05d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d055a10 0x558c8d05cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 --2- 172.21.15.39:0/3394362226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0550f0 0x558c8d06d880 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 -- 172.21.15.39:0/3394362226 >> 172.21.15.39:0/3394362226 conn(0x558c8d052f20 msgr2=0x558c8d059910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 -- 172.21.15.39:0/3394362226 shutdown_connections 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.810+0000 7f1c5d515740 1 -- 172.21.15.39:0/3394362226 wait complete. 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 -- start start 2024-09-10T21:57:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 Processor -- start 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 0x558c8d065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d066230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d0dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541ad680 con 0x558c8d0550f0 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541acfb0 con 0x558c8d055a10 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541aa210 con 0x558c8d0619a0 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.811+0000 7f1c5d515740 10 client.0 _ll_register_callbacks cb 0x7f1c4c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 0x558c8d065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d0dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c58edc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 0x558c8d065cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54986/0 (socket says 172.21.15.39:54986) 2024-09-10T21:57:10.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c58edc640 1 -- 172.21.15.39:0/1998733117 learned_addr learned my addr 172.21.15.39:0/1998733117 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 -- 172.21.15.39:0/1998733117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 msgr2=0x558c8d066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d066230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 -- 172.21.15.39:0/1998733117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 msgr2=0x558c8d065cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 0x558c8d065cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 -- 172.21.15.39:0/1998733117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c8d0dd8c0 con 0x558c8d0619a0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c596dd640 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d0dd380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009bf0 tx=0x7f1c4c004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cebf278f9637fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.812+0000 7f1c33fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c034070 con 0x558c8d0619a0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1c4c067070 con 0x558c8d0619a0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c480e9720 con 0x558c8d0619a0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c030c80 con 0x558c8d0619a0 2024-09-10T21:57:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 10 client.25552 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558c8d0deb70 con 0x558c8d0619a0 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c480e9720 con 0x558c8d0619a0 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1c4c06ec00 con 0x558c8d0619a0 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 10 client.25552 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 10 client.25552 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 20 client.25552 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:10.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d0e1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:10.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 4 client.25552 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.813+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c8cfc98a0 con 0x558c8d071460 2024-09-10T21:57:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c58edc640 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d0e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c58edc640 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d0e1360 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecdec130f543b045 server_cookie=8dba0e612d2627f5 in_seq=0 out_seq=0 2024-09-10T21:57:10.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c33fff640 10 client.25552 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:10.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c33fff640 1 -- 172.21.15.39:0/1998733117 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c8cfc98a0 con 0x558c8d071460 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c33fff640 10 client.25552 handle_command_reply: tid=0 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.814+0000 7f1c5d515740 1 client.25552 shutdown 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 msgr2=0x558c8d0dd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d0dd380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009bf0 tx=0x7f1c4c004480 comp rx=0 tx=0).stop 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 shutdown_connections 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x558c8d071460 0x558c8d0e1360 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c33fff640 0 client.25552 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c8d0619a0 0x558c8d0dd380 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c8d055a10 0x558c8d066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 --2- 172.21.15.39:0/1998733117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c8d0550f0 0x558c8d065cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 >> 172.21.15.39:0/1998733117 conn(0x558c8d052f20 msgr2=0x558c8d05ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 shutdown_connections 2024-09-10T21:57:10.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 1 -- 172.21.15.39:0/1998733117 wait complete. 2024-09-10T21:57:10.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.815+0000 7f1c5d515740 20 client.25552 trim_cache size 0 max 16384 2024-09-10T21:57:10.824 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 msgr2=0x7f1c440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 0x7f1c440b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009ca0 tx=0x7f1c4c005c50 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 msgr2=0x7f1c5419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800e9f0 tx=0x7f1c4800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 shutdown_connections 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1c440b5360 0x7f1c440b7820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c5410f440 0x7f1c541a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c541021b0 0x7f1c5419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 --2- 172.21.15.39:0/1988249970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c54101890 0x7f1c5419b4f0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800e9f0 tx=0x7f1c4800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 >> 172.21.15.39:0/1988249970 conn(0x7f1c540fd700 msgr2=0x7f1c54110850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:10.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 shutdown_connections 2024-09-10T21:57:10.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:10.816+0000 7f1c5b140640 1 -- 172.21.15.39:0/1988249970 wait complete. 2024-09-10T21:57:11.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:11 smithi039 ceph-mon[30872]: pgmap v406: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.06k op/s 2024-09-10T21:57:11.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:11 smithi070 ceph-mon[34909]: pgmap v406: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.06k op/s 2024-09-10T21:57:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:11 smithi173 ceph-mon[35294]: pgmap v406: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.06k op/s 2024-09-10T21:57:11.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:57:11.996 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.886+0000 7fb366712640 1 -- 172.21.15.39:0/1404814683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107510 msgr2=0x7fb360107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.886+0000 7fb366712640 1 --2- 172.21.15.39:0/1404814683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107510 0x7fb360107950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00d910 tx=0x7fb35c02e5a0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.892+0000 7fb366712640 1 -- 172.21.15.39:0/1404814683 shutdown_connections 2024-09-10T21:57:12.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.892+0000 7fb366712640 1 --2- 172.21.15.39:0/1404814683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360107e90 0x7fb36010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.892+0000 7fb366712640 1 --2- 172.21.15.39:0/1404814683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107510 0x7fb360107950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.892+0000 7fb366712640 1 --2- 172.21.15.39:0/1404814683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360101b00 0x7fb360101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.892+0000 7fb366712640 1 -- 172.21.15.39:0/1404814683 >> 172.21.15.39:0/1404814683 conn(0x7fb3600fd5b0 msgr2=0x7fb3600ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:12.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.896+0000 7fb366712640 1 -- 172.21.15.39:0/1404814683 shutdown_connections 2024-09-10T21:57:12.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.897+0000 7fb366712640 1 -- 172.21.15.39:0/1404814683 wait complete. 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.898+0000 7fb366712640 1 Processor -- start 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 -- start start 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360107510 0x7fb360074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107e90 0x7fb36006d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb360110a90 con 0x7fb360101b00 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb360110910 con 0x7fb360107e90 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.899+0000 7fb366712640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb360110c10 con 0x7fb360107510 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.900+0000 7fb365710640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.900+0000 7fb365710640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55006/0 (socket says 172.21.15.39:55006) 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.900+0000 7fb365710640 1 -- 172.21.15.39:0/3423204807 learned_addr learned my addr 172.21.15.39:0/3423204807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.900+0000 7fb364f0f640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360107510 0x7fb360074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.900+0000 7fb365f11640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107e90 0x7fb36006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.901+0000 7fb365710640 1 -- 172.21.15.39:0/3423204807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360107510 msgr2=0x7fb360074b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.901+0000 7fb365710640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360107510 0x7fb360074b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.902+0000 7fb365710640 1 -- 172.21.15.39:0/3423204807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107e90 msgr2=0x7fb36006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.902+0000 7fb365710640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107e90 0x7fb36006d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.902+0000 7fb365710640 1 -- 172.21.15.39:0/3423204807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36006e0e0 con 0x7fb360101b00 2024-09-10T21:57:12.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.902+0000 7fb365710640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb35000b450 tx=0x7fb35000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.905+0000 7fb3567fc640 1 -- 172.21.15.39:0/3423204807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350015020 con 0x7fb360101b00 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.905+0000 7fb3567fc640 1 -- 172.21.15.39:0/3423204807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb350011d40 con 0x7fb360101b00 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.905+0000 7fb3567fc640 1 -- 172.21.15.39:0/3423204807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35000f340 con 0x7fb360101b00 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.905+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36006e3d0 con 0x7fb360101b00 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.905+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3600734e0 con 0x7fb360101b00 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.914+0000 7fb369d49740 1 Processor -- start 2024-09-10T21:57:12.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.914+0000 7fb369d49740 1 -- start start 2024-09-10T21:57:12.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a66b0 0x55fcce4a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a6fd0 0x55fcce4b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fcce40bea0 con 0x55fcce4a66b0 2024-09-10T21:57:12.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fcce3fb2d0 con 0x55fcce4a6fd0 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb369d49740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fcce3ff0e0 con 0x55fcce4b2f60 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45262/0 (socket says 172.21.15.39:45262) 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 -- 172.21.15.39:0/1677041575 learned_addr learned my addr 172.21.15.39:0/1677041575 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 -- 172.21.15.39:0/1677041575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a6fd0 msgr2=0x55fcce4b2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a6fd0 0x55fcce4b2a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 -- 172.21.15.39:0/1677041575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a66b0 msgr2=0x55fcce4a6a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a66b0 0x55fcce4a6a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.915+0000 7fb364f0f640 1 -- 172.21.15.39:0/1677041575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcce159650 con 0x55fcce4b2f60 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.917+0000 7fb364f0f640 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02eb90 tx=0x7fb35c00c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a528cd229ec6aa13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.922+0000 7fb34b7fe640 1 -- 172.21.15.39:0/1677041575 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c00d110 con 0x55fcce4b2f60 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.922+0000 7fb34b7fe640 1 -- 172.21.15.39:0/1677041575 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb35c044070 con 0x55fcce4b2f60 2024-09-10T21:57:12.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.922+0000 7fb34b7fe640 1 -- 172.21.15.39:0/1677041575 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0046c0 con 0x55fcce4b2f60 2024-09-10T21:57:12.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.924+0000 7fb369d49740 1 -- 172.21.15.39:0/1677041575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 msgr2=0x55fcce4b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:12.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.924+0000 7fb369d49740 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02eb90 tx=0x7fb35c00c510 comp rx=0 tx=0).stop 2024-09-10T21:57:12.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.925+0000 7fb3567fc640 1 -- 172.21.15.39:0/3423204807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb35000f4e0 con 0x7fb360101b00 2024-09-10T21:57:12.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.928+0000 7fb3567fc640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 0x7fb34c0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.928+0000 7fb3567fc640 1 -- 172.21.15.39:0/3423204807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb3500e5200 con 0x7fb360101b00 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.929+0000 7fb369d49740 1 -- 172.21.15.39:0/1677041575 shutdown_connections 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.929+0000 7fb369d49740 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.929+0000 7fb369d49740 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a6fd0 0x55fcce4b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.929+0000 7fb369d49740 1 --2- 172.21.15.39:0/1677041575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a66b0 0x55fcce4a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.929+0000 7fb369d49740 1 -- 172.21.15.39:0/1677041575 >> 172.21.15.39:0/1677041575 conn(0x55fcce4a44e0 msgr2=0x55fcce4a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.930+0000 7fb365f11640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 0x7fb34c0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.931+0000 7fb365f11640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 0x7fb34c0b7a10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb358007e10 tx=0x7fb358007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:12.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.933+0000 7fb369d49740 1 -- 172.21.15.39:0/1677041575 shutdown_connections 2024-09-10T21:57:12.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.934+0000 7fb369d49740 1 -- 172.21.15.39:0/1677041575 wait complete. 2024-09-10T21:57:12.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.934+0000 7fb369d49740 1 -- start start 2024-09-10T21:57:12.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.934+0000 7fb369d49740 1 Processor -- start 2024-09-10T21:57:12.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4b2f60 0x55fcce4b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fcce25c700 con 0x55fcce4b2f60 2024-09-10T21:57:12.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fcce396160 con 0x55fcce4a66b0 2024-09-10T21:57:12.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fcce4b5bb0 con 0x55fcce4a6fd0 2024-09-10T21:57:12.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.935+0000 7fb369d49740 10 client.0 _ll_register_callbacks cb 0x55fcce3af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:12.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45270/0 (socket says 172.21.15.39:45270) 2024-09-10T21:57:12.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 -- 172.21.15.39:0/2220211352 learned_addr learned my addr 172.21.15.39:0/2220211352 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:12.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb365710640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 -- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 msgr2=0x55fcce4b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 -- 172.21.15.39:0/2220211352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4b2f60 msgr2=0x55fcce4b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4b2f60 0x55fcce4b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.938+0000 7fb364f0f640 1 -- 172.21.15.39:0/2220211352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcce3c3c90 con 0x55fcce4a6fd0 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.939+0000 7fb365710640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:57:12.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.939+0000 7fb364f0f640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02eac0 tx=0x7fb35c00d5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0415865e3238810 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:12.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.943+0000 7fb348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:12.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.943+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c04d070 con 0x55fcce4a6fd0 2024-09-10T21:57:12.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.943+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb35c00cd10 con 0x55fcce4a6fd0 2024-09-10T21:57:12.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.944+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb35c044070 con 0x55fcce4a6fd0 2024-09-10T21:57:12.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.946+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb35c004020 con 0x55fcce4a6fd0 2024-09-10T21:57:12.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.948+0000 7fb369d49740 10 client.25561 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:12.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.948+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcce4c16a0 con 0x55fcce4a6fd0 2024-09-10T21:57:12.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.950+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb35c044070 con 0x55fcce4a6fd0 2024-09-10T21:57:12.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.950+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb35c0052a0 con 0x55fcce4a6fd0 2024-09-10T21:57:12.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 10 client.25561 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:12.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:12.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 20 client.25561 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:12.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce4c29f0 0x55fcce4c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:12.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 4 client.25561 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:12.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.951+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcce40ddf0 con 0x55fcce4c29f0 2024-09-10T21:57:12.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.952+0000 7fb365710640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce4c29f0 0x55fcce4c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:12.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.959+0000 7fb365710640 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce4c29f0 0x55fcce4c4de0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39bd934ab352a8 server_cookie=b510a78c5c901b08 in_seq=0 out_seq=0 2024-09-10T21:57:12.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.959+0000 7fb348ff9640 10 client.25561 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:12.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.963+0000 7fb348ff9640 1 -- 172.21.15.39:0/2220211352 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcce40ddf0 con 0x55fcce4c29f0 2024-09-10T21:57:12.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.963+0000 7fb348ff9640 10 client.25561 handle_command_reply: tid=0 2024-09-10T21:57:12.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.964+0000 7fb369d49740 1 client.25561 shutdown 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.964+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 msgr2=0x55fcce4afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.964+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02eac0 tx=0x7fb35c00d5c0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 shutdown_connections 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce4c29f0 0x55fcce4c4de0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4b2f60 0x55fcce4b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4a6fd0 0x55fcce4afd90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 --2- 172.21.15.39:0/2220211352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.965+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 >> 172.21.15.39:0/2220211352 conn(0x55fcce4a44e0 msgr2=0x55fcce492670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:12.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.966+0000 7fb348ff9640 0 client.25561 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:12.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.970+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 shutdown_connections 2024-09-10T21:57:12.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.970+0000 7fb369d49740 1 -- 172.21.15.39:0/2220211352 wait complete. 2024-09-10T21:57:12.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:12.970+0000 7fb369d49740 20 client.25561 trim_cache size 0 max 16384 2024-09-10T21:57:13.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.006+0000 7fb369d49740 1 Processor -- start 2024-09-10T21:57:13.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.006+0000 7fb369d49740 1 -- start start 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce492560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400e540 con 0x55fcce4a6fd0 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb344010140 con 0x55fcce4a66b0 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb369d49740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400ec10 con 0x55fcce4b2f60 2024-09-10T21:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb365710640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb365710640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37290/0 (socket says 172.21.15.39:37290) 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb365710640 1 -- 172.21.15.39:0/1363545817 learned_addr learned my addr 172.21.15.39:0/1363545817 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.007+0000 7fb365f11640 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 -- 172.21.15.39:0/1363545817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 msgr2=0x55fcce4b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 -- 172.21.15.39:0/1363545817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 msgr2=0x55fcce492560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce492560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 -- 172.21.15.39:0/1363545817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcce4b1060 con 0x55fcce4a66b0 2024-09-10T21:57:13.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.008+0000 7fb365710640 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb35000be10 tx=0x7fb3500b0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d484a95ed107fcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:13.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.011+0000 7fb34affd640 1 -- 172.21.15.39:0/1363545817 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500be070 con 0x55fcce4a66b0 2024-09-10T21:57:13.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.011+0000 7fb34affd640 1 -- 172.21.15.39:0/1363545817 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3500ab970 con 0x55fcce4a66b0 2024-09-10T21:57:13.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.011+0000 7fb34affd640 1 -- 172.21.15.39:0/1363545817 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500e4040 con 0x55fcce4a66b0 2024-09-10T21:57:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.012+0000 7fb369d49740 1 -- 172.21.15.39:0/1363545817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 msgr2=0x55fcce4beeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.012+0000 7fb369d49740 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb35000be10 tx=0x7fb3500b0040 comp rx=0 tx=0).stop 2024-09-10T21:57:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.013+0000 7fb369d49740 1 -- 172.21.15.39:0/1363545817 shutdown_connections 2024-09-10T21:57:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.013+0000 7fb369d49740 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.013+0000 7fb369d49740 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce492560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.013+0000 7fb369d49740 1 --2- 172.21.15.39:0/1363545817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4beeb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.013+0000 7fb369d49740 1 -- 172.21.15.39:0/1363545817 >> 172.21.15.39:0/1363545817 conn(0x55fcce4a44e0 msgr2=0x55fcce491e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.018+0000 7fb369d49740 1 -- 172.21.15.39:0/1363545817 shutdown_connections 2024-09-10T21:57:13.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.021+0000 7fb369d49740 1 -- 172.21.15.39:0/1363545817 wait complete. 2024-09-10T21:57:13.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.021+0000 7fb369d49740 1 -- start start 2024-09-10T21:57:13.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.021+0000 7fb369d49740 1 Processor -- start 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4bb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce4bb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400f9b0 con 0x55fcce4a6fd0 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400f2e0 con 0x55fcce4a66b0 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400c520 con 0x55fcce4b2f60 2024-09-10T21:57:13.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.022+0000 7fb369d49740 10 client.0 _ll_register_callbacks cb 0x7fb35c00c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.023+0000 7fb365f11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.023+0000 7fb365f11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45294/0 (socket says 172.21.15.39:45294) 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.023+0000 7fb365f11640 1 -- 172.21.15.39:0/1773653130 learned_addr learned my addr 172.21.15.39:0/1773653130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb364f0f640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce4bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb365f11640 1 -- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 msgr2=0x55fcce4bb100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb365f11640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4bb100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb365f11640 1 -- 172.21.15.39:0/1773653130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 msgr2=0x55fcce4bb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb365f11640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce4bb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.024+0000 7fb365f11640 1 -- 172.21.15.39:0/1773653130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcce4b6700 con 0x55fcce4b2f60 2024-09-10T21:57:13.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.025+0000 7fb365f11640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb35801ee30 tx=0x7fb358004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf80bb42db3e0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:13.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.025+0000 7fb348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:13.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.029+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35802b060 con 0x55fcce4b2f60 2024-09-10T21:57:13.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.029+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3500ab970 con 0x55fcce4b2f60 2024-09-10T21:57:13.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.029+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb358026410 con 0x55fcce4b2f60 2024-09-10T21:57:13.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.032+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb358026630 con 0x55fcce4b2f60 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.035+0000 7fb369d49740 10 client.25567 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.035+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcce5301d0 con 0x55fcce4b2f60 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3500ab970 con 0x55fcce4b2f60 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb3580319d0 con 0x55fcce4b2f60 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 10 client.25567 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:13.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 10 client.25567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:13.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 20 client.25567 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:13.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce530a20 0x55fcce532e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:13.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 4 client.25567 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:13.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.038+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcce4098a0 con 0x55fcce530a20 2024-09-10T21:57:13.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.043+0000 7fb365710640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce530a20 0x55fcce532e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:13.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.050+0000 7fb365710640 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce530a20 0x55fcce532e40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5339715075781b server_cookie=ecceef73585d16ee in_seq=0 out_seq=0 2024-09-10T21:57:13.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.050+0000 7fb348ff9640 10 client.25567 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:13.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.056+0000 7fb348ff9640 1 -- 172.21.15.39:0/1773653130 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcce4098a0 con 0x55fcce530a20 2024-09-10T21:57:13.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.056+0000 7fb348ff9640 10 client.25567 handle_command_reply: tid=0 2024-09-10T21:57:13.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.056+0000 7fb369d49740 1 client.25567 shutdown 2024-09-10T21:57:13.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.061+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 msgr2=0x55fcce4b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:13.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.061+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb35801ee30 tx=0x7fb358004a40 comp rx=0 tx=0).stop 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 shutdown_connections 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55fcce530a20 0x55fcce532e40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcce4b2f60 0x55fcce4b5ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcce4a6fd0 0x55fcce4bb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 --2- 172.21.15.39:0/1773653130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcce4a66b0 0x55fcce4bb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 >> 172.21.15.39:0/1773653130 conn(0x55fcce4a44e0 msgr2=0x55fcce492670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:13.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb348ff9640 0 client.25567 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 shutdown_connections 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.068+0000 7fb369d49740 1 -- 172.21.15.39:0/1773653130 wait complete. 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.069+0000 7fb369d49740 20 client.25567 trim_cache size 0 max 16384 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 msgr2=0x7fb34c0b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:13.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 0x7fb34c0b7a10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb358007e10 tx=0x7fb358007520 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 msgr2=0x7fb360074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb35000b450 tx=0x7fb35000b910 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 shutdown_connections 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb34c0b5550 0x7fb34c0b7a10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360107e90 0x7fb36006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb360107510 0x7fb360074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 --2- 172.21.15.39:0/3423204807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb360101b00 0x7fb360074620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 >> 172.21.15.39:0/3423204807 conn(0x7fb3600fd5b0 msgr2=0x7fb3600ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.070+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 shutdown_connections 2024-09-10T21:57:13.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:13.071+0000 7fb366712640 1 -- 172.21.15.39:0/3423204807 wait complete. 2024-09-10T21:57:13.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:13 smithi070 ceph-mon[34909]: pgmap v407: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.05k op/s 2024-09-10T21:57:13.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:13 smithi039 ceph-mon[30872]: pgmap v407: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.05k op/s 2024-09-10T21:57:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:13 smithi173 ceph-mon[35294]: pgmap v407: 97 pgs: 97 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.05k op/s 2024-09-10T21:57:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.395+0000 7fa078be8640 1 -- 172.21.15.39:0/1995367756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074103370 msgr2=0x7fa074109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.395+0000 7fa078be8640 1 --2- 172.21.15.39:0/1995367756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074103370 0x7fa074109cf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009cd0 tx=0x7fa06c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 -- 172.21.15.39:0/1995367756 shutdown_connections 2024-09-10T21:57:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 --2- 172.21.15.39:0/1995367756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074103370 0x7fa074109cf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 --2- 172.21.15.39:0/1995367756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa074102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 --2- 172.21.15.39:0/1995367756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074101860 0x7fa074101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 -- 172.21.15.39:0/1995367756 >> 172.21.15.39:0/1995367756 conn(0x7fa0740fd140 msgr2=0x7fa0740ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 -- 172.21.15.39:0/1995367756 shutdown_connections 2024-09-10T21:57:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.396+0000 7fa078be8640 1 -- 172.21.15.39:0/1995367756 wait complete. 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 Processor -- start 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 -- start start 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 0x7fa07419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa07410e600 con 0x7fa074101860 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa07410e480 con 0x7fa074103370 2024-09-10T21:57:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa078be8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa07410e780 con 0x7fa0741029b0 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa07259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa072d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 0x7fa07419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45302/0 (socket says 172.21.15.39:45302) 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa07259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55064/0 (socket says 172.21.15.39:55064) 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.397+0000 7fa06bfff640 1 -- 172.21.15.39:0/415948619 learned_addr learned my addr 172.21.15.39:0/415948619 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 -- 172.21.15.39:0/415948619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 msgr2=0x7fa0741993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 -- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 msgr2=0x7fa074198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 -- 172.21.15.39:0/415948619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07419a8e0 con 0x7fa074103370 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa07259c640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa06bfff640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa072d9d640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 0x7fa07419a020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa06c031780 tx=0x7fa06c003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa06b7fe640 1 -- 172.21.15.39:0/415948619 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c004040 con 0x7fa074103370 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa06b7fe640 1 -- 172.21.15.39:0/415948619 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa06c004690 con 0x7fa074103370 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07419ab70 con 0x7fa074103370 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.398+0000 7fa06b7fe640 1 -- 172.21.15.39:0/415948619 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c030da0 con 0x7fa074103370 2024-09-10T21:57:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.399+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741a12a0 con 0x7fa074103370 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.401+0000 7fa07ba91740 1 Processor -- start 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.402+0000 7fa06b7fe640 1 -- 172.21.15.39:0/415948619 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa06c030070 con 0x7fa074103370 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 -- start start 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559be491d6f0 con 0x559be49b0bd0 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559be490cb20 con 0x559be49ab860 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07ba91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559be4910930 con 0x559be49ae190 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37318/0 (socket says 172.21.15.39:37318) 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa06bfff640 1 -- 172.21.15.39:0/78433087 learned_addr learned my addr 172.21.15.39:0/78433087 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07259c640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa06bfff640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07259c640 1 -- 172.21.15.39:0/78433087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 msgr2=0x559be49adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07259c640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.403+0000 7fa07259c640 1 -- 172.21.15.39:0/78433087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 msgr2=0x559be49b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa07259c640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa07259c640 1 -- 172.21.15.39:0/78433087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559be48d2530 con 0x559be49ae190 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa06bfff640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa06b7fe640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 0x7fa0600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa06bfff640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 0x7fa0600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa06b7fe640 1 -- 172.21.15.39:0/415948619 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa06c02e030 con 0x7fa074103370 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa07259c640 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49b0580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fd0 tx=0x7fa0640118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c1b2d97c86aee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.404+0000 7fa068ff9640 1 -- 172.21.15.39:0/78433087 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004030 con 0x559be49ae190 2024-09-10T21:57:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.405+0000 7fa068ff9640 1 -- 172.21.15.39:0/78433087 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0640054d0 con 0x559be49ae190 2024-09-10T21:57:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.405+0000 7fa068ff9640 1 -- 172.21.15.39:0/78433087 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004ce0 con 0x559be49ae190 2024-09-10T21:57:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.405+0000 7fa06bfff640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 0x7fa0600b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d6c0 tx=0x7fa05c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- 172.21.15.39:0/78433087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 msgr2=0x559be49b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49b0580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fd0 tx=0x7fa0640118d0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- 172.21.15.39:0/78433087 shutdown_connections 2024-09-10T21:57:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49b0580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 --2- 172.21.15.39:0/78433087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- 172.21.15.39:0/78433087 >> 172.21.15.39:0/78433087 conn(0x559be49a69b0 msgr2=0x559be49a7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- 172.21.15.39:0/78433087 shutdown_connections 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- 172.21.15.39:0/78433087 wait complete. 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.406+0000 7fa07ba91740 1 -- start start 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 Processor -- start 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 0x559be49b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559be4844ab0 con 0x559be49ae190 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559be48b2730 con 0x559be49ab860 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559be49b3bb0 con 0x559be49b0bd0 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37330/0 (socket says 172.21.15.39:37330) 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07259c640 1 -- 172.21.15.39:0/4050357959 learned_addr learned my addr 172.21.15.39:0/4050357959 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa07ba91740 10 client.0 _ll_register_callbacks cb 0x559be49066b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa06bfff640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 0x559be49b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.407+0000 7fa072d9d640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa07259c640 1 -- 172.21.15.39:0/4050357959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 msgr2=0x559be49b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa07259c640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa07259c640 1 -- 172.21.15.39:0/4050357959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 msgr2=0x559be49b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa07259c640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 0x559be49b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa07259c640 1 -- 172.21.15.39:0/4050357959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559be466e790 con 0x559be49ab860 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.408+0000 7fa06bfff640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 0x559be49b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.409+0000 7fa07259c640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa064009350 tx=0x7fa06400fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e461d90c165d9dde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.409+0000 7fa059ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.409+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064029020 con 0x559be49ab860 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.409+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa064004bf0 con 0x559be49ab860 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.409+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0640054d0 con 0x559be49ab860 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.410+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa06400fea0 con 0x559be49ab860 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.411+0000 7fa07ba91740 10 client.25574 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.411+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559be46e7620 con 0x559be49ab860 2024-09-10T21:57:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.412+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0640054d0 con 0x559be49ab860 2024-09-10T21:57:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.413+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa064004df0 con 0x559be49ab860 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.414+0000 7fa07ba91740 10 client.25574 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.414+0000 7fa07ba91740 10 client.25574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.414+0000 7fa07ba91740 20 client.25574 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.414+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be49c05a0 0x559be49c2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.415+0000 7fa07ba91740 4 client.25574 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.415+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559be491f640 con 0x559be49c05a0 2024-09-10T21:57:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.415+0000 7fa06bfff640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be49c05a0 0x559be49c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.415+0000 7fa06bfff640 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be49c05a0 0x559be49c2990 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d02fa97b9184963c server_cookie=c6bc4cc8cdbc27cc in_seq=0 out_seq=0 2024-09-10T21:57:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.415+0000 7fa059ffb640 10 client.25574 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.418+0000 7fa059ffb640 1 -- 172.21.15.39:0/4050357959 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559be491f640 con 0x559be49c05a0 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa059ffb640 10 client.25574 handle_command_reply: tid=0 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 client.25574 shutdown 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 msgr2=0x559be49b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa064009350 tx=0x7fa06400fcb0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 shutdown_connections 2024-09-10T21:57:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be49c05a0 0x559be49c2990 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ae190 0x559be49b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa059ffb640 0 client.25574 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 --2- 172.21.15.39:0/4050357959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49b4ed0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 >> 172.21.15.39:0/4050357959 conn(0x559be49a69b0 msgr2=0x559be49a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 shutdown_connections 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.419+0000 7fa07ba91740 1 -- 172.21.15.39:0/4050357959 wait complete. 2024-09-10T21:57:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.420+0000 7fa07ba91740 20 client.25574 trim_cache size 0 max 16384 2024-09-10T21:57:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.435+0000 7fa07ba91740 1 Processor -- start 2024-09-10T21:57:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.435+0000 7fa07ba91740 1 -- start start 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 0x559be49a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 0x559be49a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741a9f30 con 0x559be49ab860 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741abb30 con 0x559be49ae190 2024-09-10T21:57:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07ba91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741aa600 con 0x559be49b0bd0 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 0x559be49a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 0x559be49a97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55098/0 (socket says 172.21.15.39:55098) 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa07259c640 1 -- 172.21.15.39:0/1325967009 learned_addr learned my addr 172.21.15.39:0/1325967009 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa06bfff640 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 0x559be49a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.436+0000 7fa072d9d640 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 -- 172.21.15.39:0/1325967009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 msgr2=0x559be49c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 -- 172.21.15.39:0/1325967009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 msgr2=0x559be49a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 0x559be49a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 -- 172.21.15.39:0/1325967009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559be49c2d00 con 0x559be49ae190 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa06bfff640 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 0x559be49a9d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00df50 tx=0x7fa05c014070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702c6c87a86270f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa05bfff640 1 -- 172.21.15.39:0/1325967009 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c010ca0 con 0x559be49ae190 2024-09-10T21:57:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa05bfff640 1 -- 172.21.15.39:0/1325967009 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa05c02e070 con 0x559be49ae190 2024-09-10T21:57:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.437+0000 7fa05bfff640 1 -- 172.21.15.39:0/1325967009 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0295a0 con 0x559be49ae190 2024-09-10T21:57:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 -- 172.21.15.39:0/1325967009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 msgr2=0x559be49a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 0x559be49a9d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00df50 tx=0x7fa05c014070 comp rx=0 tx=0).stop 2024-09-10T21:57:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 -- 172.21.15.39:0/1325967009 shutdown_connections 2024-09-10T21:57:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49b0bd0 0x559be49c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ae190 0x559be49a9d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 --2- 172.21.15.39:0/1325967009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49ab860 0x559be49a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 -- 172.21.15.39:0/1325967009 >> 172.21.15.39:0/1325967009 conn(0x559be49a69b0 msgr2=0x559be49a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 -- 172.21.15.39:0/1325967009 shutdown_connections 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.438+0000 7fa07ba91740 1 -- 172.21.15.39:0/1325967009 wait complete. 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07ba91740 1 -- start start 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07ba91740 1 Processor -- start 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07ba91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa07259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37346/0 (socket says 172.21.15.39:37346) 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.439+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49bb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45344/0 (socket says 172.21.15.39:45344) 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa072d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa072d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55104/0 (socket says 172.21.15.39:55104) 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 -- 172.21.15.39:0/2791351218 learned_addr learned my addr 172.21.15.39:0/2791351218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741ab3a0 con 0x559be49b0bd0 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741aacd0 con 0x559be49ab860 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741a7f10 con 0x559be49ae190 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07ba91740 10 client.0 _ll_register_callbacks cb 0x7fa05c0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 -- 172.21.15.39:0/2791351218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 msgr2=0x559be49bb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49bb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 -- 172.21.15.39:0/2791351218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 msgr2=0x559be49bb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49bb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.440+0000 7fa07259c640 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559be49bbe50 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa07259c640 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa064005210 tx=0x7fa06400f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43629fc6f27b23e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064029040 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa064004df0 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05c02e070 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa064004040 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa07ba91740 10 client.25580 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559be49bac80 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0640035f0 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.441+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa06403b4c0 con 0x559be49ab860 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 10 client.25580 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 20 client.25580 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be4a32040 0x559be4a34460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 4 client.25580 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:57:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa05c02e070 con 0x559be4a32040 2024-09-10T21:57:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa06bfff640 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be4a32040 0x559be4a34460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa06bfff640 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be4a32040 0x559be4a34460 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ee0959079a0374 server_cookie=c648135a32c001e4 in_seq=0 out_seq=0 2024-09-10T21:57:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:14.442+0000 7fa059ffb640 10 client.25580 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:14.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:57:14.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:57:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:15.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:15 smithi039 ceph-mon[30872]: pgmap v408: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 1.22k op/s 2024-09-10T21:57:15.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:15 smithi070 ceph-mon[34909]: pgmap v408: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 1.22k op/s 2024-09-10T21:57:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:15 smithi173 ceph-mon[35294]: pgmap v408: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 1.22k op/s 2024-09-10T21:57:15.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 -- 172.21.15.39:0/153260630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 msgr2=0x7f195010cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 --2- 172.21.15.39:0/153260630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f195010cdb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1940009900 tx=0x7f194002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 -- 172.21.15.39:0/153260630 shutdown_connections 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 --2- 172.21.15.39:0/153260630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195010f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 --2- 172.21.15.39:0/153260630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f195010cdb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 --2- 172.21.15.39:0/153260630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 0x7f1950101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.734+0000 7f19578e2640 1 -- 172.21.15.39:0/153260630 >> 172.21.15.39:0/153260630 conn(0x7f1950076e60 msgr2=0x7f1950077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.735+0000 7f19578e2640 1 -- 172.21.15.39:0/153260630 shutdown_connections 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.735+0000 7f19578e2640 1 -- 172.21.15.39:0/153260630 wait complete. 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.735+0000 7f19578e2640 1 Processor -- start 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.735+0000 7f19578e2640 1 -- start start 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.735+0000 7f19578e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 0x7f1950199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f19578e2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f19578e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f19578e2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1950112db0 con 0x7f195010a9c0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f19578e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1950112c30 con 0x7f195010d2f0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f19578e2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1950112f30 con 0x7f19501018b0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55122/0 (socket says 172.21.15.39:55122) 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 -- 172.21.15.39:0/380817245 learned_addr learned my addr 172.21.15.39:0/380817245 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1955e7f640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f195567e640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 0x7f1950199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 -- 172.21.15.39:0/380817245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 msgr2=0x7f1950199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 0x7f1950199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 -- 172.21.15.39:0/380817245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 msgr2=0x7f195019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 -- 172.21.15.39:0/380817245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195019f3b0 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1955e7f640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.736+0000 7f1954e7d640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1940032fd0 tx=0x7f1940031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.737+0000 7f19467fc640 1 -- 172.21.15.39:0/380817245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194003f030 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.737+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195019f640 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.737+0000 7f19467fc640 1 -- 172.21.15.39:0/380817245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19400043d0 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.737+0000 7f19467fc640 1 -- 172.21.15.39:0/380817245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940035070 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.737+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19501a5d60 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.739+0000 7f19467fc640 1 -- 172.21.15.39:0/380817245 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1940003c30 con 0x7f195010a9c0 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.739+0000 7f1959cb7740 1 Processor -- start 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 -- start start 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 0x55713be11250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55713bd7be60 con 0x55713be04ee0 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55713bd6b290 con 0x55713be05800 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1959cb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55713bd6f0a0 con 0x55713be11790 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55136/0 (socket says 172.21.15.39:55136) 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 -- 172.21.15.39:0/2761427173 learned_addr learned my addr 172.21.15.39:0/2761427173 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f195567e640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 0x55713be11250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1954e7d640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 -- 172.21.15.39:0/2761427173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 msgr2=0x55713be13b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be13b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 -- 172.21.15.39:0/2761427173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 msgr2=0x55713be11250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 0x55713be11250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f1955e7f640 1 -- 172.21.15.39:0/2761427173 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713bac9930 con 0x55713be04ee0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f195567e640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 0x55713be11250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.740+0000 7f19467fc640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 0x7f193c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f195567e640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 0x7f193c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1948011840 tx=0x7f1948011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77a9af426be5f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f19467fc640 1 -- 172.21.15.39:0/380817245 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1940106170 con 0x7f195010a9c0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f193b7fe640 1 -- 172.21.15.39:0/2761427173 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948011310 con 0x55713be04ee0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f193b7fe640 1 -- 172.21.15.39:0/2761427173 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f194800f9a0 con 0x55713be04ee0 2024-09-10T21:57:15.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.741+0000 7f193b7fe640 1 -- 172.21.15.39:0/2761427173 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19480055f0 con 0x55713be04ee0 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 -- 172.21.15.39:0/2761427173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 msgr2=0x55713be052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1948011840 tx=0x7f1948011d00 comp rx=0 tx=0).stop 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f195567e640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 0x7f193c0b77a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55713be08060 tx=0x7f194c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 -- 172.21.15.39:0/2761427173 shutdown_connections 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be13b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be05800 0x55713be11250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2761427173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be04ee0 0x55713be052c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.742+0000 7f1959cb7740 1 -- 172.21.15.39:0/2761427173 >> 172.21.15.39:0/2761427173 conn(0x55713be02d10 msgr2=0x55713be03eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.743+0000 7f1959cb7740 1 -- 172.21.15.39:0/2761427173 shutdown_connections 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.743+0000 7f1959cb7740 1 -- 172.21.15.39:0/2761427173 wait complete. 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.743+0000 7f1959cb7740 1 -- start start 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.743+0000 7f1959cb7740 1 Processor -- start 2024-09-10T21:57:15.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be04ee0 0x55713be0e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55713bbcc890 con 0x55713be05800 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55713bd05d40 con 0x55713be11790 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55713be14440 con 0x55713be04ee0 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1959cb7740 10 client.0 _ll_register_callbacks cb 0x55713bd69c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1955e7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1955e7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37380/0 (socket says 172.21.15.39:37380) 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1955e7f640 1 -- 172.21.15.39:0/1086559714 learned_addr learned my addr 172.21.15.39:0/1086559714 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f1954e7d640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.744+0000 7f195567e640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be04ee0 0x55713be0e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 -- 172.21.15.39:0/1086559714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be04ee0 msgr2=0x55713be0e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be04ee0 0x55713be0e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 -- 172.21.15.39:0/1086559714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 msgr2=0x55713be0ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 -- 172.21.15.39:0/1086559714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713be1d870 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1954e7d640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1955e7f640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1948005210 tx=0x7f1948005240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663c0ba547527dce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1938ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948026020 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1948011450 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194800f9a0 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1948004a40 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1959cb7740 10 client.25592 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.745+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55713be20220 con 0x55713be11790 2024-09-10T21:57:15.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f194800f9a0 con 0x55713be11790 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1948018070 con 0x55713be11790 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 10 client.25592 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 20 client.25592 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be215d0 0x55713be239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 4 client.25592 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713bd7ddb0 con 0x55713be215d0 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.746+0000 7f195567e640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be215d0 0x55713be239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.747+0000 7f195567e640 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be215d0 0x55713be239c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1369757c939b010d server_cookie=e7e4dbb8249a6b30 in_seq=0 out_seq=0 2024-09-10T21:57:15.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.747+0000 7f1938ff9640 10 client.25592 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1938ff9640 1 -- 172.21.15.39:0/1086559714 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55713bd7ddb0 con 0x55713be215d0 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1938ff9640 10 client.25592 handle_command_reply: tid=0 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 client.25592 shutdown 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 msgr2=0x55713be0f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1948005210 tx=0x7f1948005240 comp rx=0 tx=0).stop 2024-09-10T21:57:15.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 shutdown_connections 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be215d0 0x55713be239c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be11790 0x55713be0f220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1938ff9640 0 client.25592 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 --2- 172.21.15.39:0/1086559714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be04ee0 0x55713be0e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.750+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 >> 172.21.15.39:0/1086559714 conn(0x55713be02d10 msgr2=0x55713be01f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.751+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 shutdown_connections 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.751+0000 7f1959cb7740 1 -- 172.21.15.39:0/1086559714 wait complete. 2024-09-10T21:57:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.751+0000 7f1959cb7740 20 client.25592 trim_cache size 0 max 16384 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 Processor -- start 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 -- start start 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be0eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be29210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19501ae3e0 con 0x55713be05800 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19501affe0 con 0x55713be04ee0 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1959cb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19501aeab0 con 0x55713be11790 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1954e7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be0eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1954e7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55150/0 (socket says 172.21.15.39:55150) 2024-09-10T21:57:15.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1954e7d640 1 -- 172.21.15.39:0/981365907 learned_addr learned my addr 172.21.15.39:0/981365907 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:15.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f1955e7f640 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be29210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 -- 172.21.15.39:0/981365907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 msgr2=0x55713be29210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be29210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 -- 172.21.15.39:0/981365907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 msgr2=0x55713be0f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.769+0000 7f195567e640 1 -- 172.21.15.39:0/981365907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713bdfe640 con 0x55713be04ee0 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.770+0000 7f1954e7d640 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.770+0000 7f195567e640 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be0eca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55713be24150 tx=0x7f194c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc28e2114faa580 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.770+0000 7f193affd640 1 -- 172.21.15.39:0/981365907 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c01de50 con 0x55713be04ee0 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.770+0000 7f193affd640 1 -- 172.21.15.39:0/981365907 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f194c02a8c0 con 0x55713be04ee0 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.770+0000 7f193affd640 1 -- 172.21.15.39:0/981365907 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c00f850 con 0x55713be04ee0 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 -- 172.21.15.39:0/981365907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 msgr2=0x55713be0eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be0eca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55713be24150 tx=0x7f194c019000 comp rx=0 tx=0).stop 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 -- 172.21.15.39:0/981365907 shutdown_connections 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be11790 0x55713be29210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be05800 0x55713be0f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 --2- 172.21.15.39:0/981365907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be0eca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 -- 172.21.15.39:0/981365907 >> 172.21.15.39:0/981365907 conn(0x55713be02d10 msgr2=0x55713be088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 -- 172.21.15.39:0/981365907 shutdown_connections 2024-09-10T21:57:15.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.771+0000 7f1959cb7740 1 -- 172.21.15.39:0/981365907 wait complete. 2024-09-10T21:57:15.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 -- start start 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 Processor -- start 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be15790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be05800 0x55713be15cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 0x55713be16210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19501af850 con 0x55713be11790 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19501af180 con 0x55713be04ee0 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19501ac3c0 con 0x55713be05800 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.772+0000 7f1959cb7740 10 client.0 _ll_register_callbacks cb 0x7f1948011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f195567e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be15790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f195567e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be15790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37406/0 (socket says 172.21.15.39:37406) 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f195567e640 1 -- 172.21.15.39:0/2326025554 learned_addr learned my addr 172.21.15.39:0/2326025554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 0x55713be16210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1954e7d640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be05800 0x55713be15cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 -- 172.21.15.39:0/2326025554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be05800 msgr2=0x55713be15cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be05800 0x55713be15cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 -- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 msgr2=0x55713be15790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be15790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 -- 172.21.15.39:0/2326025554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713be8d570 con 0x55713be11790 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1955e7f640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 0x55713be16210 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f194802f040 tx=0x7f1948005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224be0e83e06618a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.773+0000 7f1938ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948026070 con 0x55713be11790 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1948011450 con 0x55713be11790 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194c02a8c0 con 0x55713be11790 2024-09-10T21:57:15.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1948004be0 con 0x55713be11790 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 10 client.15993 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55713be8e8b0 con 0x55713be11790 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f194c02a8c0 con 0x55713be11790 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1948018030 con 0x55713be11790 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 10 client.15993 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 20 client.15993 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be8f0c0 0x55713be914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 4 client.15993 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.774+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55713bd79860 con 0x55713be8f0c0 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.775+0000 7f195567e640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be8f0c0 0x55713be914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.775+0000 7f1938ff9640 10 client.15993 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:15.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.775+0000 7f195567e640 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be8f0c0 0x55713be914e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20037558860cd938 server_cookie=68507cc4d71e518b in_seq=0 out_seq=0 2024-09-10T21:57:15.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1938ff9640 1 -- 172.21.15.39:0/2326025554 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55713bd79860 con 0x55713be8f0c0 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1938ff9640 10 client.15993 handle_command_reply: tid=0 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 client.15993 shutdown 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 msgr2=0x55713be16210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 0x55713be16210 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f194802f040 tx=0x7f1948005c50 comp rx=0 tx=0).stop 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 shutdown_connections 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55713be8f0c0 0x55713be914e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1938ff9640 0 client.15993 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55713be11790 0x55713be16210 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55713be05800 0x55713be15cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 --2- 172.21.15.39:0/2326025554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55713be04ee0 0x55713be15790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 >> 172.21.15.39:0/2326025554 conn(0x55713be02d10 msgr2=0x55713be08090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 shutdown_connections 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 1 -- 172.21.15.39:0/2326025554 wait complete. 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.859+0000 7f1959cb7740 20 client.15993 trim_cache size 0 max 16384 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:57:15.863 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "998a7b51-518d-4b13-8ae6-f313900d2c62", 2024-09-10T21:57:15.864 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:57:15.864 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:57:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 msgr2=0x7f193c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 0x7f193c0b77a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55713be08060 tx=0x7f194c005f90 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 msgr2=0x7f1950199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1940032fd0 tx=0x7f1940031a20 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 shutdown_connections 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f193c0b52e0 0x7f193c0b77a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f195010d2f0 0x7f195019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f195010a9c0 0x7f1950199840 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 --2- 172.21.15.39:0/380817245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19501018b0 0x7f1950199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 >> 172.21.15.39:0/380817245 conn(0x7f1950076e60 msgr2=0x7f1950100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 shutdown_connections 2024-09-10T21:57:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:15.860+0000 7f19578e2640 1 -- 172.21.15.39:0/380817245 wait complete. 2024-09-10T21:57:16.500 INFO:tasks.workunit.client.0.smithi039.stdout: 58 1170525 582 757450 497 672218 1466 2024-09-10T21:57:16.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:57:17.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:17 smithi070 ceph-mon[34909]: pgmap v409: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 502 op/s 2024-09-10T21:57:17.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:17 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:57:17.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:17 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:17.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:17 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:57:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:17 smithi039 ceph-mon[30872]: pgmap v409: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 502 op/s 2024-09-10T21:57:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:17 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:57:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:17 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:17 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:57:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:17 smithi173 ceph-mon[35294]: pgmap v409: 97 pgs: 97 active+clean; 168 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 502 op/s 2024-09-10T21:57:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:17 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:57:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:17 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:17 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:57:17.543 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:18.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 -- 172.21.15.39:0/488629083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6410f3a0 msgr2=0x7fbb64111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 --2- 172.21.15.39:0/488629083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6410f3a0 0x7fbb64111790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009be0 tx=0x7fbb5c02a6c0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 -- 172.21.15.39:0/488629083 shutdown_connections 2024-09-10T21:57:18.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 --2- 172.21.15.39:0/488629083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6410f3a0 0x7fbb64111790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 --2- 172.21.15.39:0/488629083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 --2- 172.21.15.39:0/488629083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb640754e0 0x7fbb640758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 -- 172.21.15.39:0/488629083 >> 172.21.15.39:0/488629083 conn(0x7fbb640fe800 msgr2=0x7fbb64100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 -- 172.21.15.39:0/488629083 shutdown_connections 2024-09-10T21:57:18.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.020+0000 7fbb6b609640 1 -- 172.21.15.39:0/488629083 wait complete. 2024-09-10T21:57:18.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.021+0000 7fbb6b609640 1 Processor -- start 2024-09-10T21:57:18.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.021+0000 7fbb6b609640 1 -- start start 2024-09-10T21:57:18.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.021+0000 7fbb6b609640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.021+0000 7fbb6b609640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb6b609640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6410f3a0 0x7fbb641a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb6b609640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64114f40 con 0x7fbb64075e00 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb6b609640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64114dc0 con 0x7fbb640754e0 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb6b609640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641150c0 con 0x7fbb6410f3a0 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37428/0 (socket says 172.21.15.39:37428) 2024-09-10T21:57:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb693a5640 1 -- 172.21.15.39:0/3743445080 learned_addr learned my addr 172.21.15.39:0/3743445080 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6410f3a0 0x7fbb641a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3743445080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6410f3a0 msgr2=0x7fbb641a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6410f3a0 0x7fbb641a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3743445080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 msgr2=0x7fbb6419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3743445080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb641a14c0 con 0x7fbb64075e00 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6419b950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005fd0 tx=0x7fbb5800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb567fc640 1 -- 172.21.15.39:0/3743445080 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800cd00 con 0x7fbb64075e00 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb641a17b0 con 0x7fbb64075e00 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.022+0000 7fbb567fc640 1 -- 172.21.15.39:0/3743445080 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb580035f0 con 0x7fbb64075e00 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.023+0000 7fbb567fc640 1 -- 172.21.15.39:0/3743445080 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58010690 con 0x7fbb64075e00 2024-09-10T21:57:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.023+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb641a7e70 con 0x7fbb64075e00 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.025+0000 7fbb567fc640 1 -- 172.21.15.39:0/3743445080 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbb58003a80 con 0x7fbb64075e00 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 Processor -- start 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 -- start start 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e066860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e0727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55585dfdce50 con 0x55585e066da0 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55585dfcc280 con 0x55585e072d30 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.026+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55585dfd0090 con 0x55585e066480 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e0727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37436/0 (socket says 172.21.15.39:37436) 2024-09-10T21:57:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 -- 172.21.15.39:0/907801576 learned_addr learned my addr 172.21.15.39:0/907801576 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb567fc640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 0x7fbb500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 -- 172.21.15.39:0/907801576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 msgr2=0x55585e066860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e066860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 -- 172.21.15.39:0/907801576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 msgr2=0x55585e0727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e0727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 -- 172.21.15.39:0/907801576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55585dd2a650 con 0x55585e072d30 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb693a5640 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e0727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 0x7fbb500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb567fc640 1 -- 172.21.15.39:0/3743445080 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb580e5e40 con 0x7fbb64075e00 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.027+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e500 tx=0x7fbb58020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45db478c6700a0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.028+0000 7fbb4f7fe640 1 -- 172.21.15.39:0/907801576 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb580ac380 con 0x55585e072d30 2024-09-10T21:57:18.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.028+0000 7fbb4f7fe640 1 -- 172.21.15.39:0/907801576 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb580cdd40 con 0x55585e072d30 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.028+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 0x7fbb500b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02abe0 tx=0x7fbb5c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.028+0000 7fbb4f7fe640 1 -- 172.21.15.39:0/907801576 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58013190 con 0x55585e072d30 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- 172.21.15.39:0/907801576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 msgr2=0x55585e075120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e500 tx=0x7fbb58020000 comp rx=0 tx=0).stop 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- 172.21.15.39:0/907801576 shutdown_connections 2024-09-10T21:57:18.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e075120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e0727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/907801576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- 172.21.15.39:0/907801576 >> 172.21.15.39:0/907801576 conn(0x55585e0642b0 msgr2=0x55585e065450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- 172.21.15.39:0/907801576 shutdown_connections 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- 172.21.15.39:0/907801576 wait complete. 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.029+0000 7fbb6d9de740 1 -- start start 2024-09-10T21:57:18.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 Processor -- start 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 0x55585e06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 0x55585e06ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55585de2d700 con 0x55585e072d30 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55585df67110 con 0x55585e066da0 2024-09-10T21:57:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55585e075950 con 0x55585e066480 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb6d9de740 10 client.0 _ll_register_callbacks cb 0x55585df80990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 0x55585e06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45422/0 (socket says 172.21.15.39:45422) 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 0x55585e06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37450/0 (socket says 172.21.15.39:37450) 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.030+0000 7fbb693a5640 1 -- 172.21.15.39:0/3268880380 learned_addr learned my addr 172.21.15.39:0/3268880380 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:18.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 0x55585e06ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb693a5640 1 -- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 msgr2=0x55585e06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 0x55585e06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb693a5640 1 -- 172.21.15.39:0/3268880380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 msgr2=0x55585e06ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 0x55585e06ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb693a5640 1 -- 172.21.15.39:0/3268880380 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55585df94c40 con 0x55585e066480 2024-09-10T21:57:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.031+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 0x55585e06ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb60011970 tx=0x7fbb60011d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744ff5310996b2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010ba0 con 0x55585e066480 2024-09-10T21:57:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb60010d40 con 0x55585e066480 2024-09-10T21:57:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb580cdd40 con 0x55585e066480 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb60005020 con 0x55585e066480 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb6d9de740 10 client.25615 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55585e0812b0 con 0x55585e066480 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.032+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb580cdd40 con 0x55585e066480 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbb6001b470 con 0x55585e066480 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 10 client.25615 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 10 client.25615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 20 client.25615 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e082860 0x55585e084c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 4 client.25615 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55585dfdeda0 con 0x55585e082860 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e082860 0x55585e084c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb4cff9640 10 client.25615 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:18.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.033+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e082860 0x55585e084c80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12de8844540ec64f server_cookie=b7bbe4af4258b2e3 in_seq=0 out_seq=0 2024-09-10T21:57:18.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.039+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3268880380 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55585dfdeda0 con 0x55585e082860 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.039+0000 7fbb4cff9640 10 client.25615 handle_command_reply: tid=0 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.039+0000 7fbb6d9de740 1 client.25615 shutdown 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 msgr2=0x55585e0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb60011970 tx=0x7fbb60011d70 comp rx=0 tx=0).stop 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 shutdown_connections 2024-09-10T21:57:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e082860 0x55585e084c80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e072d30 0x55585e06ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e066da0 0x55585e06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb4cff9640 0 client.25615 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3268880380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e0725b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 >> 172.21.15.39:0/3268880380 conn(0x55585e0642b0 msgr2=0x55585e069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 shutdown_connections 2024-09-10T21:57:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3268880380 wait complete. 2024-09-10T21:57:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.040+0000 7fbb6d9de740 20 client.25615 trim_cache size 0 max 16384 2024-09-10T21:57:18.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.060+0000 7fbb6d9de740 1 Processor -- start 2024-09-10T21:57:18.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 -- start start 2024-09-10T21:57:18.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066480 0x55585e06e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e065150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641b05e0 con 0x55585e066480 2024-09-10T21:57:18.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641b21e0 con 0x55585e072d30 2024-09-10T21:57:18.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641b0cb0 con 0x55585e066da0 2024-09-10T21:57:18.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:45424/0 (socket says 172.21.15.39:45424) 2024-09-10T21:57:18.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb69ba6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e065150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.061+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3130355550 learned_addr learned my addr 172.21.15.39:0/3130355550 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:18.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066480 0x55585e06e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 -- 172.21.15.39:0/3130355550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 msgr2=0x55585e06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 -- 172.21.15.39:0/3130355550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066480 msgr2=0x55585e06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066480 0x55585e06e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 -- 172.21.15.39:0/3130355550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55585e070870 con 0x55585e072d30 2024-09-10T21:57:18.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:18.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e065150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c034040 tx=0x7fbb5c03f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd13f389dd66d307 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb4effd640 1 -- 172.21.15.39:0/3130355550 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c036040 con 0x55585e072d30 2024-09-10T21:57:18.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb4effd640 1 -- 172.21.15.39:0/3130355550 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5c052070 con 0x55585e072d30 2024-09-10T21:57:18.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.062+0000 7fbb4effd640 1 -- 172.21.15.39:0/3130355550 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c03f6e0 con 0x55585e072d30 2024-09-10T21:57:18.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3130355550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 msgr2=0x55585e065150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e065150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c034040 tx=0x7fbb5c03f000 comp rx=0 tx=0).stop 2024-09-10T21:57:18.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3130355550 shutdown_connections 2024-09-10T21:57:18.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e065150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066da0 0x55585e06e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3130355550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066480 0x55585e06e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3130355550 >> 172.21.15.39:0/3130355550 conn(0x55585e0642b0 msgr2=0x55585e06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3130355550 shutdown_connections 2024-09-10T21:57:18.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.063+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3130355550 wait complete. 2024-09-10T21:57:18.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.064+0000 7fbb6d9de740 1 -- start start 2024-09-10T21:57:18.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.064+0000 7fbb6d9de740 1 Processor -- start 2024-09-10T21:57:18.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641b1a50 con 0x55585e066da0 2024-09-10T21:57:18.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641b1380 con 0x55585e072d30 2024-09-10T21:57:18.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641ae5c0 con 0x55585e066480 2024-09-10T21:57:18.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb693a5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55202/0 (socket says 172.21.15.39:55202) 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3599063377 learned_addr learned my addr 172.21.15.39:0/3599063377 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb6d9de740 10 client.0 _ll_register_callbacks cb 0x7fbb6000bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3599063377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 msgr2=0x55585e06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 msgr2=0x55585e06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.065+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb68ba4640 1 -- 172.21.15.39:0/3599063377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55585e07a2f0 con 0x55585e066da0 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb69ba6640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb68ba4640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbb580ac540 tx=0x7fbb58003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df92b204b1837a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:18.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5806e530 con 0x55585e066da0 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbb580e98f0 con 0x55585e066da0 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5c052070 con 0x55585e066da0 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb580abd20 con 0x55585e066da0 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb6d9de740 10 client.16011 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:18.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.066+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55585e0efa80 con 0x55585e066da0 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5c052070 con 0x55585e066da0 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbb5806e210 con 0x55585e066da0 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb6d9de740 10 client.16011 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb6d9de740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb6d9de740 20 client.16011 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.067+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e0efe30 0x55585e0f2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:18.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.068+0000 7fbb6d9de740 4 client.16011 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:57:18.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.068+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55585dfda850 con 0x55585e0efe30 2024-09-10T21:57:18.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.068+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e0efe30 0x55585e0f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:18.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.068+0000 7fbb4cff9640 10 client.16011 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:18.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.068+0000 7fbb693a5640 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e0efe30 0x55585e0f2220 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff22369441ef412 server_cookie=1312886b7f2ac6ca in_seq=0 out_seq=0 2024-09-10T21:57:18.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb4cff9640 1 -- 172.21.15.39:0/3599063377 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1429 (crc 0 0 0) 0x55585dfda850 con 0x55585e0efe30 2024-09-10T21:57:18.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb4cff9640 10 client.16011 handle_command_reply: tid=0 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 client.16011 shutdown 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 msgr2=0x55585e06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbb580ac540 tx=0x7fbb58003e20 comp rx=0 tx=0).stop 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 shutdown_connections 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55585e0efe30 0x55585e0f2220 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55585e072d30 0x55585e06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55585e066da0 0x55585e06d0c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb6d9de740 1 --2- 172.21.15.39:0/3599063377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55585e066480 0x55585e06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.076+0000 7fbb4cff9640 0 client.16011 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.077+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 >> 172.21.15.39:0/3599063377 conn(0x55585e0642b0 msgr2=0x55585e065100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.077+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 shutdown_connections 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.077+0000 7fbb6d9de740 1 -- 172.21.15.39:0/3599063377 wait complete. 2024-09-10T21:57:18.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.077+0000 7fbb6d9de740 20 client.16011 trim_cache size 0 max 16384 2024-09-10T21:57:18.092 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:57:18.092 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (50 inodes in the stack)", 2024-09-10T21:57:18.092 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:57:18.092 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "998a7b51-518d-4b13-8ae6-f313900d2c62", 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:57:18.093 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:18.094 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:18.095 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:18.096 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:57:18.097 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:57:18.098 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:57:18.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.078+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 msgr2=0x7fbb500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.078+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 0x7fbb500b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02abe0 tx=0x7fbb5c009500 comp rx=0 tx=0).stop 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.078+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 msgr2=0x7fbb6419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.078+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6419b950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005fd0 tx=0x7fbb5800ee50 comp rx=0 tx=0).stop 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 shutdown_connections 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbb500b52e0 0x7fbb500b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb6410f3a0 0x7fbb641a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64075e00 0x7fbb6419b950 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 --2- 172.21.15.39:0/3743445080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb640754e0 0x7fbb6419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:18.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.079+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 >> 172.21.15.39:0/3743445080 conn(0x7fbb640fe800 msgr2=0x7fbb64111590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:18.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.080+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 shutdown_connections 2024-09-10T21:57:18.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:18.080+0000 7fbb6b609640 1 -- 172.21.15.39:0/3743445080 wait complete. 2024-09-10T21:57:18.908 INFO:tasks.cephfs.filesystem:scrub status for tag:998a7b51-518d-4b13-8ae6-f313900d2c62 - {'path': '/', 'tag': '998a7b51-518d-4b13-8ae6-f313900d2c62', 'options': 'recursive,force'} 2024-09-10T21:57:19.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:19 smithi070 ceph-mon[34909]: pgmap v410: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 638 op/s 2024-09-10T21:57:19.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:19 smithi039 ceph-mon[30872]: pgmap v410: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 638 op/s 2024-09-10T21:57:19.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:19 smithi173 ceph-mon[35294]: pgmap v410: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 638 op/s 2024-09-10T21:57:19.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.713+0000 7fa059ffb640 1 -- 172.21.15.39:0/2791351218 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa05c02e070 con 0x559be4a32040 2024-09-10T21:57:19.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.713+0000 7fa059ffb640 10 client.25580 handle_command_reply: tid=0 2024-09-10T21:57:19.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.713+0000 7fa07ba91740 1 client.25580 shutdown 2024-09-10T21:57:19.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.713+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 msgr2=0x559be49bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:19.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.713+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa064005210 tx=0x7fa06400f9a0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 shutdown_connections 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x559be4a32040 0x559be4a34460 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be49b0bd0 0x559be49bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559be49ae190 0x559be49bb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 --2- 172.21.15.39:0/2791351218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559be49ab860 0x559be49bc6d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 >> 172.21.15.39:0/2791351218 conn(0x559be49a69b0 msgr2=0x559be49a87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa059ffb640 0 client.25580 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 shutdown_connections 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 1 -- 172.21.15.39:0/2791351218 wait complete. 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.714+0000 7fa07ba91740 20 client.25580 trim_cache size 0 max 16384 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:57:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:57:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 msgr2=0x7fa0600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 0x7fa0600b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d6c0 tx=0x7fa05c00b410 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 msgr2=0x7fa07419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 0x7fa07419a020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa06c031780 tx=0x7fa06c003ba0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 shutdown_connections 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa0600b52e0 0x7fa0600b77a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa074103370 0x7fa07419a020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0741029b0 0x7fa0741993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 --2- 172.21.15.39:0/415948619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa074101860 0x7fa074198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.745+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 >> 172.21.15.39:0/415948619 conn(0x7fa0740fd140 msgr2=0x7fa074105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.746+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 shutdown_connections 2024-09-10T21:57:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:19.746+0000 7fa078be8640 1 -- 172.21.15.39:0/415948619 wait complete. 2024-09-10T21:57:21.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:21 smithi070 ceph-mon[34909]: pgmap v411: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 952 op/s 2024-09-10T21:57:21.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:21 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:57:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:21 smithi039 ceph-mon[30872]: pgmap v411: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 952 op/s 2024-09-10T21:57:21.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:21 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:57:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:21 smithi173 ceph-mon[35294]: pgmap v411: 97 pgs: 97 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 952 op/s 2024-09-10T21:57:21.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:21 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:57:22.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:57:22.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:22 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:57:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:57:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:57:22.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:22 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:57:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:57:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:57:22.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:22 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:23.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:23 smithi070 ceph-mon[34909]: pgmap v412: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 980 op/s 2024-09-10T21:57:23.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:23 smithi039 ceph-mon[30872]: pgmap v412: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 980 op/s 2024-09-10T21:57:23.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:23 smithi173 ceph-mon[35294]: pgmap v412: 97 pgs: 97 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 980 op/s 2024-09-10T21:57:25.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:25 smithi070 ceph-mon[34909]: pgmap v413: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.7 MiB/s wr, 1.20k op/s 2024-09-10T21:57:25.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:25 smithi039 ceph-mon[30872]: pgmap v413: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.7 MiB/s wr, 1.20k op/s 2024-09-10T21:57:25.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:25 smithi173 ceph-mon[35294]: pgmap v413: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.7 MiB/s wr, 1.20k op/s 2024-09-10T21:57:26.500 INFO:tasks.workunit.client.0.smithi039.stdout: 62 548567 320 357288 161 316532 641 2024-09-10T21:57:27.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:27 smithi070 ceph-mon[34909]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-10T21:57:27.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:27 smithi039 ceph-mon[30872]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-10T21:57:27.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:27 smithi173 ceph-mon[35294]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-10T21:57:29.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:29 smithi070 ceph-mon[34909]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-10T21:57:29.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:29 smithi039 ceph-mon[30872]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-10T21:57:29.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:29 smithi173 ceph-mon[35294]: pgmap v415: 97 pgs: 97 active+clean; 174 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-10T21:57:31.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:31 smithi070 ceph-mon[34909]: pgmap v416: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 1.26k op/s 2024-09-10T21:57:31.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:31 smithi039 ceph-mon[30872]: pgmap v416: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 1.26k op/s 2024-09-10T21:57:31.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:31 smithi173 ceph-mon[35294]: pgmap v416: 97 pgs: 97 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 1.26k op/s 2024-09-10T21:57:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 -- 172.21.15.39:0/2524772589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 msgr2=0x7facfc101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2524772589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc101c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facec009860 tx=0x7facec02a340 comp rx=0 tx=0).stop 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 -- 172.21.15.39:0/2524772589 shutdown_connections 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2524772589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc103380 0x7facfc109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2524772589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc1029c0 0x7facfc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2524772589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc101c70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 -- 172.21.15.39:0/2524772589 >> 172.21.15.39:0/2524772589 conn(0x7facfc0fd130 msgr2=0x7facfc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 -- 172.21.15.39:0/2524772589 shutdown_connections 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.872+0000 7fad01e0c640 1 -- 172.21.15.39:0/2524772589 wait complete. 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 Processor -- start 2024-09-10T21:57:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 -- start start 2024-09-10T21:57:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 0x7facfc19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7facfc10d4e0 con 0x7facfc1029c0 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facfc10d360 con 0x7facfc101870 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7fad01e0c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7facfc10d660 con 0x7facfc103380 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7facfaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7facfaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46480/0 (socket says 172.21.15.39:46480) 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.873+0000 7facfaffd640 1 -- 172.21.15.39:0/2248203361 learned_addr learned my addr 172.21.15.39:0/2248203361 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfbfff640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 0x7facfc19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 -- 172.21.15.39:0/2248203361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 msgr2=0x7facfc19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 0x7facfc19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 -- 172.21.15.39:0/2248203361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 msgr2=0x7facfc198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 -- 172.21.15.39:0/2248203361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc19a8e0 con 0x7facfc1029c0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfb7fe640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfbfff640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 0x7facfc19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facfaffd640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7facf000e9f0 tx=0x7facf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facf8ff9640 1 -- 172.21.15.39:0/2248203361 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf000cd80 con 0x7facfc1029c0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc19abd0 con 0x7facfc1029c0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facf8ff9640 1 -- 172.21.15.39:0/2248203361 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf00054d0 con 0x7facfc1029c0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7facf8ff9640 1 -- 172.21.15.39:0/2248203361 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0010690 con 0x7facfc1029c0 2024-09-10T21:57:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.874+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc1a12a0 con 0x7facfc1029c0 2024-09-10T21:57:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 Processor -- start 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facf8ff9640 1 -- 172.21.15.39:0/2248203361 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7facf0004e90 con 0x7facfc1029c0 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 -- start start 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624317ff860 0x562431801c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562431804bd0 0x562431807090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5624317716f0 con 0x562431802190 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562431760b20 con 0x562431804bd0 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7fad04bda740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562431764930 con 0x5624317ff860 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facfaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562431804bd0 0x562431807090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46496/0 (socket says 172.21.15.39:46496) 2024-09-10T21:57:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facfb7fe640 1 -- 172.21.15.39:0/1829233627 learned_addr learned my addr 172.21.15.39:0/1829233627 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.877+0000 7facfbfff640 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624317ff860 0x562431801c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 -- 172.21.15.39:0/1829233627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624317ff860 msgr2=0x562431801c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624317ff860 0x562431801c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 -- 172.21.15.39:0/1829233627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562431804bd0 msgr2=0x562431807090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562431804bd0 0x562431807090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 -- 172.21.15.39:0/1829233627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562431726530 con 0x562431802190 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facf8ff9640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 0x7face40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfb7fe640 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7facec009860 tx=0x7facec005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712362d84fd11861 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facf8ff9640 1 -- 172.21.15.39:0/2248203361 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7facf00e5fe0 con 0x7facfc1029c0 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7facfbfff640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 0x7face40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7face1ffb640 1 -- 172.21.15.39:0/1829233627 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec037040 con 0x562431802190 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7face1ffb640 1 -- 172.21.15.39:0/1829233627 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facec030dc0 con 0x562431802190 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.878+0000 7face1ffb640 1 -- 172.21.15.39:0/1829233627 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec032b70 con 0x562431802190 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 -- 172.21.15.39:0/1829233627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 msgr2=0x562431804580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7facfbfff640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 0x7face40b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7facfc199b20 tx=0x7facf4011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7facec009860 tx=0x7facec005dc0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 -- 172.21.15.39:0/1829233627 shutdown_connections 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562431804bd0 0x562431807090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431804580 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 --2- 172.21.15.39:0/1829233627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624317ff860 0x562431801c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 -- 172.21.15.39:0/1829233627 >> 172.21.15.39:0/1829233627 conn(0x5624317fa9b0 msgr2=0x5624317fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 -- 172.21.15.39:0/1829233627 shutdown_connections 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.879+0000 7fad04bda740 1 -- 172.21.15.39:0/1829233627 wait complete. 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 -- start start 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 Processor -- start 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x562431808e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431809500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431804bd0 0x56243180a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562431698ab0 con 0x562431802190 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562431706730 con 0x5624317ff860 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562431807b50 con 0x562431804bd0 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7fad04bda740 10 client.0 _ll_register_callbacks cb 0x56243175a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7facfaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431809500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x562431808e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x562431808e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:50042/0 (socket says 172.21.15.39:50042) 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7facfb7fe640 1 -- 172.21.15.39:0/3265999909 learned_addr learned my addr 172.21.15.39:0/3265999909 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.880+0000 7facfbfff640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431804bd0 0x56243180a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 -- 172.21.15.39:0/3265999909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431804bd0 msgr2=0x56243180a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431804bd0 0x56243180a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 -- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 msgr2=0x562431808e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x562431808e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 -- 172.21.15.39:0/3265999909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624314c2790 con 0x562431802190 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facfaffd640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431809500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facf00e3be0 tx=0x7facf0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c6c01ec7c6e63f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf00ac620 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7facf00b5950 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facec030dc0 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facf00abfc0 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7fad04bda740 10 client.16023 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56243153b620 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.881+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facec030dc0 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7facf00e80d0 con 0x562431802190 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 10 client.16023 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 20 client.16023 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624318147c0 0x562431816be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 4 client.16023 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562431773640 con 0x5624318147c0 2024-09-10T21:57:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.882+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624318147c0 0x562431816be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.883+0000 7facdaffd640 10 client.16023 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.883+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624318147c0 0x562431816be0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63bb85bec9a6d31c server_cookie=2bbe0726629774cc in_seq=0 out_seq=0 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7facdaffd640 1 -- 172.21.15.39:0/3265999909 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562431773640 con 0x5624318147c0 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7facdaffd640 10 client.16023 handle_command_reply: tid=0 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 client.16023 shutdown 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 msgr2=0x562431809500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431809500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facf00e3be0 tx=0x7facf0009310 comp rx=0 tx=0).stop 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 shutdown_connections 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5624318147c0 0x562431816be0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431804bd0 0x56243180a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431802190 0x562431809500 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 --2- 172.21.15.39:0/3265999909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x562431808e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 >> 172.21.15.39:0/3265999909 conn(0x5624317fa9b0 msgr2=0x5624317f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7facdaffd640 0 client.16023 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 shutdown_connections 2024-09-10T21:57:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 1 -- 172.21.15.39:0/3265999909 wait complete. 2024-09-10T21:57:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.886+0000 7fad04bda740 20 client.16023 trim_cache size 0 max 16384 2024-09-10T21:57:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 Processor -- start 2024-09-10T21:57:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 -- start start 2024-09-10T21:57:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x56243180a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x5624318167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1a9e80 con 0x562431804bd0 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1aba80 con 0x5624317ff860 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7fad04bda740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1aa550 con 0x562431802190 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7facfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7facfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46514/0 (socket says 172.21.15.39:46514) 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7facfbfff640 1 -- 172.21.15.39:0/1087642300 learned_addr learned my addr 172.21.15.39:0/1087642300 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.903+0000 7facfb7fe640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x56243180a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfaffd640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x5624318167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 -- 172.21.15.39:0/1087642300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 msgr2=0x5624318167d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x5624318167d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 -- 172.21.15.39:0/1087642300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 msgr2=0x56243180a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x56243180a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 -- 172.21.15.39:0/1087642300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562431801fc0 con 0x562431804bd0 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfaffd640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x5624318167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7facfbfff640 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7facf400b770 tx=0x7facf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae694cfc4d0e527 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7face17fa640 1 -- 172.21.15.39:0/1087642300 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4021050 con 0x562431804bd0 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7face17fa640 1 -- 172.21.15.39:0/1087642300 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf4022040 con 0x562431804bd0 2024-09-10T21:57:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.904+0000 7face17fa640 1 -- 172.21.15.39:0/1087642300 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4005260 con 0x562431804bd0 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- 172.21.15.39:0/1087642300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 msgr2=0x562431807f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7facf400b770 tx=0x7facf4017000 comp rx=0 tx=0).stop 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- 172.21.15.39:0/1087642300 shutdown_connections 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x562431807f20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x5624318167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 --2- 172.21.15.39:0/1087642300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x56243180a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- 172.21.15.39:0/1087642300 >> 172.21.15.39:0/1087642300 conn(0x5624317fa9b0 msgr2=0x5624317fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- 172.21.15.39:0/1087642300 shutdown_connections 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- 172.21.15.39:0/1087642300 wait complete. 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.905+0000 7fad04bda740 1 -- start start 2024-09-10T21:57:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 Processor -- start 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x5624318108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x56243180f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1ab2f0 con 0x562431804bd0 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1aac20 con 0x5624317ff860 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1a7e60 con 0x562431802190 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7fad04bda740 10 client.0 _ll_register_callbacks cb 0x7facf00a6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46530/0 (socket says 172.21.15.39:46530) 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 -- 172.21.15.39:0/3750409214 learned_addr learned my addr 172.21.15.39:0/3750409214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x5624318108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfaffd640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x56243180f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 -- 172.21.15.39:0/3750409214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 msgr2=0x56243180f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x56243180f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 -- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 msgr2=0x5624318108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x5624318108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfbfff640 1 -- 172.21.15.39:0/3750409214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562431810280 con 0x562431804bd0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.906+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x5624318108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facfbfff640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7facf400b5e0 tx=0x7facf400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cdd1ebb3eacc4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4034070 con 0x562431804bd0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf4022040 con 0x562431804bd0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7facf4004a40 con 0x562431804bd0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7facf4021020 con 0x562431804bd0 2024-09-10T21:57:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7fad04bda740 10 client.16029 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5624318817b0 con 0x562431804bd0 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.907+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf4022040 con 0x562431804bd0 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7facf400b040 con 0x562431804bd0 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 10 client.16029 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 20 client.16029 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562431882200 0x562431884620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 4 client.16029 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56243176f0f0 con 0x562431882200 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562431882200 0x562431884620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7facdaffd640 10 client.16029 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:32.908+0000 7facfb7fe640 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562431882200 0x562431884620 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1794e93384611d3a server_cookie=c17a4fca843306fc in_seq=0 out_seq=0 2024-09-10T21:57:33.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:33 smithi070 ceph-mon[34909]: pgmap v417: 97 pgs: 97 active+clean; 194 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 977 op/s 2024-09-10T21:57:33.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:33 smithi039 ceph-mon[30872]: pgmap v417: 97 pgs: 97 active+clean; 194 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 977 op/s 2024-09-10T21:57:33.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:33 smithi173 ceph-mon[35294]: pgmap v417: 97 pgs: 97 active+clean; 194 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 977 op/s 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7facdaffd640 1 -- 172.21.15.39:0/3750409214 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56243176f0f0 con 0x562431882200 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7facdaffd640 10 client.16029 handle_command_reply: tid=0 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 client.16029 shutdown 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 msgr2=0x56243180faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7facf400b5e0 tx=0x7facf400f040 comp rx=0 tx=0).stop 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 shutdown_connections 2024-09-10T21:57:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x562431882200 0x562431884620 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562431804bd0 0x56243180faf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562431802190 0x56243180f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7facdaffd640 0 client.16029 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 --2- 172.21.15.39:0/3750409214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624317ff860 0x5624318108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 >> 172.21.15.39:0/3750409214 conn(0x5624317fa9b0 msgr2=0x562431807f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 shutdown_connections 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 1 -- 172.21.15.39:0/3750409214 wait complete. 2024-09-10T21:57:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.976+0000 7fad04bda740 20 client.16029 trim_cache size 0 max 16384 2024-09-10T21:57:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:57:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:57:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:57:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 msgr2=0x7face40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 0x7face40b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7facfc199b20 tx=0x7facf4011040 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 msgr2=0x7facfc1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7facf000e9f0 tx=0x7facf000edf0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 shutdown_connections 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7face40b52e0 0x7face40b77a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facfc103380 0x7facfc19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facfc1029c0 0x7facfc1993f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 --2- 172.21.15.39:0/2248203361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facfc101870 0x7facfc198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 >> 172.21.15.39:0/2248203361 conn(0x7facfc0fd130 msgr2=0x7facfc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 shutdown_connections 2024-09-10T21:57:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:33.977+0000 7fad01e0c640 1 -- 172.21.15.39:0/2248203361 wait complete. 2024-09-10T21:57:35.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:35 smithi070 ceph-mon[34909]: pgmap v418: 97 pgs: 97 active+clean; 228 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 1.51k op/s 2024-09-10T21:57:35.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:35 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:35 smithi039 ceph-mon[30872]: pgmap v418: 97 pgs: 97 active+clean; 228 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 1.51k op/s 2024-09-10T21:57:35.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:35 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:35 smithi173 ceph-mon[35294]: pgmap v418: 97 pgs: 97 active+clean; 228 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 1.51k op/s 2024-09-10T21:57:35.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:35 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:57:36.501 INFO:tasks.workunit.client.0.smithi039.stdout: 62 1382 1 510 2 445 4 2024-09-10T21:57:37.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:37 smithi070 ceph-mon[34909]: pgmap v419: 97 pgs: 97 active+clean; 233 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.44k op/s 2024-09-10T21:57:37.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:37 smithi039 ceph-mon[30872]: pgmap v419: 97 pgs: 97 active+clean; 233 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.44k op/s 2024-09-10T21:57:37.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:37 smithi173 ceph-mon[35294]: pgmap v419: 97 pgs: 97 active+clean; 233 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.44k op/s 2024-09-10T21:57:39.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:39 smithi070 ceph-mon[34909]: pgmap v420: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 1.60k op/s 2024-09-10T21:57:39.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:39 smithi039 ceph-mon[30872]: pgmap v420: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 1.60k op/s 2024-09-10T21:57:39.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:39 smithi173 ceph-mon[35294]: pgmap v420: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 MiB/s wr, 1.60k op/s 2024-09-10T21:57:41.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:41 smithi070 ceph-mon[34909]: pgmap v421: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 1.69k op/s 2024-09-10T21:57:41.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:41 smithi039 ceph-mon[30872]: pgmap v421: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 1.69k op/s 2024-09-10T21:57:41.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:41 smithi173 ceph-mon[35294]: pgmap v421: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 1.69k op/s 2024-09-10T21:57:43.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:43 smithi070 ceph-mon[34909]: pgmap v422: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 1.40k op/s 2024-09-10T21:57:43.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:43 smithi039 ceph-mon[30872]: pgmap v422: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 1.40k op/s 2024-09-10T21:57:43.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:43 smithi173 ceph-mon[35294]: pgmap v422: 97 pgs: 97 active+clean; 214 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 1.40k op/s 2024-09-10T21:57:45.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:45 smithi070 ceph-mon[34909]: pgmap v423: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.44k op/s 2024-09-10T21:57:45.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:45 smithi039 ceph-mon[30872]: pgmap v423: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.44k op/s 2024-09-10T21:57:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:45 smithi173 ceph-mon[35294]: pgmap v423: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.44k op/s 2024-09-10T21:57:46.500 INFO:tasks.workunit.client.0.smithi039.stdout: 64 9655 77 6387 103 5213 221 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.069+0000 7f01901ad640 1 -- 172.21.15.39:0/2738207171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f018806b470 msgr2=0x7f0188105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.069+0000 7f01901ad640 1 --2- 172.21.15.39:0/2738207171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f018806b470 0x7f0188105530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0184009900 tx=0x7f018402a410 comp rx=0 tx=0).stop 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 -- 172.21.15.39:0/2738207171 shutdown_connections 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 --2- 172.21.15.39:0/2738207171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 0x7f018810ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 --2- 172.21.15.39:0/2738207171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188105ac0 0x7f0188107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 --2- 172.21.15.39:0/2738207171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f018806b470 0x7f0188105530 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 -- 172.21.15.39:0/2738207171 >> 172.21.15.39:0/2738207171 conn(0x7f01880fd140 msgr2=0x7f01880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 -- 172.21.15.39:0/2738207171 shutdown_connections 2024-09-10T21:57:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 -- 172.21.15.39:0/2738207171 wait complete. 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 Processor -- start 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.070+0000 7f01901ad640 1 -- start start 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f018806b470 0x7f018819b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 0x7f018819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0188110820 con 0x7f0188105ac0 2024-09-10T21:57:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01881106a0 con 0x7f0188108670 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f01901ad640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01881109a0 con 0x7f018806b470 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52962/0 (socket says 172.21.15.39:52962) 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 -- 172.21.15.39:0/2365949167 learned_addr learned my addr 172.21.15.39:0/2365949167 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018e74a640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 0x7f018819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018df49640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f018806b470 0x7f018819b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 -- 172.21.15.39:0/2365949167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f018806b470 msgr2=0x7f018819b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f018806b470 0x7f018819b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 -- 172.21.15.39:0/2365949167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 msgr2=0x7f018819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 0x7f018819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 -- 172.21.15.39:0/2365949167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018819caf0 con 0x7f0188105ac0 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.071+0000 7f018d748640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f017800c970 tx=0x7f017800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.072+0000 7f017effd640 1 -- 172.21.15.39:0/2365949167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178007bb0 con 0x7f0188105ac0 2024-09-10T21:57:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.072+0000 7f017effd640 1 -- 172.21.15.39:0/2365949167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178007d50 con 0x7f0188105ac0 2024-09-10T21:57:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.072+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018819cde0 con 0x7f0188105ac0 2024-09-10T21:57:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.072+0000 7f017effd640 1 -- 172.21.15.39:0/2365949167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017800f450 con 0x7f0188105ac0 2024-09-10T21:57:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.072+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01881a34b0 con 0x7f0188105ac0 2024-09-10T21:57:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.074+0000 7f017effd640 1 -- 172.21.15.39:0/2365949167 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0178004f20 con 0x7f0188105ac0 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 Processor -- start 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 -- start start 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f017effd640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 0x7f01740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f98580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f98bd0 0x563fb6f9b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563fb6f056f0 con 0x563fb6f93860 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563fb6ef4b20 con 0x563fb6f96190 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.075+0000 7f019305a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fb6ef8930 con 0x563fb6f98bd0 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018e74a640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 0x7f01740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018d748640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52964/0 (socket says 172.21.15.39:52964) 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 -- 172.21.15.39:0/2952707691 learned_addr learned my addr 172.21.15.39:0/2952707691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f017effd640 1 -- 172.21.15.39:0/2365949167 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f01780e5890 con 0x7f0188105ac0 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018e74a640 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f98bd0 0x563fb6f9b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 -- 172.21.15.39:0/2952707691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f98bd0 msgr2=0x563fb6f9b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f98bd0 0x563fb6f9b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 -- 172.21.15.39:0/2952707691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 msgr2=0x563fb6f98580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f98580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 -- 172.21.15.39:0/2952707691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb6eba530 con 0x563fb6f93860 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018d748640 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f98580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018df49640 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0184009230 tx=0x7f0184004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e289b86df8afff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f018e74a640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 0x7f01740b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f018819bda0 tx=0x7f0180009be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f0173fff640 1 -- 172.21.15.39:0/2952707691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184035030 con 0x563fb6f93860 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f0173fff640 1 -- 172.21.15.39:0/2952707691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01840046c0 con 0x563fb6f93860 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.076+0000 7f0173fff640 1 -- 172.21.15.39:0/2952707691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184003850 con 0x563fb6f93860 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 -- 172.21.15.39:0/2952707691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 msgr2=0x563fb6f95c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0184009230 tx=0x7f0184004390 comp rx=0 tx=0).stop 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 -- 172.21.15.39:0/2952707691 shutdown_connections 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f98bd0 0x563fb6f9b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f98580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 --2- 172.21.15.39:0/2952707691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f93860 0x563fb6f95c50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 -- 172.21.15.39:0/2952707691 >> 172.21.15.39:0/2952707691 conn(0x563fb6f8e9b0 msgr2=0x563fb6f8f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 -- 172.21.15.39:0/2952707691 shutdown_connections 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.077+0000 7f019305a740 1 -- 172.21.15.39:0/2952707691 wait complete. 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 -- start start 2024-09-10T21:57:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 Processor -- start 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f96190 0x563fb6f9d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563fb6e2cab0 con 0x563fb6f98bd0 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563fb6e9a730 con 0x563fb6f93860 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fb6f9bb50 con 0x563fb6f96190 2024-09-10T21:57:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f019305a740 10 client.0 _ll_register_callbacks cb 0x563fb6eee6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018e74a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018df49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018df49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51672/0 (socket says 172.21.15.39:51672) 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018e74a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52976/0 (socket says 172.21.15.39:52976) 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018df49640 1 -- 172.21.15.39:0/297520437 learned_addr learned my addr 172.21.15.39:0/297520437 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.078+0000 7f018d748640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f96190 0x563fb6f9d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 -- 172.21.15.39:0/297520437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f96190 msgr2=0x563fb6f9d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f96190 0x563fb6f9d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 -- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 msgr2=0x563fb6f9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 -- 172.21.15.39:0/297520437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb6c56790 con 0x563fb6f98bd0 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018df49640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f018e74a640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0180010a60 tx=0x7f01800096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdae74951a445a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f01717fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180025070 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01840046c0 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0180012be0 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0180012de0 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f019305a740 10 client.16041 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fb6ccf620 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.079+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01840046c0 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f018001e040 con 0x563fb6f98bd0 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 10 client.16041 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 20 client.16041 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb6fa8880 0x563fb6faad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 4 client.16041 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fb6f07640 con 0x563fb6fa8880 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f018df49640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb6fa8880 0x563fb6faad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f01717fa640 10 client.16041 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.080+0000 7f018df49640 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb6fa8880 0x563fb6faad10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff59429a7d01da4 server_cookie=9dd2eedd8f37139b in_seq=0 out_seq=0 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.081+0000 7f01717fa640 1 -- 172.21.15.39:0/297520437 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fb6f07640 con 0x563fb6fa8880 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.081+0000 7f01717fa640 10 client.16041 handle_command_reply: tid=0 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.081+0000 7f019305a740 1 client.16041 shutdown 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 msgr2=0x563fb6f9e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0180010a60 tx=0x7f01800096a0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 shutdown_connections 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb6fa8880 0x563fb6faad10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f9e0e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f96190 0x563fb6f9d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 --2- 172.21.15.39:0/297520437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f93860 0x563fb6f9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f01717fa640 0 client.16041 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 >> 172.21.15.39:0/297520437 conn(0x563fb6f8e9b0 msgr2=0x563fb6f8dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 shutdown_connections 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 1 -- 172.21.15.39:0/297520437 wait complete. 2024-09-10T21:57:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.082+0000 7f019305a740 20 client.16041 trim_cache size 0 max 16384 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 Processor -- start 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 -- start start 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6faac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f92d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01881abfb0 con 0x563fb6f98bd0 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01881adbb0 con 0x563fb6f96190 2024-09-10T21:57:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f019305a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ac680 con 0x563fb6f93860 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52980/0 (socket says 172.21.15.39:52980) 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 -- 172.21.15.39:0/3219606701 learned_addr learned my addr 172.21.15.39:0/3219606701 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018d748640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f92d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018df49640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6faac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 -- 172.21.15.39:0/3219606701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 msgr2=0x563fb6faac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6faac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 -- 172.21.15.39:0/3219606701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 msgr2=0x563fb6f92d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f92d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018e74a640 1 -- 172.21.15.39:0/3219606701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb6f9d880 con 0x563fb6f98bd0 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.097+0000 7f018d748640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f92d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f018e74a640 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0180015040 tx=0x7f0180004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62df019cb24bbdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f01737fe640 1 -- 172.21.15.39:0/3219606701 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180025070 con 0x563fb6f98bd0 2024-09-10T21:57:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f01737fe640 1 -- 172.21.15.39:0/3219606701 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0180012820 con 0x563fb6f98bd0 2024-09-10T21:57:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f01737fe640 1 -- 172.21.15.39:0/3219606701 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180021c80 con 0x563fb6f98bd0 2024-09-10T21:57:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 -- 172.21.15.39:0/3219606701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 msgr2=0x563fb6f93290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0180015040 tx=0x7f0180004820 comp rx=0 tx=0).stop 2024-09-10T21:57:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 -- 172.21.15.39:0/3219606701 shutdown_connections 2024-09-10T21:57:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f98bd0 0x563fb6f93290 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f96190 0x563fb6f92d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 --2- 172.21.15.39:0/3219606701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6faac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.098+0000 7f019305a740 1 -- 172.21.15.39:0/3219606701 >> 172.21.15.39:0/3219606701 conn(0x563fb6f8e9b0 msgr2=0x563fb6f8f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- 172.21.15.39:0/3219606701 shutdown_connections 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- 172.21.15.39:0/3219606701 wait complete. 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- start start 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 Processor -- start 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6fa1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f98bd0 0x563fb6fa3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ad420 con 0x563fb6f96190 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01881acd50 con 0x563fb6f98bd0 2024-09-10T21:57:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01881a9f90 con 0x563fb6f93860 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f019305a740 10 client.0 _ll_register_callbacks cb 0x7f0180009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f018d748640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f018d748640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52982/0 (socket says 172.21.15.39:52982) 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f018d748640 1 -- 172.21.15.39:0/2398226159 learned_addr learned my addr 172.21.15.39:0/2398226159 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.099+0000 7f018e74a640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f98bd0 0x563fb6fa3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018df49640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6fa1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 -- 172.21.15.39:0/2398226159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 msgr2=0x563fb6fa1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6fa1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 -- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f98bd0 msgr2=0x563fb6fa3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f98bd0 0x563fb6fa3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 -- 172.21.15.39:0/2398226159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb6fa3950 con 0x563fb6f96190 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f018d748640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f01780e33a0 tx=0x7f01780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d79822632e6930 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017801d040 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f01780b5160 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0180012820 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f01780ac060 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 10 client.16047 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fb6fa4d90 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0180012820 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f01780a79d0 con 0x563fb6f96190 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 10 client.16047 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.100+0000 7f019305a740 20 client.16047 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb7015d60 0x563fb7018180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f019305a740 4 client.16047 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:57:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fb6f030f0 con 0x563fb7015d60 2024-09-10T21:57:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f018df49640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb7015d60 0x563fb7018180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f018df49640 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb7015d60 0x563fb7018180 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad8b0b88511aee29 server_cookie=211f5ced9f9f0a6d in_seq=0 out_seq=0 2024-09-10T21:57:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:47.101+0000 7f01717fa640 10 client.16047 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:47.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: pgmap v424: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 843 op/s 2024-09-10T21:57:47.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:57:47.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:57:47.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:57:47.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:57:47.409 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: pgmap v424: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 843 op/s 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:57:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:57:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: pgmap v424: 97 pgs: 97 active+clean; 224 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 843 op/s 2024-09-10T21:57:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:57:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:57:47.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:57:47.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:57:47.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:57:48.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:57:49.182 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:49.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:49 smithi039 ceph-mon[30872]: pgmap v425: 97 pgs: 97 active+clean; 226 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 683 op/s 2024-09-10T21:57:49.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:49 smithi070 ceph-mon[34909]: pgmap v425: 97 pgs: 97 active+clean; 226 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 683 op/s 2024-09-10T21:57:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:49 smithi173 ceph-mon[35294]: pgmap v425: 97 pgs: 97 active+clean; 226 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 683 op/s 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 -- 172.21.15.39:0/1123355672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c103ca0 msgr2=0x7f4b0c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 --2- 172.21.15.39:0/1123355672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c104080 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009900 tx=0x7f4afc02a410 comp rx=0 tx=0).stop 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 -- 172.21.15.39:0/1123355672 shutdown_connections 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 --2- 172.21.15.39:0/1123355672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c10d100 0x7f4b0c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 --2- 172.21.15.39:0/1123355672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 --2- 172.21.15.39:0/1123355672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c104080 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 -- 172.21.15.39:0/1123355672 >> 172.21.15.39:0/1123355672 conn(0x7f4b0c0fd700 msgr2=0x7f4b0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 -- 172.21.15.39:0/1123355672 shutdown_connections 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.795+0000 7f4b127d6640 1 -- 172.21.15.39:0/1123355672 wait complete. 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 Processor -- start 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 -- start start 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c10d100 0x7f4b0c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112d70 con 0x7f4b0c1045c0 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112bf0 con 0x7f4b0c103ca0 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b127d6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112ef0 con 0x7f4b0c10d100 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44952/0 (socket says 172.21.15.39:44952) 2024-09-10T21:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 -- 172.21.15.39:0/3657489902 learned_addr learned my addr 172.21.15.39:0/3657489902 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c10d100 0x7f4b0c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 -- 172.21.15.39:0/3657489902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c10d100 msgr2=0x7f4b0c1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c10d100 0x7f4b0c1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 -- 172.21.15.39:0/3657489902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c103ca0 msgr2=0x7f4b0c101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.796+0000 7f4b03fff640 1 -- 172.21.15.39:0/3657489902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c1a7620 con 0x7f4b0c1045c0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c970 tx=0x7f4af400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b09ffb640 1 -- 172.21.15.39:0/3657489902 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4007bb0 con 0x7f4b0c1045c0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b09ffb640 1 -- 172.21.15.39:0/3657489902 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af4007d50 con 0x7f4b0c1045c0 2024-09-10T21:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b09ffb640 1 -- 172.21.15.39:0/3657489902 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af400f7b0 con 0x7f4b0c1045c0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c1a7910 con 0x7f4b0c1045c0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.797+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c1a7ea0 con 0x7f4b0c1045c0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.799+0000 7f4b14bab740 1 Processor -- start 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.799+0000 7f4b09ffb640 1 -- 172.21.15.39:0/3657489902 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4af4018480 con 0x7f4b0c1045c0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.799+0000 7f4b14bab740 1 -- start start 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 0x5603669fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669fad30 0x5603669fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560366964e50 con 0x5603669ee480 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560366954280 con 0x5603669eeda0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b14bab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560366958090 con 0x5603669fad30 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44964/0 (socket says 172.21.15.39:44964) 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 -- 172.21.15.39:0/3159525138 learned_addr learned my addr 172.21.15.39:0/3159525138 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 0x5603669fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669fad30 0x5603669fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 -- 172.21.15.39:0/3159525138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669fad30 msgr2=0x5603669fd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669fad30 0x5603669fd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 -- 172.21.15.39:0/3159525138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 msgr2=0x5603669fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 0x5603669fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 -- 172.21.15.39:0/3159525138 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603666b2650 con 0x5603669ee480 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 0x5603669fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b09ffb640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 0x7f4af80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.800+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009f80 tx=0x7f4b04010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7829388dd3dcc68c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 0x7f4af80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b027fc640 1 -- 172.21.15.39:0/3159525138 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04003b70 con 0x5603669ee480 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b09ffb640 1 -- 172.21.15.39:0/3657489902 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4af40e5e00 con 0x7f4b0c1045c0 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b027fc640 1 -- 172.21.15.39:0/3159525138 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04003d10 con 0x5603669ee480 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b027fc640 1 -- 172.21.15.39:0/3159525138 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040119c0 con 0x5603669ee480 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b14bab740 1 -- 172.21.15.39:0/3159525138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 msgr2=0x5603669ee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 0x7f4af80b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031440 tx=0x7f4afc032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.801+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009f80 tx=0x7f4b04010860 comp rx=0 tx=0).stop 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 -- 172.21.15.39:0/3159525138 shutdown_connections 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669fad30 0x5603669fd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669eeda0 0x5603669fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3159525138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669ee860 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 -- 172.21.15.39:0/3159525138 >> 172.21.15.39:0/3159525138 conn(0x5603669ec2b0 msgr2=0x5603669ed450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 -- 172.21.15.39:0/3159525138 shutdown_connections 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 -- 172.21.15.39:0/3159525138 wait complete. 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 -- start start 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 Processor -- start 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669ee480 0x5603669fa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.802+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5603667b5700 con 0x5603669eeda0 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603668ef110 con 0x5603669fad30 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603669fd9b0 con 0x5603669ee480 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 10 client.0 _ll_register_callbacks cb 0x560366908990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44974/0 (socket says 172.21.15.39:44974) 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 -- 172.21.15.39:0/3848530509 learned_addr learned my addr 172.21.15.39:0/3848530509 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669ee480 0x5603669fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 -- 172.21.15.39:0/3848530509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669ee480 msgr2=0x5603669fa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669ee480 0x5603669fa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 -- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 msgr2=0x5603669f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 -- 172.21.15.39:0/3848530509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56036691cc40 con 0x5603669eeda0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4af40a8c30 tx=0x7f4af400a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16d333ecacd2276 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4aeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40ac430 con 0x5603669eeda0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4af40b58d0 con 0x5603669eeda0 2024-09-10T21:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.803+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b04003d10 con 0x5603669eeda0 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4af40abdd0 con 0x5603669eeda0 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 10 client.16059 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560366a09370 con 0x5603669eeda0 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04003d10 con 0x5603669eeda0 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4af40b3340 con 0x5603669eeda0 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 10 client.16059 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 20 client.16059 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a0a880 0x560366a0cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 4 client.16059 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560366966da0 con 0x560366a0a880 2024-09-10T21:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.804+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a0a880 0x560366a0cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.805+0000 7f4aeb7fe640 10 client.16059 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.805+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a0a880 0x560366a0cc70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e8b5f442631763 server_cookie=f85e381f01f7e6dc in_seq=0 out_seq=0 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3848530509 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560366966da0 con 0x560366a0a880 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4aeb7fe640 10 client.16059 handle_command_reply: tid=0 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 client.16059 shutdown 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 msgr2=0x5603669f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4af40a8c30 tx=0x7f4af400a4a0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 shutdown_connections 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a0a880 0x560366a0cc70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669eeda0 0x5603669f7aa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3848530509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669ee480 0x5603669fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 >> 172.21.15.39:0/3848530509 conn(0x5603669ec2b0 msgr2=0x5603669f1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.806+0000 7f4aeb7fe640 0 client.16059 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.807+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 shutdown_connections 2024-09-10T21:57:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.807+0000 7f4b14bab740 1 -- 172.21.15.39:0/3848530509 wait complete. 2024-09-10T21:57:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.807+0000 7f4b14bab740 20 client.16059 trim_cache size 0 max 16384 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 Processor -- start 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 -- start start 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a06be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669fc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1b04c0 con 0x5603669ee480 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1b20c0 con 0x5603669fad30 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b14bab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1b0b90 con 0x5603669eeda0 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44982/0 (socket says 172.21.15.39:44982) 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b0bfff640 1 -- 172.21.15.39:0/1924747492 learned_addr learned my addr 172.21.15.39:0/1924747492 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b10d73640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b03fff640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a06be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.827+0000 7f4b10d73640 1 -- 172.21.15.39:0/1924747492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 msgr2=0x560366a06be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b10d73640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a06be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b10d73640 1 -- 172.21.15.39:0/1924747492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 msgr2=0x5603669edaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b10d73640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b10d73640 1 -- 172.21.15.39:0/1924747492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603669f5fa0 con 0x5603669fad30 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b10d73640 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669fc120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006010 tx=0x7f4b04009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f5d1edfb7dda0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b01ffb640 1 -- 172.21.15.39:0/1924747492 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04003bf0 con 0x5603669fad30 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b01ffb640 1 -- 172.21.15.39:0/1924747492 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04003d90 con 0x5603669fad30 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.828+0000 7f4b01ffb640 1 -- 172.21.15.39:0/1924747492 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04005400 con 0x5603669fad30 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 -- 172.21.15.39:0/1924747492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 msgr2=0x5603669fc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669fc120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006010 tx=0x7f4b04009240 comp rx=0 tx=0).stop 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 -- 172.21.15.39:0/1924747492 shutdown_connections 2024-09-10T21:57:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669fad30 0x5603669fc120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a06be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 --2- 172.21.15.39:0/1924747492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669ee480 0x5603669edaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 -- 172.21.15.39:0/1924747492 >> 172.21.15.39:0/1924747492 conn(0x5603669ec2b0 msgr2=0x5603669ed3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 -- 172.21.15.39:0/1924747492 shutdown_connections 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.829+0000 7f4b14bab740 1 -- 172.21.15.39:0/1924747492 wait complete. 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 -- start start 2024-09-10T21:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 Processor -- start 2024-09-10T21:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a03370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 0x5603669fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1b1930 con 0x5603669fad30 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1b1260 con 0x5603669ee480 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c1ae4a0 con 0x5603669eeda0 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b14bab740 10 client.0 _ll_register_callbacks cb 0x7f4af40e93f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b10d73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 0x5603669fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42102/0 (socket says 172.21.15.39:42102) 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b0bfff640 1 -- 172.21.15.39:0/3275092083 learned_addr learned my addr 172.21.15.39:0/3275092083 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.830+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a03370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 -- 172.21.15.39:0/3275092083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 msgr2=0x560366a03370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a03370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 -- 172.21.15.39:0/3275092083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 msgr2=0x5603669fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 0x5603669fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 -- 172.21.15.39:0/3275092083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603669fe310 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b10d73640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 0x5603669fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b0bfff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031890 tx=0x7f4afc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17c22d333b7c36b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4aeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc05f060 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4afc005040 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b04003d90 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4afc035040 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b14bab740 10 client.25670 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.831+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560366a781b0 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04003d90 con 0x5603669ee480 2024-09-10T21:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4afc0035f0 con 0x5603669ee480 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 10 client.25670 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 10 client.25670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 20 client.25670 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a789d0 0x560366a7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 4 client.25670 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560366962850 con 0x560366a789d0 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a789d0 0x560366a7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4aeb7fe640 10 client.25670 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.832+0000 7f4b03fff640 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a789d0 0x560366a7adf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45752a550889096a server_cookie=2358ad24183c1ff6 in_seq=0 out_seq=0 2024-09-10T21:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4aeb7fe640 1 -- 172.21.15.39:0/3275092083 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x560366962850 con 0x560366a789d0 2024-09-10T21:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4aeb7fe640 10 client.25670 handle_command_reply: tid=0 2024-09-10T21:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 client.25670 shutdown 2024-09-10T21:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 msgr2=0x560366a02e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031890 tx=0x7f4afc009260 comp rx=0 tx=0).stop 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 shutdown_connections 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560366a789d0 0x560366a7adf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603669fad30 0x5603669fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603669eeda0 0x560366a03370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 --2- 172.21.15.39:0/3275092083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5603669ee480 0x560366a02e30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 >> 172.21.15.39:0/3275092083 conn(0x5603669ec2b0 msgr2=0x5603669eabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4aeb7fe640 0 client.25670 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 shutdown_connections 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.834+0000 7f4b14bab740 1 -- 172.21.15.39:0/3275092083 wait complete. 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b14bab740 20 client.25670 trim_cache size 0 max 16384 2024-09-10T21:57:49.839 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:49.840 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:57:49.842 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 msgr2=0x7f4af80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 0x7f4af80b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031440 tx=0x7f4afc032c80 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 msgr2=0x7f4b0c101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c970 tx=0x7f4af400ce30 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 shutdown_connections 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f4af80b5360 0x7f4af80b7820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c10d100 0x7f4b0c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c1045c0 0x7f4b0c101e90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 --2- 172.21.15.39:0/3657489902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b0c103ca0 0x7f4b0c101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 >> 172.21.15.39:0/3657489902 conn(0x7f4b0c0fd700 msgr2=0x7f4b0c10f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 shutdown_connections 2024-09-10T21:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:49.835+0000 7f4b127d6640 1 -- 172.21.15.39:0/3657489902 wait complete. 2024-09-10T21:57:50.601 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:57:50.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:57:50.887 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:51.338 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:51 smithi039 ceph-mon[30872]: pgmap v426: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-10T21:57:51.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 -- 172.21.15.39:0/4221129442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 msgr2=0x7f439010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 --2- 172.21.15.39:0/4221129442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f439010cb50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4384009900 tx=0x7f438402a410 comp rx=0 tx=0).stop 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 -- 172.21.15.39:0/4221129442 shutdown_connections 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 --2- 172.21.15.39:0/4221129442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439010d120 0x7f439010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 --2- 172.21.15.39:0/4221129442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f439010cb50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 --2- 172.21.15.39:0/4221129442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390103b70 0x7f4390103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 -- 172.21.15.39:0/4221129442 >> 172.21.15.39:0/4221129442 conn(0x7f43900fd700 msgr2=0x7f43900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.336+0000 7f4395c56640 1 -- 172.21.15.39:0/4221129442 shutdown_connections 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.337+0000 7f4395c56640 1 -- 172.21.15.39:0/4221129442 wait complete. 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.337+0000 7f4395c56640 1 Processor -- start 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.337+0000 7f4395c56640 1 -- start start 2024-09-10T21:57:51.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4390103b70 0x7f43901019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 0x7f4390102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4390112d60 con 0x7f4390104570 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4390112be0 con 0x7f439010d120 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4390112ee0 con 0x7f4390103b70 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45022/0 (socket says 172.21.15.39:45022) 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 0x7f4390102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 -- 172.21.15.39:0/4256499330 learned_addr learned my addr 172.21.15.39:0/4256499330 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438f7fe640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4390103b70 0x7f43901019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 -- 172.21.15.39:0/4256499330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4390103b70 msgr2=0x7f43901019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4390103b70 0x7f43901019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 -- 172.21.15.39:0/4256499330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 msgr2=0x7f4390102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 0x7f4390102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 -- 172.21.15.39:0/4256499330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901a7670 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438ffff640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 0x7f4390102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438effd640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4384005940 tx=0x7f4384004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438403f030 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.338+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43901a7900 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.339+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4384003aa0 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.339+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384035070 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.339+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901a7e30 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.340+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390103f50 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.341+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f438403bce0 con 0x7f4390104570 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.342+0000 7f438cff9640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 0x7f43780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:51.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.342+0000 7f438f7fe640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 0x7f43780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:51.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.343+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4384106550 con 0x7f4390104570 2024-09-10T21:57:51.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.343+0000 7f438f7fe640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 0x7f43780b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4380009bd0 tx=0x7f4380005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:51.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.347+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43840ccd70 con 0x7f4390104570 2024-09-10T21:57:51.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:51 smithi070 ceph-mon[34909]: pgmap v426: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-10T21:57:51.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:51 smithi173 ceph-mon[35294]: pgmap v426: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-10T21:57:51.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.579+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f439002e5c0 con 0x7f4390104570 2024-09-10T21:57:51.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.580+0000 7f438cff9640 1 -- 172.21.15.39:0/4256499330 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11980 (secure 0 0 0) 0x7f43840d17a0 con 0x7f4390104570 2024-09-10T21:57:51.581 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:57:51.581 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"btime":"2024-09-10T21:56:56:565338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:56:55.941400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:57:51.582 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 msgr2=0x7f43780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 0x7f43780b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4380009bd0 tx=0x7f4380005f90 comp rx=0 tx=0).stop 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 msgr2=0x7f4390101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4384005940 tx=0x7f4384004270 comp rx=0 tx=0).stop 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 shutdown_connections 2024-09-10T21:57:51.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f43780b52e0 0x7f43780b77a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010d120 0x7f4390102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4390104570 0x7f4390101f30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 --2- 172.21.15.39:0/4256499330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4390103b70 0x7f43901019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 >> 172.21.15.39:0/4256499330 conn(0x7f43900fd700 msgr2=0x7f43900fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 shutdown_connections 2024-09-10T21:57:51.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:51.582+0000 7f4395c56640 1 -- 172.21.15.39:0/4256499330 wait complete. 2024-09-10T21:57:52.172 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:52 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4256499330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:52.207 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:57:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:52 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4256499330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:52.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:52 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4256499330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:57:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.699+0000 7f01717fa640 1 -- 172.21.15.39:0/2398226159 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fb6f030f0 con 0x563fb7015d60 2024-09-10T21:57:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.699+0000 7f01717fa640 10 client.16047 handle_command_reply: tid=0 2024-09-10T21:57:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.699+0000 7f019305a740 1 client.16047 shutdown 2024-09-10T21:57:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.704+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 msgr2=0x563fb6fa2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.704+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f01780e33a0 tx=0x7f01780048f0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.704+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 shutdown_connections 2024-09-10T21:57:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.704+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x563fb7015d60 0x563fb7018180 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563fb6f98bd0 0x563fb6fa3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563fb6f96190 0x563fb6fa2550 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 --2- 172.21.15.39:0/2398226159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fb6f93860 0x563fb6fa1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f01717fa640 0 client.16047 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 >> 172.21.15.39:0/2398226159 conn(0x563fb6f8e9b0 msgr2=0x563fb6f92c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 shutdown_connections 2024-09-10T21:57:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.705+0000 7f019305a740 1 -- 172.21.15.39:0/2398226159 wait complete. 2024-09-10T21:57:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.706+0000 7f019305a740 20 client.16047 trim_cache size 0 max 16384 2024-09-10T21:57:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:57:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:57:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:57:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.707+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 msgr2=0x7f01740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.707+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 0x7f01740b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f018819bda0 tx=0x7f0180009be0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.707+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 msgr2=0x7f018819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.707+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f017800c970 tx=0x7f017800ce30 comp rx=0 tx=0).stop 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 shutdown_connections 2024-09-10T21:57:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f01740b5360 0x7f01740b7820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0188108670 0x7f018819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0188105ac0 0x7f018819b670 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 --2- 172.21.15.39:0/2365949167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f018806b470 0x7f018819b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 >> 172.21.15.39:0/2365949167 conn(0x7f01880fd140 msgr2=0x7f0188103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 shutdown_connections 2024-09-10T21:57:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:57:52.708+0000 7f01901ad640 1 -- 172.21.15.39:0/2365949167 wait complete. 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 -- 172.21.15.39:0/2686104393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc1023f0 msgr2=0x7f23bc1068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 --2- 172.21.15.39:0/2686104393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc1023f0 0x7f23bc1068c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009900 tx=0x7f23a402a410 comp rx=0 tx=0).stop 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 -- 172.21.15.39:0/2686104393 shutdown_connections 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 --2- 172.21.15.39:0/2686104393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 --2- 172.21.15.39:0/2686104393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc1023f0 0x7f23bc1068c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 --2- 172.21.15.39:0/2686104393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc101ad0 0x7f23bc101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 -- 172.21.15.39:0/2686104393 >> 172.21.15.39:0/2686104393 conn(0x7f23bc0fd740 msgr2=0x7f23bc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 -- 172.21.15.39:0/2686104393 shutdown_connections 2024-09-10T21:57:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.094+0000 7f23c1f90640 1 -- 172.21.15.39:0/2686104393 wait complete. 2024-09-10T21:57:53.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.095+0000 7f23c1f90640 1 Processor -- start 2024-09-10T21:57:53.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.095+0000 7f23c1f90640 1 -- start start 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 0x7f23bc19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 0x7f23bc19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1193a0 con 0x7f23bc101ad0 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc119220 con 0x7f23bc1023f0 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23c1f90640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc119520 con 0x7f23bc106f10 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 0x7f23bc19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 0x7f23bc19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52416/0 (socket says 172.21.15.39:52416) 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 -- 172.21.15.39:0/1693564072 learned_addr learned my addr 172.21.15.39:0/1693564072 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 0x7f23bc19f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45032/0 (socket says 172.21.15.39:45032) 2024-09-10T21:57:53.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23b3fff640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 0x7f23bc19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42144/0 (socket says 172.21.15.39:42144) 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 -- 172.21.15.39:0/1693564072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 msgr2=0x7f23bc19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 0x7f23bc19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 -- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 msgr2=0x7f23bc19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 0x7f23bc19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.096+0000 7f23bbfff640 1 -- 172.21.15.39:0/1693564072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc1a5800 con 0x7f23bc106f10 2024-09-10T21:57:53.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.097+0000 7f23bbfff640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d750 tx=0x7f23b400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.097+0000 7f23b97fa640 1 -- 172.21.15.39:0/1693564072 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4017070 con 0x7f23bc106f10 2024-09-10T21:57:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.097+0000 7f23b97fa640 1 -- 172.21.15.39:0/1693564072 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23b40054d0 con 0x7f23bc106f10 2024-09-10T21:57:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.098+0000 7f23b97fa640 1 -- 172.21.15.39:0/1693564072 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4004b90 con 0x7f23bc106f10 2024-09-10T21:57:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.098+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc1a5af0 con 0x7f23bc106f10 2024-09-10T21:57:53.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.098+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc1ac380 con 0x7f23bc106f10 2024-09-10T21:57:53.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.100+0000 7f23b97fa640 1 -- 172.21.15.39:0/1693564072 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f23b4004d50 con 0x7f23bc106f10 2024-09-10T21:57:53.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.103+0000 7f23b97fa640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 0x7f23a80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.103+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 0x7f23a80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 Processor -- start 2024-09-10T21:57:53.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 -- start start 2024-09-10T21:57:53.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f631298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 0x559f63135840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63138170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559f6309fea0 con 0x559f631294d0 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6308f2d0 con 0x559f63135d80 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23c4365740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559f630930e0 con 0x559f63129df0 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.104+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f631298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 0x559f63135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 0x7f23a80b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0099a0 tx=0x7f23ac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 0x559f63135840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52424/0 (socket says 172.21.15.39:52424) 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23b3fff640 1 -- 172.21.15.39:0/3840326075 learned_addr learned my addr 172.21.15.39:0/3840326075 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23b97fa640 1 -- 172.21.15.39:0/1693564072 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f23b40e54c0 con 0x7f23bc106f10 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 -- 172.21.15.39:0/3840326075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 msgr2=0x559f63135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 0x559f63135840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 -- 172.21.15.39:0/3840326075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 msgr2=0x559f63138170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63138170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 -- 172.21.15.39:0/3840326075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f62ded650 con 0x559f631294d0 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.105+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f631298b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f23ac003bb0 tx=0x7f23ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcdedfbde522270 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.106+0000 7f23b1ffb640 1 -- 172.21.15.39:0/3840326075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac026470 con 0x559f631294d0 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.106+0000 7f23b1ffb640 1 -- 172.21.15.39:0/3840326075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23ac026ac0 con 0x559f631294d0 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.106+0000 7f23b1ffb640 1 -- 172.21.15.39:0/3840326075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac01dbe0 con 0x559f631294d0 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 -- 172.21.15.39:0/3840326075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 msgr2=0x559f631298b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f631298b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f23ac003bb0 tx=0x7f23ac014000 comp rx=0 tx=0).stop 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 -- 172.21.15.39:0/3840326075 shutdown_connections 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63129df0 0x559f63135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 --2- 172.21.15.39:0/3840326075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f631298b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 -- 172.21.15.39:0/3840326075 >> 172.21.15.39:0/3840326075 conn(0x559f63127300 msgr2=0x559f631284a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 -- 172.21.15.39:0/3840326075 shutdown_connections 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.107+0000 7f23c4365740 1 -- 172.21.15.39:0/3840326075 wait complete. 2024-09-10T21:57:53.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.108+0000 7f23c4365740 1 -- start start 2024-09-10T21:57:53.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 Processor -- start 2024-09-10T21:57:53.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45042/0 (socket says 172.21.15.39:45042) 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63129df0 0x559f63132b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23bb7fe640 1 -- 172.21.15.39:0/1981491323 learned_addr learned my addr 172.21.15.39:0/1981491323 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63133250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559f62ef0700 con 0x559f631294d0 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6302a160 con 0x559f63129df0 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559f63138a00 con 0x559f63135d80 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.109+0000 7f23b3fff640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63129df0 0x559f63132b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bbfff640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23c4365740 10 client.0 _ll_register_callbacks cb 0x559f630439e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 -- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 msgr2=0x559f63133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 -- 172.21.15.39:0/1981491323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63129df0 msgr2=0x559f63132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63129df0 0x559f63132b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f63057c90 con 0x559f631294d0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bbfff640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ac026ac0 con 0x559f631294d0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009850 tx=0x7f23ac004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784bcc610f807aad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f239affd640 10 client.16083 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f239affd640 1 -- 172.21.15.39:0/1981491323 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac033060 con 0x559f631294d0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.110+0000 7f239affd640 1 -- 172.21.15.39:0/1981491323 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f23ac026830 con 0x559f631294d0 2024-09-10T21:57:53.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f239affd640 1 -- 172.21.15.39:0/1981491323 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23ac01d920 con 0x559f631294d0 2024-09-10T21:57:53.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 10 client.16083 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:53.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f631442f0 con 0x559f631294d0 2024-09-10T21:57:53.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f239affd640 1 -- 172.21.15.39:0/1981491323 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f23ac01dac0 con 0x559f631294d0 2024-09-10T21:57:53.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 10 client.16083 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:53.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 10 client.16083 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 20 client.16083 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f63145640 0x559f63147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 4 client.16083 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.111+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f630a1df0 con 0x559f63145640 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.112+0000 7f23b3fff640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f63145640 0x559f63147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.112+0000 7f23b3fff640 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f63145640 0x559f63147a30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1bbd3005d47b7ae server_cookie=6b99a6773a9aba03 in_seq=0 out_seq=0 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.112+0000 7f239affd640 10 client.16083 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f239affd640 1 -- 172.21.15.39:0/1981491323 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f630a1df0 con 0x559f63145640 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f239affd640 10 client.16083 handle_command_reply: tid=0 2024-09-10T21:57:53.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 client.16083 shutdown 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 msgr2=0x559f63135730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009850 tx=0x7f23ac004980 comp rx=0 tx=0).stop 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 shutdown_connections 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f63145640 0x559f63147a30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63129df0 0x559f63132b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 --2- 172.21.15.39:0/1981491323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f631294d0 0x559f63135730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 >> 172.21.15.39:0/1981491323 conn(0x559f63127300 msgr2=0x559f6312ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f239affd640 0 client.16083 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 shutdown_connections 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.113+0000 7f23c4365740 1 -- 172.21.15.39:0/1981491323 wait complete. 2024-09-10T21:57:53.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.114+0000 7f23c4365740 20 client.16083 trim_cache size 0 max 16384 2024-09-10T21:57:53.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.129+0000 7f23c4365740 1 Processor -- start 2024-09-10T21:57:53.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.129+0000 7f23c4365740 1 -- start start 2024-09-10T21:57:53.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.129+0000 7f23c4365740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 0x559f63141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.129+0000 7f23c4365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.129+0000 7f23c4365740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63137170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.133+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 0x559f63141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.133+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 0x559f63141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42172/0 (socket says 172.21.15.39:42172) 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45046/0 (socket says 172.21.15.39:45046) 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23c4365740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b4a60 con 0x559f63129df0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23c4365740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b6660 con 0x559f631294d0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23c4365740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b5130 con 0x559f63135d80 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23bb7fe640 1 -- 172.21.15.39:0/446671931 learned_addr learned my addr 172.21.15.39:0/446671931 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 -- 172.21.15.39:0/446671931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 msgr2=0x559f63137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 -- 172.21.15.39:0/446671931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 msgr2=0x559f63141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 0x559f63141ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.134+0000 7f23b3fff640 1 -- 172.21.15.39:0/446671931 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f63131080 con 0x559f63129df0 2024-09-10T21:57:53.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.135+0000 7f23b3fff640 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005ab0 tx=0x7f23a4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f02e5dfd2adfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.141+0000 7f23b17fa640 1 -- 172.21.15.39:0/446671931 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4035040 con 0x559f63129df0 2024-09-10T21:57:53.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.141+0000 7f23b17fa640 1 -- 172.21.15.39:0/446671931 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23a4005030 con 0x559f63129df0 2024-09-10T21:57:53.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.141+0000 7f23b17fa640 1 -- 172.21.15.39:0/446671931 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004b00 con 0x559f63129df0 2024-09-10T21:57:53.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.146+0000 7f23c4365740 1 -- 172.21.15.39:0/446671931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 msgr2=0x559f631348c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.146+0000 7f23c4365740 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005ab0 tx=0x7f23a4031400 comp rx=0 tx=0).stop 2024-09-10T21:57:53.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.151+0000 7f23c4365740 1 -- 172.21.15.39:0/446671931 shutdown_connections 2024-09-10T21:57:53.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.151+0000 7f23c4365740 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f63135d80 0x559f63137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.151+0000 7f23c4365740 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f631348c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.151+0000 7f23c4365740 1 --2- 172.21.15.39:0/446671931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f631294d0 0x559f63141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.151+0000 7f23c4365740 1 -- 172.21.15.39:0/446671931 >> 172.21.15.39:0/446671931 conn(0x559f63127300 msgr2=0x559f631341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.158+0000 7f23c4365740 1 -- 172.21.15.39:0/446671931 shutdown_connections 2024-09-10T21:57:53.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.158+0000 7f23c4365740 1 -- 172.21.15.39:0/446671931 wait complete. 2024-09-10T21:57:53.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.158+0000 7f23c4365740 1 -- start start 2024-09-10T21:57:53.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.159+0000 7f23c4365740 1 Processor -- start 2024-09-10T21:57:53.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.159+0000 7f23c4365740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f631294d0 0x559f6314abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23c4365740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45052/0 (socket says 172.21.15.39:45052) 2024-09-10T21:57:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23b3fff640 1 -- 172.21.15.39:0/3255292003 learned_addr learned my addr 172.21.15.39:0/3255292003 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:53.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63147660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.160+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b5ed0 con 0x559f63129df0 2024-09-10T21:57:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.161+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b5800 con 0x559f63135d80 2024-09-10T21:57:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.161+0000 7f23bbfff640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.161+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b2a40 con 0x559f631294d0 2024-09-10T21:57:53.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f631294d0 0x559f6314abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23b3fff640 1 -- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f631294d0 msgr2=0x559f6314abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23b3fff640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f631294d0 0x559f6314abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23b3fff640 1 -- 172.21.15.39:0/3255292003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 msgr2=0x559f63147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23b3fff640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.165+0000 7f23b3fff640 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f63147c50 con 0x559f63129df0 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.166+0000 7f23b3fff640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009900 tx=0x7f23a4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5975d83029b2b1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.166+0000 7f23c4365740 10 client.0 _ll_register_callbacks cb 0x7f23ac0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:53.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.166+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23a4005030 con 0x559f63129df0 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f239affd640 10 client.16089 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f239affd640 1 -- 172.21.15.39:0/3255292003 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4058060 con 0x559f63129df0 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f239affd640 1 -- 172.21.15.39:0/3255292003 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f23a4004780 con 0x559f63129df0 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f239affd640 1 -- 172.21.15.39:0/3255292003 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23a4035040 con 0x559f63129df0 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f23c4365740 10 client.16089 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:53.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.167+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559f631c3e90 con 0x559f63129df0 2024-09-10T21:57:53.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.169+0000 7f239affd640 1 -- 172.21.15.39:0/3255292003 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f23a4004980 con 0x559f63129df0 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.171+0000 7f23c4365740 10 client.16089 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.171+0000 7f23c4365740 10 client.16089 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.171+0000 7f23c4365740 20 client.16089 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.171+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f631c4300 0x559f631c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.172+0000 7f23c4365740 4 client.16089 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.172+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f6309d8a0 con 0x559f631c4300 2024-09-10T21:57:53.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.176+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f631c4300 0x559f631c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:53.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.184+0000 7f239affd640 10 client.16089 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:53.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.184+0000 7f23bb7fe640 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f631c4300 0x559f631c66f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4df06e9a101a1d0f server_cookie=d33fe2cb41891a81 in_seq=0 out_seq=0 2024-09-10T21:57:53.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.188+0000 7f239affd640 1 -- 172.21.15.39:0/3255292003 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f6309d8a0 con 0x559f631c4300 2024-09-10T21:57:53.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.188+0000 7f239affd640 10 client.16089 handle_command_reply: tid=0 2024-09-10T21:57:53.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.190+0000 7f23c4365740 1 client.16089 shutdown 2024-09-10T21:57:53.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.191+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 msgr2=0x559f63147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.191+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009900 tx=0x7f23a4005fd0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 shutdown_connections 2024-09-10T21:57:53.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x559f631c4300 0x559f631c66f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f63135d80 0x559f63147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f63129df0 0x559f63147120 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 --2- 172.21.15.39:0/3255292003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f631294d0 0x559f6314abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.192+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 >> 172.21.15.39:0/3255292003 conn(0x559f63127300 msgr2=0x559f631349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.195+0000 7f239affd640 0 client.16089 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:57:53.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.195+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 shutdown_connections 2024-09-10T21:57:53.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.197+0000 7f23c4365740 1 -- 172.21.15.39:0/3255292003 wait complete. 2024-09-10T21:57:53.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.200+0000 7f23c4365740 20 client.16089 trim_cache size 0 max 16384 2024-09-10T21:57:53.202 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.204+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 msgr2=0x7f23a80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.204+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 0x7f23a80b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0099a0 tx=0x7f23ac009500 comp rx=0 tx=0).stop 2024-09-10T21:57:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.204+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 msgr2=0x7f23bc1a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.204+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d750 tx=0x7f23b400dc10 comp rx=0 tx=0).stop 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 shutdown_connections 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f23a80b5360 0x7f23a80b7820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23bc106f10 0x7f23bc1a5030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc1023f0 0x7f23bc19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 --2- 172.21.15.39:0/1693564072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23bc101ad0 0x7f23bc19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.207+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 >> 172.21.15.39:0/1693564072 conn(0x7f23bc0fd740 msgr2=0x7f23bc1058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.210+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 shutdown_connections 2024-09-10T21:57:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:53.210+0000 7f23c1f90640 1 -- 172.21.15.39:0/1693564072 wait complete. 2024-09-10T21:57:53.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:53 smithi070 ceph-mon[34909]: pgmap v427: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-10T21:57:53.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:53 smithi039 ceph-mon[30872]: pgmap v427: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-10T21:57:53.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:53 smithi173 ceph-mon[35294]: pgmap v427: 97 pgs: 97 active+clean; 227 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-10T21:57:54.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:57:54.471 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:55.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.218+0000 7fa9e57f7640 1 -- 172.21.15.39:0/4267586178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e011c0a0 msgr2=0x7fa9e011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.220+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/4267586178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e011c0a0 0x7fa9e011e490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009ca0 tx=0x7fa9d802a970 comp rx=0 tx=0).stop 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.225+0000 7fa9e57f7640 1 -- 172.21.15.39:0/4267586178 shutdown_connections 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.225+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/4267586178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e011c0a0 0x7fa9e011e490 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.225+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/4267586178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e010a530 0x7fa9e010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.225+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/4267586178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.225+0000 7fa9e57f7640 1 -- 172.21.15.39:0/4267586178 >> 172.21.15.39:0/4267586178 conn(0x7fa9e006dfc0 msgr2=0x7fa9e006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.226+0000 7fa9e57f7640 1 -- 172.21.15.39:0/4267586178 shutdown_connections 2024-09-10T21:57:55.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.231+0000 7fa9e57f7640 1 -- 172.21.15.39:0/4267586178 wait complete. 2024-09-10T21:57:55.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.232+0000 7fa9e57f7640 1 Processor -- start 2024-09-10T21:57:55.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.235+0000 7fa9e57f7640 1 -- start start 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e010a530 0x7fa9e01a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 0x7fa9e01ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0121b60 con 0x7fa9e011c0a0 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01219e0 con 0x7fa9e010a530 2024-09-10T21:57:55.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.236+0000 7fa9e57f7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0121ce0 con 0x7fa9e010a150 2024-09-10T21:57:55.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.237+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.237+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52484/0 (socket says 172.21.15.39:52484) 2024-09-10T21:57:55.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.237+0000 7fa9deffd640 1 -- 172.21.15.39:0/2051913236 learned_addr learned my addr 172.21.15.39:0/2051913236 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:55.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.237+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 0x7fa9e01ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.238+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e010a530 0x7fa9e01a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 -- 172.21.15.39:0/2051913236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 msgr2=0x7fa9e01a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 -- 172.21.15.39:0/2051913236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e010a530 msgr2=0x7fa9e01a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e010a530 0x7fa9e01a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 -- 172.21.15.39:0/2051913236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e01ae060 con 0x7fa9e011c0a0 2024-09-10T21:57:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.239+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 0x7fa9e01ad890 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009bf0 tx=0x7fa9d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.243+0000 7fa9c7fff640 1 -- 172.21.15.39:0/2051913236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8034030 con 0x7fa9e011c0a0 2024-09-10T21:57:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.243+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e01ae2f0 con 0x7fa9e011c0a0 2024-09-10T21:57:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.243+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01b4a10 con 0x7fa9e011c0a0 2024-09-10T21:57:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.243+0000 7fa9c7fff640 1 -- 172.21.15.39:0/2051913236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d8030b40 con 0x7fa9e011c0a0 2024-09-10T21:57:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.243+0000 7fa9c7fff640 1 -- 172.21.15.39:0/2051913236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8039420 con 0x7fa9e011c0a0 2024-09-10T21:57:55.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.248+0000 7fa9e7bcc740 1 Processor -- start 2024-09-10T21:57:55.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.259+0000 7fa9e7bcc740 1 -- start start 2024-09-10T21:57:55.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.260+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104efc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.260+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f08840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.260+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 0x557104f0b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.260+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557104e72ea0 con 0x557104efcdf0 2024-09-10T21:57:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.261+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557104e622d0 con 0x557104f08d80 2024-09-10T21:57:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.261+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557104e660e0 con 0x557104efc4d0 2024-09-10T21:57:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.261+0000 7fa9c7fff640 1 -- 172.21.15.39:0/2051913236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa9d8041070 con 0x7fa9e011c0a0 2024-09-10T21:57:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.263+0000 7fa9c7fff640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 0x7fa9c80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.263+0000 7fa9c7fff640 1 -- 172.21.15.39:0/2051913236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa9d81068f0 con 0x7fa9e011c0a0 2024-09-10T21:57:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.264+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f08840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.264+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f08840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45076/0 (socket says 172.21.15.39:45076) 2024-09-10T21:57:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.264+0000 7fa9deffd640 1 -- 172.21.15.39:0/3251558109 learned_addr learned my addr 172.21.15.39:0/3251558109 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.263+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 0x557104f0b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.264+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104efc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.264+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 0x7fa9c80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.265+0000 7fa9df7fe640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 0x7fa9c80b79b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80049d0 tx=0x7fa9d802ae70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3251558109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 msgr2=0x557104efc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104efc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3251558109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 msgr2=0x557104f08840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f08840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3251558109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557104bc0650 con 0x557104f08d80 2024-09-10T21:57:55.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.267+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 0x557104f0b170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400cfc0 tx=0x7fa9d400c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be8dd84baab75ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.270+0000 7fa9c57fa640 1 -- 172.21.15.39:0/3251558109 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4018030 con 0x557104f08d80 2024-09-10T21:57:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.270+0000 7fa9c57fa640 1 -- 172.21.15.39:0/3251558109 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4010a90 con 0x557104f08d80 2024-09-10T21:57:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.270+0000 7fa9c57fa640 1 -- 172.21.15.39:0/3251558109 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400faa0 con 0x557104f08d80 2024-09-10T21:57:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.275+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3251558109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 msgr2=0x557104f0b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.275+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 0x557104f0b170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400cfc0 tx=0x7fa9d400c380 comp rx=0 tx=0).stop 2024-09-10T21:57:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.276+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3251558109 shutdown_connections 2024-09-10T21:57:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.276+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104f08d80 0x557104f0b170 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400cfc0 tx=0x7fa9d400c380 comp rx=0 tx=0).stop 2024-09-10T21:57:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.276+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f08840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.276+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3251558109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104efc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.276+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3251558109 >> 172.21.15.39:0/3251558109 conn(0x557104efa300 msgr2=0x557104efb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.278+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3251558109 shutdown_connections 2024-09-10T21:57:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.283+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3251558109 wait complete. 2024-09-10T21:57:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.284+0000 7fa9e7bcc740 1 -- start start 2024-09-10T21:57:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.284+0000 7fa9e7bcc740 1 Processor -- start 2024-09-10T21:57:55.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 0x557104f05d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f06260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557104cc3700 con 0x557104efc4d0 2024-09-10T21:57:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557104dfd160 con 0x557104efcdf0 2024-09-10T21:57:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557104f0ba00 con 0x557104f067a0 2024-09-10T21:57:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.292+0000 7fa9e7bcc740 10 client.0 _ll_register_callbacks cb 0x557104e169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.293+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 0x557104f05d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.294+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 0x557104f05d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45082/0 (socket says 172.21.15.39:45082) 2024-09-10T21:57:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.294+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.294+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3359516304 learned_addr learned my addr 172.21.15.39:0/3359516304 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.294+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.298+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3359516304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 msgr2=0x557104f06260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.298+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f06260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.298+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3359516304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 msgr2=0x557104f05d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.298+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 0x557104f05d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.298+0000 7fa9de7fc640 1 -- 172.21.15.39:0/3359516304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557104e2ac90 con 0x557104f067a0 2024-09-10T21:57:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.299+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f14dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400f780 tx=0x7fa9d4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b777dd575eec8b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.299+0000 7fa9c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:55.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.301+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4018040 con 0x557104f067a0 2024-09-10T21:57:55.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.301+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d4010a90 con 0x557104f067a0 2024-09-10T21:57:55.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.301+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa9d4004020 con 0x557104f067a0 2024-09-10T21:57:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.303+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9d4004220 con 0x557104f067a0 2024-09-10T21:57:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.305+0000 7fa9e7bcc740 10 client.25702 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.305+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557104f17a00 con 0x557104f067a0 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4010a90 con 0x557104f067a0 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa9d40035f0 con 0x557104f067a0 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 10 client.25702 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 10 client.25702 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 20 client.25702 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:55.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f19190 0x557104f1b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 4 client.25702 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.308+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557104e74df0 con 0x557104f19190 2024-09-10T21:57:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.309+0000 7fa9deffd640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f19190 0x557104f1b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.317+0000 7fa9deffd640 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f19190 0x557104f1b5b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d715bf044d26df0 server_cookie=729a3003072527aa in_seq=0 out_seq=0 2024-09-10T21:57:55.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.317+0000 7fa9c2ff5640 10 client.25702 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:55.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.318+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/3359516304 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557104e74df0 con 0x557104f19190 2024-09-10T21:57:55.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.318+0000 7fa9c2ff5640 10 client.25702 handle_command_reply: tid=0 2024-09-10T21:57:55.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.319+0000 7fa9e7bcc740 1 client.25702 shutdown 2024-09-10T21:57:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.321+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 msgr2=0x557104f14dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.321+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f14dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400f780 tx=0x7fa9d4000bc0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 shutdown_connections 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f14dc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f19190 0x557104f1b5b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f06260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/3359516304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efc4d0 0x557104f05d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.324+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 >> 172.21.15.39:0/3359516304 conn(0x557104efa300 msgr2=0x557104effe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.325+0000 7fa9c2ff5640 0 client.25702 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:55.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.325+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 shutdown_connections 2024-09-10T21:57:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.325+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/3359516304 wait complete. 2024-09-10T21:57:55.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.329+0000 7fa9e7bcc740 20 client.25702 trim_cache size 0 max 16384 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.367+0000 7fa9e7bcc740 1 Processor -- start 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 -- start start 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104ef9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f07a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 0x557104f02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc00e4a0 con 0x557104f067a0 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc0100a0 con 0x557104efcdf0 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc00eb70 con 0x557104efc4d0 2024-09-10T21:57:55.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 0x557104f02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.368+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 0x557104f02f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45092/0 (socket says 172.21.15.39:45092) 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 -- 172.21.15.39:0/4229055358 learned_addr learned my addr 172.21.15.39:0/4229055358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104ef9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9deffd640 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f07a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 -- 172.21.15.39:0/4229055358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 msgr2=0x557104f07a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f07a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 -- 172.21.15.39:0/4229055358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 msgr2=0x557104f02f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 0x557104f02f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.369+0000 7fa9de7fc640 1 -- 172.21.15.39:0/4229055358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557104ef5bb0 con 0x557104efc4d0 2024-09-10T21:57:55.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.370+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104ef9c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4012410 tx=0x7fa9d4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a530860b94b82b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.372+0000 7fa9c4ff9640 1 -- 172.21.15.39:0/4229055358 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4021070 con 0x557104efc4d0 2024-09-10T21:57:55.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.372+0000 7fa9c4ff9640 1 -- 172.21.15.39:0/4229055358 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4019040 con 0x557104efc4d0 2024-09-10T21:57:55.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.372+0000 7fa9c4ff9640 1 -- 172.21.15.39:0/4229055358 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4005680 con 0x557104efc4d0 2024-09-10T21:57:55.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.374+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/4229055358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 msgr2=0x557104ef9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.374+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104ef9c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4012410 tx=0x7fa9d4000bc0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.378+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/4229055358 shutdown_connections 2024-09-10T21:57:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.378+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104f067a0 0x557104f02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.378+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efcdf0 0x557104f07a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.378+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/4229055358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104efc4d0 0x557104ef9c10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.378+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/4229055358 >> 172.21.15.39:0/4229055358 conn(0x557104efa300 msgr2=0x557104f07350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.381+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/4229055358 shutdown_connections 2024-09-10T21:57:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.382+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/4229055358 wait complete. 2024-09-10T21:57:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.382+0000 7fa9e7bcc740 1 -- start start 2024-09-10T21:57:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.383+0000 7fa9e7bcc740 1 Processor -- start 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.383+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 0x557104f112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f0ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc00f910 con 0x557104efcdf0 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc00f240 con 0x557104efc4d0 2024-09-10T21:57:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 0x557104f112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc00c480 con 0x557104f067a0 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9e7bcc740 10 client.0 _ll_register_callbacks cb 0x7fa9d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45104/0 (socket says 172.21.15.39:45104) 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9deffd640 1 -- 172.21.15.39:0/2352365679 learned_addr learned my addr 172.21.15.39:0/2352365679 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:55.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 0x557104f112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42218/0 (socket says 172.21.15.39:42218) 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.384+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f0ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.385+0000 7fa9deffd640 1 -- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 msgr2=0x557104f0ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.385+0000 7fa9deffd640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f0ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.385+0000 7fa9deffd640 1 -- 172.21.15.39:0/2352365679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 msgr2=0x557104f112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.385+0000 7fa9deffd640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 0x557104f112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.385+0000 7fa9deffd640 1 -- 172.21.15.39:0/2352365679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557104efad80 con 0x557104efcdf0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.386+0000 7fa9deffd640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x557104f1be20 tx=0x7fa9d0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00647a9f87f24d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.387+0000 7fa9c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.388+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0005020 con 0x557104efcdf0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.388+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d4019040 con 0x557104efcdf0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.388+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa9d00051c0 con 0x557104efcdf0 2024-09-10T21:57:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.388+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9d00053c0 con 0x557104efcdf0 2024-09-10T21:57:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.390+0000 7fa9e7bcc740 10 client.16104 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.391+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557104f85d30 con 0x557104efcdf0 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.392+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4019040 con 0x557104efcdf0 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.392+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa9d00119a0 con 0x557104efcdf0 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 10 client.16104 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 10 client.16104 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 20 client.16104 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f864e0 0x557104f88900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 4 client.16104 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.393+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557104e708a0 con 0x557104f864e0 2024-09-10T21:57:55.399 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:55 smithi039 ceph-mon[30872]: pgmap v428: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 273 op/s 2024-09-10T21:57:55.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.397+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f864e0 0x557104f88900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:55.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.402+0000 7fa9de7fc640 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f864e0 0x557104f88900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d9207878e10c2d2f server_cookie=b77cfddb000b3bb5 in_seq=0 out_seq=0 2024-09-10T21:57:55.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.402+0000 7fa9c2ff5640 10 client.16104 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:55.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:55 smithi070 ceph-mon[34909]: pgmap v428: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 273 op/s 2024-09-10T21:57:55.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9c2ff5640 1 -- 172.21.15.39:0/2352365679 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557104e708a0 con 0x557104f864e0 2024-09-10T21:57:55.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9c2ff5640 10 client.16104 handle_command_reply: tid=0 2024-09-10T21:57:55.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 client.16104 shutdown 2024-09-10T21:57:55.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 msgr2=0x557104f0c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x557104f1be20 tx=0x7fa9d0012820 comp rx=0 tx=0).stop 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 shutdown_connections 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557104f067a0 0x557104f0ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557104efcdf0 0x557104f0c790 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557104f864e0 0x557104f88900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 --2- 172.21.15.39:0/2352365679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557104efc4d0 0x557104f112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 >> 172.21.15.39:0/2352365679 conn(0x557104efa300 msgr2=0x557104f07b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.407+0000 7fa9c2ff5640 0 client.16104 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:57:55.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.410+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 shutdown_connections 2024-09-10T21:57:55.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.414+0000 7fa9e7bcc740 1 -- 172.21.15.39:0/2352365679 wait complete. 2024-09-10T21:57:55.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.414+0000 7fa9e7bcc740 20 client.16104 trim_cache size 0 max 16384 2024-09-10T21:57:55.417 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.416+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 msgr2=0x7fa9c80b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.416+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 0x7fa9c80b79b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80049d0 tx=0x7fa9d802ae70 comp rx=0 tx=0).stop 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 msgr2=0x7fa9e01ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 0x7fa9e01ad890 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009bf0 tx=0x7fa9d8003f10 comp rx=0 tx=0).stop 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 shutdown_connections 2024-09-10T21:57:55.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9c80b54f0 0x7fa9c80b79b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9e011c0a0 0x7fa9e01ad890 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e010a530 0x7fa9e01a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.417+0000 7fa9e57f7640 1 --2- 172.21.15.39:0/2051913236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e010a150 0x7fa9e01a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:55.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.418+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 >> 172.21.15.39:0/2051913236 conn(0x7fa9e006dfc0 msgr2=0x7fa9e011c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:55.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.418+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 shutdown_connections 2024-09-10T21:57:55.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:55.422+0000 7fa9e57f7640 1 -- 172.21.15.39:0/2051913236 wait complete. 2024-09-10T21:57:55.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:55 smithi173 ceph-mon[35294]: pgmap v428: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 273 op/s 2024-09-10T21:57:56.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:57:56.500 INFO:tasks.workunit.client.0.smithi039.stdout: 66 733804 345 487565 268 407919 1134 2024-09-10T21:57:56.526 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:57.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 -- 172.21.15.39:0/2954710447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 msgr2=0x7fc3cc102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2954710447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc102090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009900 tx=0x7fc3c802a410 comp rx=0 tx=0).stop 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 -- 172.21.15.39:0/2954710447 shutdown_connections 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2954710447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc108040 0x7fc3cc10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2954710447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2954710447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc102090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.042+0000 7fc3d330e640 1 -- 172.21.15.39:0/2954710447 >> 172.21.15.39:0/2954710447 conn(0x7fc3cc0fd740 msgr2=0x7fc3cc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.043+0000 7fc3d330e640 1 -- 172.21.15.39:0/2954710447 shutdown_connections 2024-09-10T21:57:57.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.043+0000 7fc3d330e640 1 -- 172.21.15.39:0/2954710447 wait complete. 2024-09-10T21:57:57.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.044+0000 7fc3d330e640 1 Processor -- start 2024-09-10T21:57:57.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 -- start start 2024-09-10T21:57:57.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 0x7fc3cc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc112e60 con 0x7fc3cc1076c0 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc112ce0 con 0x7fc3cc101cb0 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d330e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc112fe0 con 0x7fc3cc108040 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45128/0 (socket says 172.21.15.39:45128) 2024-09-10T21:57:57.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2119152128 learned_addr learned my addr 172.21.15.39:0/2119152128 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.046+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 0x7fc3cc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2119152128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 msgr2=0x7fc3cc1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 msgr2=0x7fc3cc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2119152128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc19f3a0 con 0x7fc3cc108040 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:57.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 0x7fc3cc19ebd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400ec50 tx=0x7fc3c400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3c27fc640 1 -- 172.21.15.39:0/2119152128 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4003b70 con 0x7fc3cc108040 2024-09-10T21:57:57.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3c27fc640 1 -- 172.21.15.39:0/2119152128 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c4003d10 con 0x7fc3cc108040 2024-09-10T21:57:57.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.047+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc19f690 con 0x7fc3cc108040 2024-09-10T21:57:57.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.048+0000 7fc3c27fc640 1 -- 172.21.15.39:0/2119152128 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4010830 con 0x7fc3cc108040 2024-09-10T21:57:57.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.048+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc10f080 con 0x7fc3cc108040 2024-09-10T21:57:57.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.050+0000 7fc3c27fc640 1 -- 172.21.15.39:0/2119152128 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc3c4003ec0 con 0x7fc3cc108040 2024-09-10T21:57:57.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.051+0000 7fc3c27fc640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 0x7fc3b80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.051+0000 7fc3c27fc640 1 -- 172.21.15.39:0/2119152128 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc3c40e5fc0 con 0x7fc3cc108040 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 Processor -- start 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 -- start start 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 0x7fc3b80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557633402ce0 0x5576334030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333fe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557633370ea0 con 0x5576333fe190 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5576333602d0 con 0x557633403600 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.052+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5576333640e0 con 0x557633402ce0 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42248/0 (socket says 172.21.15.39:42248) 2024-09-10T21:57:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 -- 172.21.15.39:0/3475250911 learned_addr learned my addr 172.21.15.39:0/3475250911 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 -- 172.21.15.39:0/3475250911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557633402ce0 msgr2=0x5576334030c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557633402ce0 0x5576334030c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 -- 172.21.15.39:0/3475250911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 msgr2=0x5576333fe600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333fe600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.053+0000 7fc3d08a9640 1 -- 172.21.15.39:0/3475250911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576330be650 con 0x557633403600 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.054+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0115f0 tx=0x7fc3bc011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34393594def574f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.054+0000 7fc3b77fe640 1 -- 172.21.15.39:0/3475250911 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc01e070 con 0x557633403600 2024-09-10T21:57:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.054+0000 7fc3b77fe640 1 -- 172.21.15.39:0/3475250911 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3bc00fb70 con 0x557633403600 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3b77fe640 1 -- 172.21.15.39:0/3475250911 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc019c60 con 0x557633403600 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 -- 172.21.15.39:0/3475250911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 msgr2=0x5576333fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0115f0 tx=0x7fc3bc011ab0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 -- 172.21.15.39:0/3475250911 shutdown_connections 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333fe600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633403600 0x5576333fdc50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/3475250911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557633402ce0 0x5576334030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.055+0000 7fc3d56e3740 1 -- 172.21.15.39:0/3475250911 >> 172.21.15.39:0/3475250911 conn(0x557633400b10 msgr2=0x557633401cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.056+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 0x7fc3b80b78f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8005ab0 tx=0x7fc3c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.057+0000 7fc3d56e3740 1 -- 172.21.15.39:0/3475250911 shutdown_connections 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.057+0000 7fc3d56e3740 1 -- 172.21.15.39:0/3475250911 wait complete. 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.057+0000 7fc3d56e3740 1 -- start start 2024-09-10T21:57:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.057+0000 7fc3d56e3740 1 Processor -- start 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x55763341c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 0x55763341c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x5576333fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5576331c1700 con 0x5576333fba30 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5576332fb160 con 0x557633402ce0 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5576333fee90 con 0x5576333fe190 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.058+0000 7fc3d56e3740 10 client.0 _ll_register_callbacks cb 0x5576333149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x5576333fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x5576333fbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45130/0 (socket says 172.21.15.39:45130) 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2630780408 learned_addr learned my addr 172.21.15.39:0/2630780408 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 0x55763341c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x55763341c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2630780408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 msgr2=0x55763341c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x55763341c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2630780408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 msgr2=0x5576333fbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x5576333fbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.059+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2630780408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557633328c90 con 0x557633402ce0 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.060+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 0x55763341c8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0197e0 tx=0x7fc3bc019670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b946e8d4d7a717cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.060+0000 7fc3b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.060+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc029060 con 0x557633402ce0 2024-09-10T21:57:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.060+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc3bc00f6c0 con 0x557633402ce0 2024-09-10T21:57:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.061+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3bc00fb70 con 0x557633402ce0 2024-09-10T21:57:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.062+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc01e040 con 0x557633402ce0 2024-09-10T21:57:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.062+0000 7fc3d56e3740 10 client.25721 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.062+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557633426640 con 0x557633402ce0 2024-09-10T21:57:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.062+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3bc00fb70 con 0x557633402ce0 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.062+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc3bc005410 con 0x557633402ce0 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 10 client.25721 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 10 client.25721 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 20 client.25721 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633427990 0x557633429d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 4 client.25721 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557633372df0 con 0x557633427990 2024-09-10T21:57:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633427990 0x557633429d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3b4ff9640 10 client.25721 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.063+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633427990 0x557633429d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3f9b33bcce94fbd server_cookie=8fc8a34ebb92bf38 in_seq=0 out_seq=0 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.064+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2630780408 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557633372df0 con 0x557633427990 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.064+0000 7fc3b4ff9640 10 client.25721 handle_command_reply: tid=0 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.064+0000 7fc3d56e3740 1 client.25721 shutdown 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 msgr2=0x55763341c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 0x55763341c8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0197e0 tx=0x7fc3bc019670 comp rx=0 tx=0).stop 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 shutdown_connections 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633427990 0x557633429d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x5576333fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402ce0 0x55763341c8c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2630780408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x55763341c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 >> 172.21.15.39:0/2630780408 conn(0x557633400b10 msgr2=0x557633405e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3b4ff9640 0 client.25721 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 shutdown_connections 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2630780408 wait complete. 2024-09-10T21:57:57.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.065+0000 7fc3d56e3740 20 client.25721 trim_cache size 0 max 16384 2024-09-10T21:57:57.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.081+0000 7fc3d56e3740 1 Processor -- start 2024-09-10T21:57:57.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.081+0000 7fc3d56e3740 1 -- start start 2024-09-10T21:57:57.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.082+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fba30 0x5576333f3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.082+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.082+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.082+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ac220 con 0x5576333fe190 2024-09-10T21:57:57.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ade20 con 0x557633402350 2024-09-10T21:57:57.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d10aa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fba30 0x5576333f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45140/0 (socket says 172.21.15.39:45140) 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2695452215 learned_addr learned my addr 172.21.15.39:0/2695452215 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42272/0 (socket says 172.21.15.39:42272) 2024-09-10T21:57:57.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.083+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ac8f0 con 0x5576333fba30 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.084+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2695452215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fba30 msgr2=0x5576333f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.084+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fba30 0x5576333f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.084+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2695452215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 msgr2=0x5576333f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.084+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.084+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2695452215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557633401a20 con 0x557633402350 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.085+0000 7fc3d18ab640 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40ac490 tx=0x7fc3c40a8ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a39f9fd3fb05eed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.085+0000 7fc3b6ffd640 1 -- 172.21.15.39:0/2695452215 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40cf040 con 0x557633402350 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.085+0000 7fc3b6ffd640 1 -- 172.21.15.39:0/2695452215 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c4009820 con 0x557633402350 2024-09-10T21:57:57.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.085+0000 7fc3b6ffd640 1 -- 172.21.15.39:0/2695452215 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40cfd40 con 0x557633402350 2024-09-10T21:57:57.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 msgr2=0x5576333f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40ac490 tx=0x7fc3c40a8ee0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 shutdown_connections 2024-09-10T21:57:57.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x5576333f91a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fe190 0x5576333f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2695452215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fba30 0x5576333f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.086+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 >> 172.21.15.39:0/2695452215 conn(0x557633400b10 msgr2=0x557633401c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.087+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 shutdown_connections 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.087+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2695452215 wait complete. 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.087+0000 7fc3d56e3740 1 -- start start 2024-09-10T21:57:57.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.088+0000 7fc3d56e3740 1 Processor -- start 2024-09-10T21:57:57.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.088+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x55763343bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x557633438330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d56e3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x557633438ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d56e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ad690 con 0x5576333fba30 2024-09-10T21:57:57.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d08a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x557633438330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x557633438ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d18ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x557633438ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42282/0 (socket says 172.21.15.39:42282) 2024-09-10T21:57:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d18ab640 1 -- 172.21.15.39:0/2907627772 learned_addr learned my addr 172.21.15.39:0/2907627772 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1acfc0 con 0x557633402350 2024-09-10T21:57:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.089+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1aa200 con 0x5576333fe190 2024-09-10T21:57:57.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x55763343bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 msgr2=0x557633438ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x557633438ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2907627772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 msgr2=0x55763343bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x55763343bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576334965c0 con 0x5576333fe190 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d56e3740 10 client.0 _ll_register_callbacks cb 0x7fc3bc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c4009820 con 0x5576333fe190 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3d08a9640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x557633438330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55763341e1d0 tx=0x7fc3bc004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c256d4369bbd098 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.090+0000 7fc3b4ff9640 10 client.25720 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.091+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2907627772 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc029040 con 0x5576333fe190 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.091+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2907627772 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc3bc038470 con 0x5576333fe190 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.091+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2907627772 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc033080 con 0x5576333fe190 2024-09-10T21:57:57.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.091+0000 7fc3d56e3740 10 client.25720 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:57.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.091+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557633497470 con 0x5576333fe190 2024-09-10T21:57:57.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2907627772 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc3bc0386b0 con 0x5576333fe190 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 10 client.25720 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 10 client.25720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 20 client.25720 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633497a90 0x557633499f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 4 client.25720 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576334037a0 con 0x557633497a90 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.092+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633497a90 0x557633499f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.093+0000 7fc3b4ff9640 10 client.25720 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.093+0000 7fc3d10aa640 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633497a90 0x557633499f20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=90ae82151f04b905 server_cookie=1b1056022ebc81a3 in_seq=0 out_seq=0 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.093+0000 7fc3b4ff9640 1 -- 172.21.15.39:0/2907627772 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576334037a0 con 0x557633497a90 2024-09-10T21:57:57.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.093+0000 7fc3b4ff9640 10 client.25720 handle_command_reply: tid=0 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.093+0000 7fc3d56e3740 1 client.25720 shutdown 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 msgr2=0x557633438330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x557633438330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55763341e1d0 tx=0x7fc3bc004c60 comp rx=0 tx=0).stop 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 shutdown_connections 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x557633497a90 0x557633499f20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3b4ff9640 0 client.25720 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557633402350 0x557633438ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576333fe190 0x557633438330 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55763341e1d0 tx=0x7fc3bc004c60 comp rx=0 tx=0).stop 2024-09-10T21:57:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 --2- 172.21.15.39:0/2907627772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576333fba30 0x55763343bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.094+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 >> 172.21.15.39:0/2907627772 conn(0x557633400b10 msgr2=0x55763341d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.095+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 shutdown_connections 2024-09-10T21:57:57.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.098+0000 7fc3d56e3740 1 -- 172.21.15.39:0/2907627772 wait complete. 2024-09-10T21:57:57.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.098+0000 7fc3d56e3740 20 client.25720 trim_cache size 0 max 16384 2024-09-10T21:57:57.099 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 msgr2=0x7fc3b80b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 0x7fc3b80b78f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8005ab0 tx=0x7fc3c8005a20 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 msgr2=0x7fc3cc19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 0x7fc3cc19ebd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400ec50 tx=0x7fc3c400c6a0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 shutdown_connections 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc3b80b5430 0x7fc3b80b78f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3cc108040 0x7fc3cc19ebd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3cc1076c0 0x7fc3cc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 --2- 172.21.15.39:0/2119152128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3cc101cb0 0x7fc3cc1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 >> 172.21.15.39:0/2119152128 conn(0x7fc3cc0fd740 msgr2=0x7fc3cc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 shutdown_connections 2024-09-10T21:57:57.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:57.099+0000 7fc3d330e640 1 -- 172.21.15.39:0/2119152128 wait complete. 2024-09-10T21:57:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:57 smithi039 ceph-mon[30872]: pgmap v429: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 920 KiB/s wr, 223 op/s 2024-09-10T21:57:57.405 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:57 smithi070 ceph-mon[34909]: pgmap v429: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 920 KiB/s wr, 223 op/s 2024-09-10T21:57:57.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:57 smithi173 ceph-mon[35294]: pgmap v429: 97 pgs: 97 active+clean; 213 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 920 KiB/s wr, 223 op/s 2024-09-10T21:57:57.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:57:58.288 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:57:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 -- 172.21.15.39:0/3750181007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9010d110 msgr2=0x7fec9010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 --2- 172.21.15.39:0/3750181007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9010d110 0x7fec9010f570 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fec88009ca0 tx=0x7fec8802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 -- 172.21.15.39:0/3750181007 shutdown_connections 2024-09-10T21:57:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 --2- 172.21.15.39:0/3750181007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9010d110 0x7fec9010f570 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 --2- 172.21.15.39:0/3750181007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec901045d0 0x7fec9010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 --2- 172.21.15.39:0/3750181007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec90103cb0 0x7fec90104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 -- 172.21.15.39:0/3750181007 >> 172.21.15.39:0/3750181007 conn(0x7fec900fd6f0 msgr2=0x7fec900ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 -- 172.21.15.39:0/3750181007 shutdown_connections 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.734+0000 7fec964a4640 1 -- 172.21.15.39:0/3750181007 wait complete. 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.735+0000 7fec964a4640 1 Processor -- start 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.735+0000 7fec964a4640 1 -- start start 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 0x7fec901023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112d80 con 0x7fec901045d0 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112c00 con 0x7fec90103cb0 2024-09-10T21:57:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec964a4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec90112f00 con 0x7fec9010d110 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42298/0 (socket says 172.21.15.39:42298) 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45156/0 (socket says 172.21.15.39:45156) 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec8f7fe640 1 -- 172.21.15.39:0/4087667009 learned_addr learned my addr 172.21.15.39:0/4087667009 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.736+0000 7fec94a41640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 0x7fec901023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 -- 172.21.15.39:0/4087667009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 msgr2=0x7fec901023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 0x7fec901023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 -- 172.21.15.39:0/4087667009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 msgr2=0x7fec90101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 -- 172.21.15.39:0/4087667009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901a7670 con 0x7fec901045d0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec94a41640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 0x7fec901023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8ffff640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d740 tx=0x7fec8400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8d7fa640 1 -- 172.21.15.39:0/4087667009 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84017020 con 0x7fec901045d0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec8d7fa640 1 -- 172.21.15.39:0/4087667009 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec8400de50 con 0x7fec901045d0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.737+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec901a7960 con 0x7fec901045d0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.738+0000 7fec8d7fa640 1 -- 172.21.15.39:0/4087667009 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8400f620 con 0x7fec901045d0 2024-09-10T21:57:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.738+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a7e90 con 0x7fec901045d0 2024-09-10T21:57:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.742+0000 7fec98879740 1 Processor -- start 2024-09-10T21:57:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 -- start start 2024-09-10T21:57:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec8d7fa640 1 -- 172.21.15.39:0/4087667009 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fec84010460 con 0x7fec901045d0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db24b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 0x5642db268850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 0x5642db268850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 0x5642db268850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:42312/0 (socket says 172.21.15.39:42312) 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec94a41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db24b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5642db1c1ea0 con 0x5642db24b4d0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec8ffff640 1 -- 172.21.15.39:0/585146746 learned_addr learned my addr 172.21.15.39:0/585146746 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642db1b12d0 con 0x5642db24bdf0 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.743+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5642db1b50e0 con 0x5642db268d90 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 -- 172.21.15.39:0/585146746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 msgr2=0x5642db268850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 0x5642db268850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 -- 172.21.15.39:0/585146746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 msgr2=0x5642db24b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db24b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 -- 172.21.15.39:0/585146746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642daf0f650 con 0x5642db268d90 2024-09-10T21:57:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26b180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec840e35d0 tx=0x7fec840ee580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91a65b5fbadaeab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.744+0000 7fec8d7fa640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 0x7fec780b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.745+0000 7fec767fc640 1 -- 172.21.15.39:0/585146746 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840a8970 con 0x5642db268d90 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.745+0000 7fec94a41640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 0x7fec780b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.745+0000 7fec767fc640 1 -- 172.21.15.39:0/585146746 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec840aca20 con 0x5642db268d90 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.745+0000 7fec767fc640 1 -- 172.21.15.39:0/585146746 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840aba90 con 0x5642db268d90 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.745+0000 7fec8d7fa640 1 -- 172.21.15.39:0/4087667009 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fec840e5bb0 con 0x7fec901045d0 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 msgr2=0x5642db26b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec94a41640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 0x7fec780b78a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fec88005fe0 tx=0x7fec88005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26b180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec840e35d0 tx=0x7fec840ee580 comp rx=0 tx=0).stop 2024-09-10T21:57:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 shutdown_connections 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26b180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24bdf0 0x5642db268850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 --2- 172.21.15.39:0/585146746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db24b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 >> 172.21.15.39:0/585146746 conn(0x5642db249300 msgr2=0x5642db24a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 shutdown_connections 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.746+0000 7fec98879740 1 -- 172.21.15.39:0/585146746 wait complete. 2024-09-10T21:57:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.747+0000 7fec98879740 1 -- start start 2024-09-10T21:57:58.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 Processor -- start 2024-09-10T21:57:58.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db268600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db265a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5642db012700 con 0x5642db24bdf0 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642db14c160 con 0x5642db24b4d0 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5642db26ba40 con 0x5642db268d90 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec98879740 10 client.0 _ll_register_callbacks cb 0x5642db1659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec94a41640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db265a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec94a41640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52582/0 (socket says 172.21.15.39:52582) 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.748+0000 7fec94a41640 1 -- 172.21.15.39:0/3084002922 learned_addr learned my addr 172.21.15.39:0/3084002922 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:58.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db268600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 -- 172.21.15.39:0/3084002922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 msgr2=0x5642db268600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db268600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 -- 172.21.15.39:0/3084002922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 msgr2=0x5642db265a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db265a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 -- 172.21.15.39:0/3084002922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642db179c90 con 0x5642db268d90 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db268600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec94a41640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec88035000 tx=0x7fec8802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9c87507c7e1351 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88004040 con 0x5642db268d90 2024-09-10T21:57:58.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fec88043030 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.749+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec840aca20 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec880041e0 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 10 client.25732 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5642db277350 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec840aca20 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fec8802f660 con 0x5642db268d90 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 10 client.25732 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 10 client.25732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 20 client.25732 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db278800 0x5642db27abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 4 client.25732 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642db1c3df0 con 0x5642db278800 2024-09-10T21:57:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.750+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db278800 0x5642db27abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.751+0000 7fec6f7fe640 10 client.25732 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.751+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db278800 0x5642db27abf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=202f293b6fbbc05d server_cookie=f7838a90dbf210f0 in_seq=0 out_seq=0 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3084002922 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642db1c3df0 con 0x5642db278800 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec6f7fe640 10 client.25732 handle_command_reply: tid=0 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 client.25732 shutdown 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 msgr2=0x5642db265fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec88035000 tx=0x7fec8802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 shutdown_connections 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db278800 0x5642db27abf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db265fd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db265a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec6f7fe640 0 client.25732 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 --2- 172.21.15.39:0/3084002922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db268600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 >> 172.21.15.39:0/3084002922 conn(0x5642db249300 msgr2=0x5642db24eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 shutdown_connections 2024-09-10T21:57:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 1 -- 172.21.15.39:0/3084002922 wait complete. 2024-09-10T21:57:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.752+0000 7fec98879740 20 client.25732 trim_cache size 0 max 16384 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.771+0000 7fec98879740 1 Processor -- start 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.771+0000 7fec98879740 1 -- start start 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db24bdf0 0x5642db24a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db268d90 0x5642db280500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec90070c10 con 0x5642db24b4d0 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec90072810 con 0x5642db268d90 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec98879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec900712e0 con 0x5642db24bdf0 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45192/0 (socket says 172.21.15.39:45192) 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 -- 172.21.15.39:0/1038075023 learned_addr learned my addr 172.21.15.39:0/1038075023 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db24bdf0 0x5642db24a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec94a41640 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db268d90 0x5642db280500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 -- 172.21.15.39:0/1038075023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db24bdf0 msgr2=0x5642db24a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db24bdf0 0x5642db24a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 -- 172.21.15.39:0/1038075023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db268d90 msgr2=0x5642db280500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db268d90 0x5642db280500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.772+0000 7fec8ffff640 1 -- 172.21.15.39:0/1038075023 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642db249130 con 0x5642db24b4d0 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.773+0000 7fec8ffff640 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x5642db24f710 tx=0x7fec80005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c34c1e0e68172b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.773+0000 7fec75ffb640 1 -- 172.21.15.39:0/1038075023 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8002a070 con 0x5642db24b4d0 2024-09-10T21:57:58.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.773+0000 7fec75ffb640 1 -- 172.21.15.39:0/1038075023 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec80025460 con 0x5642db24b4d0 2024-09-10T21:57:58.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.773+0000 7fec75ffb640 1 -- 172.21.15.39:0/1038075023 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8001e680 con 0x5642db24b4d0 2024-09-10T21:57:58.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.773+0000 7fec98879740 1 -- 172.21.15.39:0/1038075023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 msgr2=0x5642db274cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x5642db24f710 tx=0x7fec80005f90 comp rx=0 tx=0).stop 2024-09-10T21:57:58.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 -- 172.21.15.39:0/1038075023 shutdown_connections 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db268d90 0x5642db280500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db24bdf0 0x5642db24a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 --2- 172.21.15.39:0/1038075023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24b4d0 0x5642db274cd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 -- 172.21.15.39:0/1038075023 >> 172.21.15.39:0/1038075023 conn(0x5642db249300 msgr2=0x5642db24a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 -- 172.21.15.39:0/1038075023 shutdown_connections 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 -- 172.21.15.39:0/1038075023 wait complete. 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 -- start start 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.774+0000 7fec98879740 1 Processor -- start 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db270f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec90072080 con 0x5642db24bdf0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec900719b0 con 0x5642db24b4d0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec9006ec10 con 0x5642db268d90 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 10 client.0 _ll_register_callbacks cb 0x7fec88009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45202/0 (socket says 172.21.15.39:45202) 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 -- 172.21.15.39:0/3613999373 learned_addr learned my addr 172.21.15.39:0/3613999373 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db270f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec94a41640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 -- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 msgr2=0x5642db26dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 -- 172.21.15.39:0/3613999373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 msgr2=0x5642db270f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db270f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 -- 172.21.15.39:0/3613999373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642db26b920 con 0x5642db24bdf0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec8f7fe640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fec840a88f0 tx=0x7fec840e9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0515ea47af5f90a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840abc70 con 0x5642db24bdf0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fec84009c30 con 0x5642db24bdf0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.775+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec80025460 con 0x5642db24bdf0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec840abe60 con 0x5642db24bdf0 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 10 client.16137 fetch_fsmap learned FSMap version 30 2024-09-10T21:57:58.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5642db2e5fd0 con 0x5642db24bdf0 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec80025460 con 0x5642db24bdf0 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fec840a8590 con 0x5642db24bdf0 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 10 client.16137 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 10 client.16137 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 20 client.16137 populate_metadata read hostname 'smithi039' 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db2e6250 0x5642db2e8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 4 client.16137 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642db1bf8a0 con 0x5642db2e6250 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.776+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db2e6250 0x5642db2e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:57:58.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec8ffff640 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db2e6250 0x5642db2e8670 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=585593535321b1d8 server_cookie=ec38ebc9e9204ad5 in_seq=0 out_seq=0 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec6f7fe640 10 client.16137 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec6f7fe640 1 -- 172.21.15.39:0/3613999373 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642db1bf8a0 con 0x5642db2e6250 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec6f7fe640 10 client.16137 handle_command_reply: tid=0 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 client.16137 shutdown 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 msgr2=0x5642db271470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fec840a88f0 tx=0x7fec840e9b60 comp rx=0 tx=0).stop 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 shutdown_connections 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5642db2e6250 0x5642db2e8670 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642db268d90 0x5642db26dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642db24bdf0 0x5642db271470 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 --2- 172.21.15.39:0/3613999373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642db24b4d0 0x5642db270f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 >> 172.21.15.39:0/3613999373 conn(0x5642db249300 msgr2=0x5642db24a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec6f7fe640 0 client.16137 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 shutdown_connections 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 1 -- 172.21.15.39:0/3613999373 wait complete. 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.777+0000 7fec98879740 20 client.16137 trim_cache size 0 max 16384 2024-09-10T21:57:58.785 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:57:58.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 msgr2=0x7fec780b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 0x7fec780b78a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fec88005fe0 tx=0x7fec88005f70 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 msgr2=0x7fec90101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d740 tx=0x7fec8400dc00 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 shutdown_connections 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fec780b53e0 0x7fec780b78a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec9010d110 0x7fec901023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec901045d0 0x7fec90101ea0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 --2- 172.21.15.39:0/4087667009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90103cb0 0x7fec90101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:57:58.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 >> 172.21.15.39:0/4087667009 conn(0x7fec900fd6f0 msgr2=0x7fec900fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:57:58.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 shutdown_connections 2024-09-10T21:57:58.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:57:58.778+0000 7fec964a4640 1 -- 172.21.15.39:0/4087667009 wait complete. 2024-09-10T21:57:59.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:57:59 smithi070 ceph-mon[34909]: pgmap v430: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 289 op/s 2024-09-10T21:57:59.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:57:59 smithi039 ceph-mon[30872]: pgmap v430: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 289 op/s 2024-09-10T21:57:59.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:57:59 smithi173 ceph-mon[35294]: pgmap v430: 97 pgs: 97 active+clean; 212 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 289 op/s 2024-09-10T21:57:59.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:57:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 -- 172.21.15.39:0/1753292504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 msgr2=0x7f877810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 --2- 172.21.15.39:0/1753292504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 0x7f877810a930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8768009900 tx=0x7f876802a4b0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 -- 172.21.15.39:0/1753292504 shutdown_connections 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 --2- 172.21.15.39:0/1753292504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877811c0a0 0x7f877811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 --2- 172.21.15.39:0/1753292504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 0x7f877810a930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.430+0000 7f877f5ca640 1 --2- 172.21.15.39:0/1753292504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877810a150 0x7f87781111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.431+0000 7f877f5ca640 1 -- 172.21.15.39:0/1753292504 >> 172.21.15.39:0/1753292504 conn(0x7f877806dfc0 msgr2=0x7f877806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.431+0000 7f877f5ca640 1 -- 172.21.15.39:0/1753292504 shutdown_connections 2024-09-10T21:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.432+0000 7f877f5ca640 1 -- 172.21.15.39:0/1753292504 wait complete. 2024-09-10T21:58:00.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 Processor -- start 2024-09-10T21:58:00.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 -- start start 2024-09-10T21:58:00.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 0x7f87781a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877811c0a0 0x7f87781ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8778121b70 con 0x7f877811c0a0 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87781219f0 con 0x7f877810a150 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.433+0000 7f877f5ca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8778121cf0 con 0x7f877810a530 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.434+0000 7f877d366640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.434+0000 7f877d366640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:56894/0 (socket says 172.21.15.39:56894) 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.434+0000 7f877d366640 1 -- 172.21.15.39:0/2309399709 learned_addr learned my addr 172.21.15.39:0/2309399709 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.434+0000 7f877db67640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877811c0a0 0x7f87781ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 -- 172.21.15.39:0/2309399709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 msgr2=0x7f87781a85c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 0x7f87781a85c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 -- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877811c0a0 msgr2=0x7f87781ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877811c0a0 0x7f87781ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 -- 172.21.15.39:0/2309399709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87781ae130 con 0x7f877810a150 2024-09-10T21:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.435+0000 7f877d366640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f877400e9f0 tx=0x7f877400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.436+0000 7f876e7fc640 1 -- 172.21.15.39:0/2309399709 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877400cd80 con 0x7f877810a150 2024-09-10T21:58:00.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.436+0000 7f876e7fc640 1 -- 172.21.15.39:0/2309399709 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87740108e0 con 0x7f877810a150 2024-09-10T21:58:00.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.436+0000 7f876e7fc640 1 -- 172.21.15.39:0/2309399709 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774018980 con 0x7f877810a150 2024-09-10T21:58:00.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.436+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87781ae420 con 0x7f877810a150 2024-09-10T21:58:00.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.436+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87781b4ae0 con 0x7f877810a150 2024-09-10T21:58:00.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.441+0000 7f876e7fc640 1 -- 172.21.15.39:0/2309399709 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8774010430 con 0x7f877810a150 2024-09-10T21:58:00.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.442+0000 7f876e7fc640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 0x7f87640b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.442+0000 7f876e7fc640 1 -- 172.21.15.39:0/2309399709 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f87740e5ff0 con 0x7f877810a150 2024-09-10T21:58:00.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.443+0000 7f878199f740 1 Processor -- start 2024-09-10T21:58:00.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.444+0000 7f877cb65640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 0x7f87640b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.444+0000 7f877cb65640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 0x7f87640b79b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f87680096c0 tx=0x7f8768005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.445+0000 7f878199f740 1 -- start start 2024-09-10T21:58:00.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff94cea0 con 0x55e6ff9d60f0 2024-09-10T21:58:00.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff93c2d0 con 0x55e6ff9d6a10 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f878199f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff9400e0 con 0x55e6ff9e29a0 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877db67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877cb65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877db67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58560/0 (socket says 172.21.15.39:58560) 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877cb65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:56902/0 (socket says 172.21.15.39:56902) 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877db67640 1 -- 172.21.15.39:0/166906105 learned_addr learned my addr 172.21.15.39:0/166906105 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.446+0000 7f877d366640 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 -- 172.21.15.39:0/166906105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 msgr2=0x55e6ff9e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 -- 172.21.15.39:0/166906105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d60f0 msgr2=0x55e6ff9d64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9d64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 -- 172.21.15.39:0/166906105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6ff69a650 con 0x55e6ff9d6a10 2024-09-10T21:58:00.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.447+0000 7f877cb65640 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8768009850 tx=0x7f876803a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73477436e3217b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.448+0000 7f87637fe640 1 -- 172.21.15.39:0/166906105 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768040070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.448+0000 7f87637fe640 1 -- 172.21.15.39:0/166906105 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f876804c070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.448+0000 7f87637fe640 1 -- 172.21.15.39:0/166906105 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768035040 con 0x55e6ff9d6a10 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 -- 172.21.15.39:0/166906105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 msgr2=0x55e6ff9e2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8768009850 tx=0x7f876803a000 comp rx=0 tx=0).stop 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 -- 172.21.15.39:0/166906105 shutdown_connections 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9e2460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 --2- 172.21.15.39:0/166906105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.449+0000 7f878199f740 1 -- 172.21.15.39:0/166906105 >> 172.21.15.39:0/166906105 conn(0x55e6ff9d3f20 msgr2=0x55e6ff9d50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.450+0000 7f878199f740 1 -- 172.21.15.39:0/166906105 shutdown_connections 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.450+0000 7f878199f740 1 -- 172.21.15.39:0/166906105 wait complete. 2024-09-10T21:58:00.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.450+0000 7f878199f740 1 -- start start 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.451+0000 7f878199f740 1 Processor -- start 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.451+0000 7f878199f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.451+0000 7f878199f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.451+0000 7f877d366640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877d366640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58574/0 (socket says 172.21.15.39:58574) 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877d366640 1 -- 172.21.15.39:0/1479164890 learned_addr learned my addr 172.21.15.39:0/1479164890 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:00.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff79d700 con 0x55e6ff9d6a10 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff8d7160 con 0x55e6ff9e29a0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e6ff9e55c0 con 0x55e6ff9d60f0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f878199f740 10 client.0 _ll_register_callbacks cb 0x55e6ff8f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 -- 172.21.15.39:0/1479164890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 msgr2=0x55e6ff9e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 -- 172.21.15.39:0/1479164890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d6a10 msgr2=0x55e6ff9df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.452+0000 7f877db67640 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6ff904c90 con 0x55e6ff9e29a0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.453+0000 7f877d366640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.453+0000 7f877db67640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9dfda0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8770005fd0 tx=0x7f8770012e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eafe1e8e771b83df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.453+0000 7f8760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:00.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.454+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877000cd30 con 0x55e6ff9e29a0 2024-09-10T21:58:00.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.454+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f877001a3e0 con 0x55e6ff9e29a0 2024-09-10T21:58:00.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.454+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f876804c070 con 0x55e6ff9e29a0 2024-09-10T21:58:00.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.455+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f877001a5e0 con 0x55e6ff9e29a0 2024-09-10T21:58:00.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.455+0000 7f878199f740 10 client.25757 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.455+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e6ff9ee9d0 con 0x55e6ff9e29a0 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.455+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f877001ac30 con 0x55e6ff9e29a0 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.455+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f8770019070 con 0x55e6ff9e29a0 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 10 client.25757 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 10 client.25757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 20 client.25757 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ff9f2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 4 client.25757 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:00.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.456+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f876804c070 con 0x55e6ff9eff50 2024-09-10T21:58:00.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.462+0000 7f877d366640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ff9f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.463+0000 7f877d366640 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ff9f2410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeae86824d4b7030 server_cookie=9d8a9169f279b3c8 in_seq=0 out_seq=0 2024-09-10T21:58:00.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.463+0000 7f8760ff9640 10 client.25757 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:00.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f8760ff9640 1 -- 172.21.15.39:0/1479164890 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f876804c070 con 0x55e6ff9eff50 2024-09-10T21:58:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f8760ff9640 10 client.25757 handle_command_reply: tid=0 2024-09-10T21:58:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 client.25757 shutdown 2024-09-10T21:58:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 msgr2=0x55e6ff9dfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9dfda0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8770005fd0 tx=0x7f8770012e10 comp rx=0 tx=0).stop 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 shutdown_connections 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ff9f2410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f8760ff9640 0 client.25757 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9dfda0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 --2- 172.21.15.39:0/1479164890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.469+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 >> 172.21.15.39:0/1479164890 conn(0x55e6ff9d3f20 msgr2=0x55e6ff9d9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.470+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 shutdown_connections 2024-09-10T21:58:00.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.470+0000 7f878199f740 1 -- 172.21.15.39:0/1479164890 wait complete. 2024-09-10T21:58:00.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.470+0000 7f878199f740 20 client.25757 trim_cache size 0 max 16384 2024-09-10T21:58:00.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 Processor -- start 2024-09-10T21:58:00.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 -- start start 2024-09-10T21:58:00.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9df710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8778119cc0 con 0x55e6ff9e29a0 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b6600 con 0x55e6ff9d6a10 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f878199f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b50d0 con 0x55e6ff9d60f0 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f877cb65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f877cb65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:56918/0 (socket says 172.21.15.39:56918) 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f877d366640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9df710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.491+0000 7f877cb65640 1 -- 172.21.15.39:0/3767543069 learned_addr learned my addr 172.21.15.39:0/3767543069 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877db67640 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 -- 172.21.15.39:0/3767543069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 msgr2=0x55e6ff9df710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9df710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 -- 172.21.15.39:0/3767543069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 msgr2=0x55e6ff9ddfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9ddfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 -- 172.21.15.39:0/3767543069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6ff9e0380 con 0x55e6ff9d6a10 2024-09-10T21:58:00.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f877cb65640 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87680043a0 tx=0x7f8768004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856291b77f1159e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f8762ffd640 1 -- 172.21.15.39:0/3767543069 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768055070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f8762ffd640 1 -- 172.21.15.39:0/3767543069 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f876803e070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.492+0000 7f8762ffd640 1 -- 172.21.15.39:0/3767543069 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768035040 con 0x55e6ff9d6a10 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 -- 172.21.15.39:0/3767543069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 msgr2=0x55e6ff9dfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87680043a0 tx=0x7f8768004270 comp rx=0 tx=0).stop 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 -- 172.21.15.39:0/3767543069 shutdown_connections 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9ddfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9dfc50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 --2- 172.21.15.39:0/3767543069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9df710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 -- 172.21.15.39:0/3767543069 >> 172.21.15.39:0/3767543069 conn(0x55e6ff9d3f20 msgr2=0x55e6ff9da970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 -- 172.21.15.39:0/3767543069 shutdown_connections 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.493+0000 7f878199f740 1 -- 172.21.15.39:0/3767543069 wait complete. 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 -- start start 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 Processor -- start 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9f7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b5e70 con 0x55e6ff9e29a0 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b57a0 con 0x55e6ff9d6a10 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8778117ca0 con 0x55e6ff9d60f0 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f878199f740 10 client.0 _ll_register_callbacks cb 0x7f8770009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.494+0000 7f877d366640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877d366640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58584/0 (socket says 172.21.15.39:58584) 2024-09-10T21:58:00.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877d366640 1 -- 172.21.15.39:0/957185326 learned_addr learned my addr 172.21.15.39:0/957185326 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877db67640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 -- 172.21.15.39:0/957185326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 msgr2=0x55e6ff9f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 -- 172.21.15.39:0/957185326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 msgr2=0x55e6ff9e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 -- 172.21.15.39:0/957185326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6ff9e9dc0 con 0x55e6ff9d6a10 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877d366640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f877cb65640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9f7860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8768009900 tx=0x7f876802a4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e654f80c0f86f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f8760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876805e060 con 0x55e6ff9d6a10 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f876803e070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.495+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8768031ca0 con 0x55e6ff9d6a10 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8768035070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 10 client.25763 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e6ff9eb0c0 con 0x55e6ff9d6a10 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f876803e070 con 0x55e6ff9d6a10 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f8768058030 con 0x55e6ff9d6a10 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 10 client.25763 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 20 client.25763 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ffa62130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 4 client.25763 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:00.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6ff94edf0 con 0x55e6ff9eff50 2024-09-10T21:58:00.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.496+0000 7f877d366640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ffa62130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:00.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.497+0000 7f877d366640 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ffa62130 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879ae76c7735c181 server_cookie=e07b55b68086e2a7 in_seq=0 out_seq=0 2024-09-10T21:58:00.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.497+0000 7f8760ff9640 10 client.25763 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:00.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f8760ff9640 1 -- 172.21.15.39:0/957185326 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6ff94edf0 con 0x55e6ff9eff50 2024-09-10T21:58:00.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f8760ff9640 10 client.25763 handle_command_reply: tid=0 2024-09-10T21:58:00.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 client.25763 shutdown 2024-09-10T21:58:00.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 msgr2=0x55e6ff9f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9f7860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8768009900 tx=0x7f876802a4b0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 shutdown_connections 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55e6ff9eff50 0x55e6ffa62130 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6ff9e29a0 0x55e6ff9e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6ff9d6a10 0x55e6ff9f7860 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 --2- 172.21.15.39:0/957185326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e6ff9d60f0 0x55e6ff9f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 >> 172.21.15.39:0/957185326 conn(0x55e6ff9d3f20 msgr2=0x55e6ff9df600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f8760ff9640 0 client.25763 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 shutdown_connections 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 1 -- 172.21.15.39:0/957185326 wait complete. 2024-09-10T21:58:00.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.502+0000 7f878199f740 20 client.25763 trim_cache size 0 max 16384 2024-09-10T21:58:00.508 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 msgr2=0x7f87640b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 0x7f87640b79b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f87680096c0 tx=0x7f8768005fd0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 msgr2=0x7f87781a8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f877400e9f0 tx=0x7f877400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 shutdown_connections 2024-09-10T21:58:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f87640b54f0 0x7f87640b79b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f877811c0a0 0x7f87781ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f877810a530 0x7f87781a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 --2- 172.21.15.39:0/2309399709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f877810a150 0x7f87781a8080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 >> 172.21.15.39:0/2309399709 conn(0x7f877806dfc0 msgr2=0x7f877811c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 shutdown_connections 2024-09-10T21:58:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:00.503+0000 7f877f5ca640 1 -- 172.21.15.39:0/2309399709 wait complete. 2024-09-10T21:58:01.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:01 smithi039 ceph-mon[30872]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 302 op/s 2024-09-10T21:58:01.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:01 smithi173 ceph-mon[35294]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 302 op/s 2024-09-10T21:58:01.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:01 smithi070 ceph-mon[34909]: pgmap v431: 97 pgs: 97 active+clean; 214 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 302 op/s 2024-09-10T21:58:02.444 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:58:02.444 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:58:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:03.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 -- 172.21.15.39:0/22366406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc1087f0 msgr2=0x7feccc108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 --2- 172.21.15.39:0/22366406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc1087f0 0x7feccc108c30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009900 tx=0x7fecc002a410 comp rx=0 tx=0).stop 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 -- 172.21.15.39:0/22366406 shutdown_connections 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 --2- 172.21.15.39:0/22366406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc109170 0x7feccc10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 --2- 172.21.15.39:0/22366406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc1087f0 0x7feccc108c30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 --2- 172.21.15.39:0/22366406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 0x7feccc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.198+0000 7fecd1f64640 1 -- 172.21.15.39:0/22366406 >> 172.21.15.39:0/22366406 conn(0x7feccc0fe830 msgr2=0x7feccc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.199+0000 7fecd1f64640 1 -- 172.21.15.39:0/22366406 shutdown_connections 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.199+0000 7fecd1f64640 1 -- 172.21.15.39:0/22366406 wait complete. 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.199+0000 7fecd1f64640 1 Processor -- start 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.199+0000 7fecd1f64640 1 -- start start 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 0x7feccc199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 0x7feccc1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feccc112e30 con 0x7feccc109170 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feccc112cb0 con 0x7feccc1087f0 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7fecd1f64640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feccc112fb0 con 0x7feccc102de0 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49192/0 (socket says 172.21.15.39:49192) 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 -- 172.21.15.39:0/4030220461 learned_addr learned my addr 172.21.15.39:0/4030220461 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccaffd640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 0x7feccc1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccb7fe640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 0x7feccc199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 -- 172.21.15.39:0/4030220461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 msgr2=0x7feccc199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 0x7feccc199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 -- 172.21.15.39:0/4030220461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 msgr2=0x7feccc1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 0x7feccc1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 -- 172.21.15.39:0/4030220461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc19f410 con 0x7feccc109170 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccaffd640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 0x7feccc1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.200+0000 7feccbfff640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fecc400eb10 tx=0x7fecc400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.201+0000 7fecc8ff9640 1 -- 172.21.15.39:0/4030220461 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4004b20 con 0x7feccc109170 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.201+0000 7fecc8ff9640 1 -- 172.21.15.39:0/4030220461 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc4004cc0 con 0x7feccc109170 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.201+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc19f700 con 0x7feccc109170 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.201+0000 7fecc8ff9640 1 -- 172.21.15.39:0/4030220461 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4010670 con 0x7feccc109170 2024-09-10T21:58:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.201+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a5dc0 con 0x7feccc109170 2024-09-10T21:58:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 Processor -- start 2024-09-10T21:58:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecc8ff9640 1 -- 172.21.15.39:0/4030220461 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fecc4005020 con 0x7feccc109170 2024-09-10T21:58:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 -- start start 2024-09-10T21:58:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed3682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed378ba0 0x5653ed37af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5653ed2dee60 con 0x5653ed368800 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653ed2ce290 con 0x5653ed378ba0 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.204+0000 7fecd4339740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653ed2d20a0 con 0x5653ed367ee0 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed378ba0 0x5653ed37af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49206/0 (socket says 172.21.15.39:49206) 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 -- 172.21.15.39:0/3535467107 learned_addr learned my addr 172.21.15.39:0/3535467107 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccaffd640 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed3682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 -- 172.21.15.39:0/3535467107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 msgr2=0x5653ed3682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed3682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 -- 172.21.15.39:0/3535467107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed378ba0 msgr2=0x5653ed37af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed378ba0 0x5653ed37af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 -- 172.21.15.39:0/3535467107 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ed02c930 con 0x5653ed368800 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccb7fe640 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d20 tx=0x7fecbc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7987b7d1948793d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7fecc8ff9640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 0x7fecb40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7fecb1ffb640 1 -- 172.21.15.39:0/3535467107 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc004230 con 0x5653ed368800 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7feccaffd640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 0x7fecb40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.205+0000 7fecc8ff9640 1 -- 172.21.15.39:0/4030220461 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fecc40e5fd0 con 0x7feccc109170 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecb1ffb640 1 -- 172.21.15.39:0/3535467107 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecbc009e10 con 0x5653ed368800 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecb1ffb640 1 -- 172.21.15.39:0/3535467107 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc019780 con 0x5653ed368800 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 -- 172.21.15.39:0/3535467107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 msgr2=0x5653ed378660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7feccaffd640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 0x7fecb40b7820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecc0031440 tx=0x7fecc0041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d20 tx=0x7fecbc011810 comp rx=0 tx=0).stop 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 -- 172.21.15.39:0/3535467107 shutdown_connections 2024-09-10T21:58:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed378ba0 0x5653ed37af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed368800 0x5653ed378660 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 --2- 172.21.15.39:0/3535467107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed3682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.206+0000 7fecd4339740 1 -- 172.21.15.39:0/3535467107 >> 172.21.15.39:0/3535467107 conn(0x5653ed365d10 msgr2=0x5653ed366eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- 172.21.15.39:0/3535467107 shutdown_connections 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- 172.21.15.39:0/3535467107 wait complete. 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- start start 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 Processor -- start 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed376040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed378ba0 0x5653ed376580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5653ed12f890 con 0x5653ed367ee0 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653ed268d40 con 0x5653ed368800 2024-09-10T21:58:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.207+0000 7fecd4339740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653ed37b850 con 0x5653ed378ba0 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7fecd4339740 10 client.0 _ll_register_callbacks cb 0x5653ed2ccc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed376040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49216/0 (socket says 172.21.15.39:49216) 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccb7fe640 1 -- 172.21.15.39:0/1967529907 learned_addr learned my addr 172.21.15.39:0/1967529907 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 -- 172.21.15.39:0/1967529907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed378ba0 msgr2=0x5653ed376580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed378ba0 0x5653ed376580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 -- 172.21.15.39:0/1967529907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 msgr2=0x5653ed375b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 -- 172.21.15.39:0/1967529907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ed384c00 con 0x5653ed368800 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccb7fe640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7feccaffd640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed376040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006010 tx=0x7fecc002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d609b02ad7eee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7fecaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00037f0 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.208+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecbc009e10 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fecc0003990 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fecc0003b90 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 10 client.25775 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653ed387600 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecbc009e10 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fecc0055430 con 0x5653ed368800 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 10 client.25775 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 10 client.25775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 20 client.25775 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed388b20 0x5653ed38af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 4 client.25775 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ed2e0db0 con 0x5653ed388b20 2024-09-10T21:58:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.209+0000 7feccb7fe640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed388b20 0x5653ed38af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.210+0000 7feccb7fe640 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed388b20 0x5653ed38af90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69933c4ddc6d0d16 server_cookie=59289c1e8da21e5e in_seq=0 out_seq=0 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.210+0000 7fecaaffd640 10 client.25775 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.213+0000 7fecaaffd640 1 -- 172.21.15.39:0/1967529907 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653ed2e0db0 con 0x5653ed388b20 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecaaffd640 10 client.25775 handle_command_reply: tid=0 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 client.25775 shutdown 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 msgr2=0x5653ed376040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed376040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006010 tx=0x7fecc002a410 comp rx=0 tx=0).stop 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 shutdown_connections 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed388b20 0x5653ed38af90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed378ba0 0x5653ed376580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed376040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecaaffd640 0 client.25775 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 --2- 172.21.15.39:0/1967529907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed367ee0 0x5653ed375b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 >> 172.21.15.39:0/1967529907 conn(0x5653ed365d10 msgr2=0x5653ed364f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 shutdown_connections 2024-09-10T21:58:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 1 -- 172.21.15.39:0/1967529907 wait complete. 2024-09-10T21:58:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.214+0000 7fecd4339740 20 client.25775 trim_cache size 0 max 16384 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 Processor -- start 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 -- start start 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 0x5653ed374380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 0x5653ed3748c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ac1c0 con 0x5653ed378ba0 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1addc0 con 0x5653ed367ee0 2024-09-10T21:58:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.232+0000 7fecd4339740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ac890 con 0x5653ed368800 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 0x5653ed374380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49228/0 (socket says 172.21.15.39:49228) 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 -- 172.21.15.39:0/4237025896 learned_addr learned my addr 172.21.15.39:0/4237025896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccaffd640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 0x5653ed3748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 -- 172.21.15.39:0/4237025896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 msgr2=0x5653ed3748c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 0x5653ed3748c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 -- 172.21.15.39:0/4237025896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 msgr2=0x5653ed374380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 0x5653ed374380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 -- 172.21.15.39:0/4237025896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ed373a70 con 0x5653ed378ba0 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccb7fe640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 0x5653ed374380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccaffd640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 0x5653ed3748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:58:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7feccbfff640 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ac7d0 tx=0x7fecc4004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852071fb15b6b7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7fecb17fa640 1 -- 172.21.15.39:0/4237025896 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40ac190 con 0x5653ed378ba0 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7fecb17fa640 1 -- 172.21.15.39:0/4237025896 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc40ac350 con 0x5653ed378ba0 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.233+0000 7fecb17fa640 1 -- 172.21.15.39:0/4237025896 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40abfb0 con 0x5653ed378ba0 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.234+0000 7fecd4339740 1 -- 172.21.15.39:0/4237025896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 msgr2=0x5653ed390850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ac7d0 tx=0x7fecc4004f40 comp rx=0 tx=0).stop 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 -- 172.21.15.39:0/4237025896 shutdown_connections 2024-09-10T21:58:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed390850 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed368800 0x5653ed3748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 --2- 172.21.15.39:0/4237025896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed367ee0 0x5653ed374380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 -- 172.21.15.39:0/4237025896 >> 172.21.15.39:0/4237025896 conn(0x5653ed365d10 msgr2=0x5653ed3669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 -- 172.21.15.39:0/4237025896 shutdown_connections 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 -- 172.21.15.39:0/4237025896 wait complete. 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 -- start start 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.235+0000 7fecd4339740 1 Processor -- start 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed381060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed37bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1ad630 con 0x5653ed378ba0 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1acf60 con 0x5653ed368800 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1aa1a0 con 0x5653ed367ee0 2024-09-10T21:58:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7fecd4339740 10 client.0 _ll_register_callbacks cb 0x7fecc0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed381060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58650/0 (socket says 172.21.15.39:58650) 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 -- 172.21.15.39:0/2638216910 learned_addr learned my addr 172.21.15.39:0/2638216910 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 -- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 msgr2=0x5653ed381060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed381060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 -- 172.21.15.39:0/2638216910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 msgr2=0x5653ed37bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccbfff640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed37bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed37bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccb7fe640 1 -- 172.21.15.39:0/2638216910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ed37c060 con 0x5653ed367ee0 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccaffd640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed381060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.236+0000 7feccbfff640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed37bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7feccb7fe640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d20 tx=0x7fecbc009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902641d7bec2ae32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc005520 con 0x5653ed367ee0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc40ac350 con 0x5653ed367ee0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fecbc0035f0 con 0x5653ed367ee0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fecbc0037f0 con 0x5653ed367ee0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecd4339740 10 client.25765 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653ed3f6310 con 0x5653ed367ee0 2024-09-10T21:58:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc40ac350 con 0x5653ed367ee0 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.237+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fecbc019a00 con 0x5653ed367ee0 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 10 client.25765 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 10 client.25765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 20 client.25765 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed3f6940 0x5653ed3f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 4 client.25765 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:58:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5653ed37b3a0 con 0x5653ed3f6940 2024-09-10T21:58:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7feccaffd640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed3f6940 0x5653ed3f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7fecaaffd640 10 client.25765 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.238+0000 7feccaffd640 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed3f6940 0x5653ed3f8d60 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c04a9f0bc513a1f server_cookie=c1f3384a861fbc78 in_seq=0 out_seq=0 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecaaffd640 1 -- 172.21.15.39:0/2638216910 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5653ed37b3a0 con 0x5653ed3f6940 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecaaffd640 10 client.25765 handle_command_reply: tid=0 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 client.25765 shutdown 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 msgr2=0x5653ed380b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d20 tx=0x7fecbc009f00 comp rx=0 tx=0).stop 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 shutdown_connections 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ed3f6940 0x5653ed3f8d60 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ed378ba0 0x5653ed37bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ed368800 0x5653ed381060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 --2- 172.21.15.39:0/2638216910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ed367ee0 0x5653ed380b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecaaffd640 0 client.25765 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.245+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 >> 172.21.15.39:0/2638216910 conn(0x5653ed365d10 msgr2=0x5653ed3669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.246+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 shutdown_connections 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.246+0000 7fecd4339740 1 -- 172.21.15.39:0/2638216910 wait complete. 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.246+0000 7fecd4339740 20 client.25765 trim_cache size 0 max 16384 2024-09-10T21:58:03.248 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "fc795747-d38b-48fe-bda3-35a3a262b0df", 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 msgr2=0x7fecb40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 0x7fecb40b7820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecc0031440 tx=0x7fecc0041040 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 msgr2=0x7feccc19ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fecc400eb10 tx=0x7fecc400c2d0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 shutdown_connections 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fecb40b5360 0x7fecb40b7820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc109170 0x7feccc19ec40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc1087f0 0x7feccc1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 --2- 172.21.15.39:0/4030220461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feccc102de0 0x7feccc199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 >> 172.21.15.39:0/4030220461 conn(0x7feccc0fe830 msgr2=0x7feccc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 shutdown_connections 2024-09-10T21:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:03.247+0000 7fecd1f64640 1 -- 172.21.15.39:0/4030220461 wait complete. 2024-09-10T21:58:03.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:03 smithi039 ceph-mon[30872]: pgmap v432: 97 pgs: 97 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.4 MiB/s wr, 296 op/s 2024-09-10T21:58:03.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:03 smithi173 ceph-mon[35294]: pgmap v432: 97 pgs: 97 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.4 MiB/s wr, 296 op/s 2024-09-10T21:58:03.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:03 smithi070 ceph-mon[34909]: pgmap v432: 97 pgs: 97 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.4 MiB/s wr, 296 op/s 2024-09-10T21:58:04.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:58:04.288 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:04.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:58:04.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:04.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:04.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:04.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:04 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:58:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:04.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:04.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:04 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:58:04.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:04.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:04.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:04.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:04 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:04.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- 172.21.15.39:0/1366551974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 msgr2=0x7f9c5010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 --2- 172.21.15.39:0/1366551974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5010f560 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ca0 tx=0x7f9c4802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- 172.21.15.39:0/1366551974 shutdown_connections 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 --2- 172.21.15.39:0/1366551974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5010f560 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 --2- 172.21.15.39:0/1366551974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c501045c0 0x7f9c5010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 --2- 172.21.15.39:0/1366551974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c50103ca0 0x7f9c50104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- 172.21.15.39:0/1366551974 >> 172.21.15.39:0/1366551974 conn(0x7f9c500fd700 msgr2=0x7f9c500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- 172.21.15.39:0/1366551974 shutdown_connections 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- 172.21.15.39:0/1366551974 wait complete. 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 Processor -- start 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.853+0000 7f9c57d86640 1 -- start start 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c501045c0 0x7f9c501997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50112d70 con 0x7f9c5010d100 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50112bf0 con 0x7f9c50103ca0 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c57d86640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50112ef0 con 0x7f9c501045c0 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:56996/0 (socket says 172.21.15.39:56996) 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49262/0 (socket says 172.21.15.39:49262) 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 -- 172.21.15.39:0/165134498 learned_addr learned my addr 172.21.15.39:0/165134498 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55321640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c501045c0 0x7f9c501997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 -- 172.21.15.39:0/165134498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c501045c0 msgr2=0x7f9c501997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c501045c0 0x7f9c501997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 -- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 msgr2=0x7f9c5019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 -- 172.21.15.39:0/165134498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5019f310 con 0x7f9c50103ca0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c56323640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.854+0000 7f9c55b22640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00e9f0 tx=0x7f9c4c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.855+0000 7f9c46ffd640 1 -- 172.21.15.39:0/165134498 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00cd80 con 0x7f9c50103ca0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.855+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5019f600 con 0x7f9c50103ca0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.855+0000 7f9c46ffd640 1 -- 172.21.15.39:0/165134498 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c4c0054d0 con 0x7f9c50103ca0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.855+0000 7f9c46ffd640 1 -- 172.21.15.39:0/165134498 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c010690 con 0x7f9c50103ca0 2024-09-10T21:58:04.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.855+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c501a5cc0 con 0x7f9c50103ca0 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.858+0000 7f9c5a15b740 1 Processor -- start 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.858+0000 7f9c5a15b740 1 -- start start 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.858+0000 7f9c46ffd640 1 -- 172.21.15.39:0/165134498 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9c4c004e90 con 0x7f9c50103ca0 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0543c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0546530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560af04a9e50 con 0x560af0533da0 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560af0499280 con 0x560af0544140 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560af049d090 con 0x560af0533480 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c55b22640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0543c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58690/0 (socket says 172.21.15.39:58690) 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 -- 172.21.15.39:0/882226973 learned_addr learned my addr 172.21.15.39:0/882226973 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c55321640 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0546530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 -- 172.21.15.39:0/882226973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 msgr2=0x560af0546530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0546530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 -- 172.21.15.39:0/882226973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 msgr2=0x560af0543c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0543c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 -- 172.21.15.39:0/882226973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af01f7650 con 0x560af0533480 2024-09-10T21:58:04.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c46ffd640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 0x7f9c3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.859+0000 7f9c56323640 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009400 tx=0x7f9c4802f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c06fd322d9873b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c55b22640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 0x7f9c3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c3bfff640 1 -- 172.21.15.39:0/882226973 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031650 con 0x560af0533480 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c3bfff640 1 -- 172.21.15.39:0/882226973 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c48036040 con 0x560af0533480 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c3bfff640 1 -- 172.21.15.39:0/882226973 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48004400 con 0x560af0533480 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c46ffd640 1 -- 172.21.15.39:0/165134498 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9c4c0e5fd0 con 0x7f9c50103ca0 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c5a15b740 1 -- 172.21.15.39:0/882226973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 msgr2=0x560af0533860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c55b22640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 0x7f9c3c0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0e3e50 tx=0x7f9c4c0e9ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.860+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009400 tx=0x7f9c4802f310 comp rx=0 tx=0).stop 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 -- 172.21.15.39:0/882226973 shutdown_connections 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0546530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0543c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/882226973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0533860 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 -- 172.21.15.39:0/882226973 >> 172.21.15.39:0/882226973 conn(0x560af05312b0 msgr2=0x560af0532450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 -- 172.21.15.39:0/882226973 shutdown_connections 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 -- 172.21.15.39:0/882226973 wait complete. 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 -- start start 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.861+0000 7f9c5a15b740 1 Processor -- start 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0543730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533da0 0x560af0540f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560af02fa700 con 0x560af0544140 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560af0434110 con 0x560af0533da0 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560af0546c10 con 0x560af0533480 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c5a15b740 10 client.0 _ll_register_callbacks cb 0x560af044d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49282/0 (socket says 172.21.15.39:49282) 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 -- 172.21.15.39:0/3445292571 learned_addr learned my addr 172.21.15.39:0/3445292571 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c55321640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533da0 0x560af0540f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 -- 172.21.15.39:0/3445292571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 msgr2=0x560af0543730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0543730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 -- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533da0 msgr2=0x560af0540f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533da0 0x560af0540f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.862+0000 7f9c56323640 1 -- 172.21.15.39:0/3445292571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af0461c40 con 0x560af0544140 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.863+0000 7f9c56323640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c4802ade0 tx=0x7f9c48009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9283b092bd6ea553 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.863+0000 7f9c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.863+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48052020 con 0x560af0544140 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.863+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c48036040 con 0x560af0544140 2024-09-10T21:58:04.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.863+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9c48003df0 con 0x560af0544140 2024-09-10T21:58:04.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c48031760 con 0x560af0544140 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 10 client.16179 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560af053d470 con 0x560af0544140 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c48036040 con 0x560af0544140 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9c48044070 con 0x560af0544140 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 10 client.16179 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 20 client.16179 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af0557ef0 0x560af055a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 4 client.16179 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560af04abda0 con 0x560af0557ef0 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.864+0000 7f9c55321640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af0557ef0 0x560af055a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.865+0000 7f9c55321640 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af0557ef0 0x560af055a2e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0609fe46dc3ee41 server_cookie=74615f3ef7e484d5 in_seq=0 out_seq=0 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.865+0000 7f9c397fa640 10 client.16179 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.867+0000 7f9c397fa640 1 -- 172.21.15.39:0/3445292571 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560af04abda0 con 0x560af0557ef0 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.867+0000 7f9c397fa640 10 client.16179 handle_command_reply: tid=0 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.867+0000 7f9c5a15b740 1 client.16179 shutdown 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 msgr2=0x560af0541470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c4802ade0 tx=0x7f9c48009c30 comp rx=0 tx=0).stop 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 shutdown_connections 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af0557ef0 0x560af055a2e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0544140 0x560af0541470 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533da0 0x560af0540f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/3445292571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533480 0x560af0543730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 >> 172.21.15.39:0/3445292571 conn(0x560af05312b0 msgr2=0x560af0536e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c397fa640 0 client.16179 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:04.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 shutdown_connections 2024-09-10T21:58:04.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 1 -- 172.21.15.39:0/3445292571 wait complete. 2024-09-10T21:58:04.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.868+0000 7f9c5a15b740 20 client.16179 trim_cache size 0 max 16384 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.886+0000 7f9c5a15b740 1 Processor -- start 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.886+0000 7f9c5a15b740 1 -- start start 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 0x560af0530bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0544140 0x560af053f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501ac120 con 0x560af0533da0 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501add20 con 0x560af0533480 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501ac7f0 con 0x560af0544140 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c56323640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 0x560af0530bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49286/0 (socket says 172.21.15.39:49286) 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 -- 172.21.15.39:0/2360826542 learned_addr learned my addr 172.21.15.39:0/2360826542 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:04.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c56323640 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0544140 0x560af053f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 -- 172.21.15.39:0/2360826542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0544140 msgr2=0x560af053f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0544140 0x560af053f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 -- 172.21.15.39:0/2360826542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 msgr2=0x560af0530bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 0x560af0530bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 -- 172.21.15.39:0/2360826542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af05416c0 con 0x560af0533da0 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c56323640 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 0x560af0530bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.887+0000 7f9c55321640 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009640 tx=0x7f9c40012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc8352823168d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c3b7fe640 1 -- 172.21.15.39:0/2360826542 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40005020 con 0x560af0533da0 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c3b7fe640 1 -- 172.21.15.39:0/2360826542 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c400047a0 con 0x560af0533da0 2024-09-10T21:58:04.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c3b7fe640 1 -- 172.21.15.39:0/2360826542 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40010670 con 0x560af0533da0 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2360826542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 msgr2=0x560af0559f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009640 tx=0x7f9c40012820 comp rx=0 tx=0).stop 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2360826542 shutdown_connections 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0544140 0x560af053f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533da0 0x560af0559f00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2360826542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0533480 0x560af0530bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2360826542 >> 172.21.15.39:0/2360826542 conn(0x560af05312b0 msgr2=0x560af0545010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2360826542 shutdown_connections 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.888+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2360826542 wait complete. 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 -- start start 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 Processor -- start 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533da0 0x560af0554e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0551700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501ad590 con 0x560af0533480 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501acec0 con 0x560af0544140 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501aa100 con 0x560af0533da0 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c5a15b740 10 client.0 _ll_register_callbacks cb 0x7f9c4c0e9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c56323640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49302/0 (socket says 172.21.15.39:49302) 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c56323640 1 -- 172.21.15.39:0/2965383321 learned_addr learned my addr 172.21.15.39:0/2965383321 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.889+0000 7f9c55321640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533da0 0x560af0554e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0551700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 -- 172.21.15.39:0/2965383321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533da0 msgr2=0x560af0554e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533da0 0x560af0554e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 -- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 msgr2=0x560af0551700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0551700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 -- 172.21.15.39:0/2965383321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af0551cc0 con 0x560af0533480 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c56323640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005e30 tx=0x7f9c48031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7452f9d216087af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48052040 con 0x560af0533480 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9c48030c00 con 0x560af0533480 2024-09-10T21:58:04.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c400047a0 con 0x560af0533480 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c4806b050 con 0x560af0533480 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c5a15b740 10 client.16185 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.890+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560af05c53c0 con 0x560af0533480 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c400047a0 con 0x560af0533480 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9c48044040 con 0x560af0533480 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 10 client.16185 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 20 client.16185 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af05c5ae0 0x560af05c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 4 client.16185 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560af04a7850 con 0x560af05c5ae0 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.891+0000 7f9c55321640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af05c5ae0 0x560af05c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.892+0000 7f9c397fa640 10 client.16185 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:04.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.892+0000 7f9c55321640 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af05c5ae0 0x560af05c7f00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=521ce07c833ab95 server_cookie=d24c484ed310bc0a in_seq=0 out_seq=0 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c397fa640 1 -- 172.21.15.39:0/2965383321 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1715 (crc 0 0 0) 0x560af04a7850 con 0x560af05c5ae0 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c397fa640 10 client.16185 handle_command_reply: tid=0 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 client.16185 shutdown 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 msgr2=0x560af0554910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005e30 tx=0x7f9c48031a10 comp rx=0 tx=0).stop 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 shutdown_connections 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560af05c5ae0 0x560af05c7f00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560af0544140 0x560af0551700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560af0533da0 0x560af0554e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c397fa640 0 client.16185 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 --2- 172.21.15.39:0/2965383321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560af0533480 0x560af0554910 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.895+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 >> 172.21.15.39:0/2965383321 conn(0x560af05312b0 msgr2=0x560af05323e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 shutdown_connections 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c5a15b740 1 -- 172.21.15.39:0/2965383321 wait complete. 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c5a15b740 20 client.16185 trim_cache size 0 max 16384 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (9640 inodes in the stack)", 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "fc795747-d38b-48fe-bda3-35a3a262b0df", 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:58:04.899 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:58:04.900 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:04.901 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:04.902 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 msgr2=0x7f9c3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 0x7f9c3c0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0e3e50 tx=0x7f9c4c0e9ab0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 msgr2=0x7f9c50199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00e9f0 tx=0x7f9c4c00edf0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 shutdown_connections 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9c3c0b52e0 0x7f9c3c0b77a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c5010d100 0x7f9c5019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c501045c0 0x7f9c501997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 --2- 172.21.15.39:0/165134498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c50103ca0 0x7f9c50199260 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 >> 172.21.15.39:0/165134498 conn(0x7f9c500fd700 msgr2=0x7f9c5010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 shutdown_connections 2024-09-10T21:58:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:04.896+0000 7f9c57d86640 1 -- 172.21.15.39:0/165134498 wait complete. 2024-09-10T21:58:05.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:05.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: pgmap v433: 97 pgs: 97 active+clean; 253 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-10T21:58:05.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:05.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:05 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: pgmap v433: 97 pgs: 97 active+clean; 253 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:05 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:05.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: pgmap v433: 97 pgs: 97 active+clean; 253 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-10T21:58:05.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:05.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:05 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 -- 172.21.15.39:0/1012448654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 msgr2=0x7fa4d4105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/1012448654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4105530 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009900 tx=0x7fa4cc02a410 comp rx=0 tx=0).stop 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 -- 172.21.15.39:0/1012448654 shutdown_connections 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/1012448654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4108670 0x7fa4d410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/1012448654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4105ac0 0x7fa4d4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/1012448654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4105530 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 -- 172.21.15.39:0/1012448654 >> 172.21.15.39:0/1012448654 conn(0x7fa4d40fd140 msgr2=0x7fa4d40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 -- 172.21.15.39:0/1012448654 shutdown_connections 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.826+0000 7fa4db2a9640 1 -- 172.21.15.39:0/1012448654 wait complete. 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 Processor -- start 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 -- start start 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4105ac0 0x7fa4d41014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4108670 0x7fa4d4101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410e5a0 con 0x7fa4d406b470 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410e420 con 0x7fa4d4108670 2024-09-10T21:58:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4db2a9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410e720 con 0x7fa4d4105ac0 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49316/0 (socket says 172.21.15.39:49316) 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4d9045640 1 -- 172.21.15.39:0/4081050171 learned_addr learned my addr 172.21.15.39:0/4081050171 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.827+0000 7fa4d9846640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4108670 0x7fa4d4101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d8844640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4105ac0 0x7fa4d41014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 -- 172.21.15.39:0/4081050171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4105ac0 msgr2=0x7fa4d41014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4105ac0 0x7fa4d41014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 -- 172.21.15.39:0/4081050171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4108670 msgr2=0x7fa4d4101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4108670 0x7fa4d4101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 -- 172.21.15.39:0/4081050171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d4102280 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d9045640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc005940 tx=0x7fa4cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d27fc640 1 -- 172.21.15.39:0/4081050171 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc03f030 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d27fc640 1 -- 172.21.15.39:0/4081050171 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4cc003cb0 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d41a2e00 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4d27fc640 1 -- 172.21.15.39:0/4081050171 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc035070 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.828+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d41a3210 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 Processor -- start 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d27fc640 1 -- 172.21.15.39:0/4081050171 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa4cc03bbe0 con 0x7fa4d406b470 2024-09-10T21:58:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 -- start start 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daaf4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 0x5606daaf7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5606daa616f0 con 0x5606daaef860 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5606daa50b20 con 0x5606daaf4bd0 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4de073740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5606daa54930 con 0x5606daaf2190 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daaf4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49324/0 (socket says 172.21.15.39:49324) 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d9846640 1 -- 172.21.15.39:0/2406092250 learned_addr learned my addr 172.21.15.39:0/2406092250 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 0x5606daaf7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 -- 172.21.15.39:0/2406092250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 msgr2=0x5606daaf4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daaf4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 -- 172.21.15.39:0/2406092250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 msgr2=0x5606daaf1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.831+0000 7fa4d8844640 1 -- 172.21.15.39:0/2406092250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606daa16530 con 0x5606daaf4bd0 2024-09-10T21:58:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4d9846640 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4d27fc640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 0x7fa4bc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4d8844640 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 0x5606daaf7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009c20 tx=0x7fa4c8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b26a15efdf5b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4d9846640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 0x7fa4bc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4bb7fe640 1 -- 172.21.15.39:0/2406092250 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c801e070 con 0x5606daaf4bd0 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4bb7fe640 1 -- 172.21.15.39:0/2406092250 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c8009dd0 con 0x5606daaf4bd0 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4bb7fe640 1 -- 172.21.15.39:0/2406092250 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80187d0 con 0x5606daaf4bd0 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.832+0000 7fa4d27fc640 1 -- 172.21.15.39:0/4081050171 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa4cc1061c0 con 0x7fa4d406b470 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- 172.21.15.39:0/2406092250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 msgr2=0x5606daaf7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4d9846640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 0x7fa4bc0b7820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011890 tx=0x7fa4c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 0x5606daaf7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009c20 tx=0x7fa4c8011810 comp rx=0 tx=0).stop 2024-09-10T21:58:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- 172.21.15.39:0/2406092250 shutdown_connections 2024-09-10T21:58:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf4bd0 0x5606daaf7090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daaf4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 --2- 172.21.15.39:0/2406092250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- 172.21.15.39:0/2406092250 >> 172.21.15.39:0/2406092250 conn(0x5606daaea9b0 msgr2=0x5606daaeb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- 172.21.15.39:0/2406092250 shutdown_connections 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- 172.21.15.39:0/2406092250 wait complete. 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 -- start start 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.833+0000 7fa4de073740 1 Processor -- start 2024-09-10T21:58:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaf9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf4bd0 0x5606daafa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5606da988ab0 con 0x5606daaef860 2024-09-10T21:58:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5606da9f6730 con 0x5606daaf2190 2024-09-10T21:58:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5606daaf7bb0 con 0x5606daaf4bd0 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4de073740 10 client.0 _ll_register_callbacks cb 0x5606daa4a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49338/0 (socket says 172.21.15.39:49338) 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d9045640 1 -- 172.21.15.39:0/1032003115 learned_addr learned my addr 172.21.15.39:0/1032003115 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaf9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d9846640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf4bd0 0x5606daafa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 -- 172.21.15.39:0/1032003115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf4bd0 msgr2=0x5606daafa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf4bd0 0x5606daafa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 -- 172.21.15.39:0/1032003115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 msgr2=0x5606daaf8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 -- 172.21.15.39:0/1032003115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606da7b2790 con 0x5606daaf2190 2024-09-10T21:58:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d9045640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4d8844640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaf9560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097b0 tx=0x7fa4c8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d2850cb0f078e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.834+0000 7fa4b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c801e040 con 0x5606daaf2190 2024-09-10T21:58:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c8009dd0 con 0x5606daaf2190 2024-09-10T21:58:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa4c8005460 con 0x5606daaf2190 2024-09-10T21:58:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4c80044e0 con 0x5606daaf2190 2024-09-10T21:58:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 10 client.25808 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606da82b620 con 0x5606daaf2190 2024-09-10T21:58:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c8009dd0 con 0x5606daaf2190 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa4c80037f0 con 0x5606daaf2190 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 10 client.25808 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 10 client.25808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 20 client.25808 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab07020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 4 client.25808 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.835+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606daa63640 con 0x5606dab04bc0 2024-09-10T21:58:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.836+0000 7fa4d9045640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab07020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.836+0000 7fa4b8ff9640 10 client.25808 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.836+0000 7fa4d9045640 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab07020 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1987d685640aaeee server_cookie=5634ba7be6acbade in_seq=0 out_seq=0 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/1032003115 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606daa63640 con 0x5606dab04bc0 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4b8ff9640 10 client.25808 handle_command_reply: tid=0 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 client.25808 shutdown 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 msgr2=0x5606daaf9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaf9560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097b0 tx=0x7fa4c8005270 comp rx=0 tx=0).stop 2024-09-10T21:58:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 shutdown_connections 2024-09-10T21:58:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab07020 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf4bd0 0x5606daafa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4b8ff9640 0 client.25808 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaf9560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 --2- 172.21.15.39:0/1032003115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaef860 0x5606daaf8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 >> 172.21.15.39:0/1032003115 conn(0x5606daaea9b0 msgr2=0x5606daae9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 shutdown_connections 2024-09-10T21:58:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 1 -- 172.21.15.39:0/1032003115 wait complete. 2024-09-10T21:58:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.839+0000 7fa4de073740 20 client.25808 trim_cache size 0 max 16384 2024-09-10T21:58:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 Processor -- start 2024-09-10T21:58:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 -- start start 2024-09-10T21:58:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaeecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41abff0 con 0x5606daaf4bd0 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41adbf0 con 0x5606daaf2190 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4de073740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41ac6c0 con 0x5606daaef860 2024-09-10T21:58:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49354/0 (socket says 172.21.15.39:49354) 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:58772/0 (socket says 172.21.15.39:58772) 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d9846640 1 -- 172.21.15.39:0/3409762979 learned_addr learned my addr 172.21.15.39:0/3409762979 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.854+0000 7fa4d8844640 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaeecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 -- 172.21.15.39:0/3409762979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 msgr2=0x5606daafaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 -- 172.21.15.39:0/3409762979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 msgr2=0x5606daaeecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaeecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 -- 172.21.15.39:0/3409762979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606daaf8c90 con 0x5606daaf4bd0 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9045640 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4d9846640 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40039f0 tx=0x7fa4c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7862f7ab71873ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4baffd640 1 -- 172.21.15.39:0/3409762979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4004b20 con 0x5606daaf4bd0 2024-09-10T21:58:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4baffd640 1 -- 172.21.15.39:0/3409762979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4004cc0 con 0x5606daaf4bd0 2024-09-10T21:58:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.855+0000 7fa4baffd640 1 -- 172.21.15.39:0/3409762979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4004860 con 0x5606daaf4bd0 2024-09-10T21:58:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- 172.21.15.39:0/3409762979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 msgr2=0x5606daaef200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40039f0 tx=0x7fa4c4016000 comp rx=0 tx=0).stop 2024-09-10T21:58:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- 172.21.15.39:0/3409762979 shutdown_connections 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daaef200 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaf2190 0x5606daaeecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 --2- 172.21.15.39:0/3409762979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaef860 0x5606daafaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- 172.21.15.39:0/3409762979 >> 172.21.15.39:0/3409762979 conn(0x5606daaea9b0 msgr2=0x5606daaf4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- 172.21.15.39:0/3409762979 shutdown_connections 2024-09-10T21:58:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- 172.21.15.39:0/3409762979 wait complete. 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 -- start start 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.856+0000 7fa4de073740 1 Processor -- start 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daafe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41ad460 con 0x5606daaf4bd0 2024-09-10T21:58:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41acd90 con 0x5606daaef860 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41a9fd0 con 0x5606daaf2190 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4de073740 10 client.0 _ll_register_callbacks cb 0x7fa4c801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49366/0 (socket says 172.21.15.39:49366) 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 -- 172.21.15.39:0/620037479 learned_addr learned my addr 172.21.15.39:0/620037479 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d8844640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daafe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9045640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57076/0 (socket says 172.21.15.39:57076) 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 -- 172.21.15.39:0/620037479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 msgr2=0x5606daafe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daafe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 -- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 msgr2=0x5606daafda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 -- 172.21.15.39:0/620037479 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606daaff320 con 0x5606daaf4bd0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9045640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d8844640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daafe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.857+0000 7fa4d9846640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4029040 tx=0x7fa4c4009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e706f933599d08c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4034020 con 0x5606daaf4bd0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa4c400fcc0 con 0x5606daaf4bd0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c4004cc0 con 0x5606daaf4bd0 2024-09-10T21:58:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4c4030480 con 0x5606daaf4bd0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 10 client.16203 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606dab00730 con 0x5606daaf4bd0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4004cc0 con 0x5606daaf4bd0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa4c4026070 con 0x5606daaf4bd0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 10 client.16203 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 20 client.16203 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab73b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 4 client.16203 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606daa5f0f0 con 0x5606dab04bc0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.858+0000 7fa4d9045640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab73b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.859+0000 7fa4d9045640 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab73b90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5579847fe3ef2b46 server_cookie=d133fc721338b608 in_seq=0 out_seq=0 2024-09-10T21:58:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:05.859+0000 7fa4b8ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:05.938 INFO:tasks.cephfs.filesystem:scrub status for tag:fc795747-d38b-48fe-bda3-35a3a262b0df - {'path': '/', 'tag': 'fc795747-d38b-48fe-bda3-35a3a262b0df', 'options': 'recursive,force'} 2024-09-10T21:58:06.501 INFO:tasks.workunit.client.0.smithi039.stdout: 71 177581 169 115794 156 97032 808 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.712+0000 7fa4b8ff9640 1 -- 172.21.15.39:0/620037479 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606daa5f0f0 con 0x5606dab04bc0 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.712+0000 7fa4b8ff9640 10 client.16203 handle_command_reply: tid=0 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.712+0000 7fa4de073740 1 client.16203 shutdown 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 msgr2=0x5606daafeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4029040 tx=0x7fa4c4009cf0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 shutdown_connections 2024-09-10T21:58:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5606dab04bc0 0x5606dab73b90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606daaf4bd0 0x5606daafeaf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5606daaf2190 0x5606daafe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4b8ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 --2- 172.21.15.39:0/620037479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606daaef860 0x5606daafda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 >> 172.21.15.39:0/620037479 conn(0x5606daaea9b0 msgr2=0x5606daaf4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 shutdown_connections 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 1 -- 172.21.15.39:0/620037479 wait complete. 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.713+0000 7fa4de073740 20 client.16203 trim_cache size 0 max 16384 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:58:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:58:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 msgr2=0x7fa4bc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 0x7fa4bc0b7820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011890 tx=0x7fa4c4009500 comp rx=0 tx=0).stop 2024-09-10T21:58:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 msgr2=0x7fa4d4102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc005940 tx=0x7fa4cc0042f0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 shutdown_connections 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa4bc0b5360 0x7fa4bc0b7820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4d4108670 0x7fa4d4101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4105ac0 0x7fa4d41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 --2- 172.21.15.39:0/4081050171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4d406b470 0x7fa4d4102c70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 >> 172.21.15.39:0/4081050171 conn(0x7fa4d40fd140 msgr2=0x7fa4d4103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 shutdown_connections 2024-09-10T21:58:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:06.714+0000 7fa4db2a9640 1 -- 172.21.15.39:0/4081050171 wait complete. 2024-09-10T21:58:07.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:07 smithi039 ceph-mon[30872]: pgmap v434: 97 pgs: 97 active+clean; 258 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-10T21:58:07.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:07 smithi173 ceph-mon[35294]: pgmap v434: 97 pgs: 97 active+clean; 258 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-10T21:58:07.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:07 smithi070 ceph-mon[34909]: pgmap v434: 97 pgs: 97 active+clean; 258 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-10T21:58:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:58:08.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:58:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:58:08.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:58:08.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:58:08.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:58:08.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:58:08.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:58:08.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:58:08.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:58:08.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:58:08.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:58:09.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:09 smithi173 ceph-mon[35294]: pgmap v435: 97 pgs: 97 active+clean; 240 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 821 op/s 2024-09-10T21:58:09.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:09 smithi070 ceph-mon[34909]: pgmap v435: 97 pgs: 97 active+clean; 240 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 821 op/s 2024-09-10T21:58:09.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:09 smithi039 ceph-mon[30872]: pgmap v435: 97 pgs: 97 active+clean; 240 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 821 op/s 2024-09-10T21:58:11.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:11 smithi173 ceph-mon[35294]: pgmap v436: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 1.22k op/s 2024-09-10T21:58:11.660 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:11 smithi070 ceph-mon[34909]: pgmap v436: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 1.22k op/s 2024-09-10T21:58:11.686 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:11 smithi039 ceph-mon[30872]: pgmap v436: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 1.22k op/s 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.476 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:13 smithi039 ceph-mon[30872]: pgmap v437: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 1.28k op/s 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:13.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:13 smithi173 ceph-mon[35294]: pgmap v437: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 1.28k op/s 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:13.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:13.657 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:13 smithi070 ceph-mon[34909]: pgmap v437: 97 pgs: 97 active+clean; 238 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 1.28k op/s 2024-09-10T21:58:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:15 smithi173 ceph-mon[35294]: pgmap v438: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 1.64k op/s 2024-09-10T21:58:15.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:15 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:15.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:15 smithi070 ceph-mon[34909]: pgmap v438: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 1.64k op/s 2024-09-10T21:58:15.656 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:15 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:15 smithi039 ceph-mon[30872]: pgmap v438: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 1.64k op/s 2024-09-10T21:58:15.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:15 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:16.501 INFO:tasks.workunit.client.0.smithi039.stdout: 71 11189 4 6599 0 5492 5 2024-09-10T21:58:17.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:17 smithi039 ceph-mon[30872]: pgmap v439: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.47k op/s 2024-09-10T21:58:17.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:17 smithi173 ceph-mon[35294]: pgmap v439: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.47k op/s 2024-09-10T21:58:17.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:17 smithi070 ceph-mon[34909]: pgmap v439: 97 pgs: 97 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.47k op/s 2024-09-10T21:58:18.489 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:18 smithi039 ceph-mon[30872]: pgmap v440: 97 pgs: 97 active+clean; 251 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 1.58k op/s 2024-09-10T21:58:18.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:18 smithi173 ceph-mon[35294]: pgmap v440: 97 pgs: 97 active+clean; 251 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 1.58k op/s 2024-09-10T21:58:18.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:18 smithi070 ceph-mon[34909]: pgmap v440: 97 pgs: 97 active+clean; 251 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 1.58k op/s 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 -- 172.21.15.39:0/1997192194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a9006bf50 msgr2=0x7f1a901055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 --2- 172.21.15.39:0/1997192194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a9006bf50 0x7f1a901055e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009900 tx=0x7f1a8002a410 comp rx=0 tx=0).stop 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 -- 172.21.15.39:0/1997192194 shutdown_connections 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 --2- 172.21.15.39:0/1997192194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a901086d0 0x7f1a9010ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 --2- 172.21.15.39:0/1997192194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a90105b20 0x7f1a90107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 --2- 172.21.15.39:0/1997192194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a9006bf50 0x7f1a901055e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 -- 172.21.15.39:0/1997192194 >> 172.21.15.39:0/1997192194 conn(0x7f1a900fd150 msgr2=0x7f1a900ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 -- 172.21.15.39:0/1997192194 shutdown_connections 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.814+0000 7f1a958ed640 1 -- 172.21.15.39:0/1997192194 wait complete. 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 Processor -- start 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 -- start start 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a9006bf50 0x7f1a90198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a90105b20 0x7f1a901993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9010e620 con 0x7f1a901086d0 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9010e4a0 con 0x7f1a9006bf50 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a958ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9010e7a0 con 0x7f1a90105b20 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a9006bf50 0x7f1a90198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50516/0 (socket says 172.21.15.39:50516) 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 -- 172.21.15.39:0/2026232539 learned_addr learned my addr 172.21.15.39:0/2026232539 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a87fff640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a90105b20 0x7f1a901993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 -- 172.21.15.39:0/2026232539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a90105b20 msgr2=0x7f1a901993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a90105b20 0x7f1a901993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 -- 172.21.15.39:0/2026232539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a9006bf50 msgr2=0x7f1a90198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a9006bf50 0x7f1a90198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.815+0000 7f1a8f7fe640 1 -- 172.21.15.39:0/2026232539 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9019a8e0 con 0x7f1a901086d0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800cce0 tx=0x7f1a8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a948eb640 1 -- 172.21.15.39:0/2026232539 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800f450 con 0x7f1a901086d0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a948eb640 1 -- 172.21.15.39:0/2026232539 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a8800faa0 con 0x7f1a901086d0 2024-09-10T21:58:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9019abd0 con 0x7f1a901086d0 2024-09-10T21:58:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a948eb640 1 -- 172.21.15.39:0/2026232539 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88018b70 con 0x7f1a901086d0 2024-09-10T21:58:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.816+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a901a12a0 con 0x7f1a901086d0 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.818+0000 7f1a986b8740 1 Processor -- start 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.818+0000 7f1a948eb640 1 -- 172.21.15.39:0/2026232539 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1a8800f5f0 con 0x7f1a901086d0 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.818+0000 7f1a986b8740 1 -- start start 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.818+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.818+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87bad9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87badc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a986b8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c87ba426f0 con 0x55c87bad4c70 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a986b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c87ba31b20 con 0x55c87bad75a0 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a986b8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c87ba35930 con 0x55c87bad9fe0 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50526/0 (socket says 172.21.15.39:50526) 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 -- 172.21.15.39:0/4139375590 learned_addr learned my addr 172.21.15.39:0/4139375590 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a8effd640 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87bad9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87badc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 -- 172.21.15.39:0/4139375590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 msgr2=0x55c87badc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87badc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 -- 172.21.15.39:0/4139375590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 msgr2=0x55c87bad9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87bad9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 -- 172.21.15.39:0/4139375590 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87b9f7530 con 0x55c87bad4c70 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a87fff640 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009fa0 tx=0x7f1a780097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f203646eb1635dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a85ffb640 1 -- 172.21.15.39:0/4139375590 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78010490 con 0x55c87bad4c70 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a85ffb640 1 -- 172.21.15.39:0/4139375590 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a78010ae0 con 0x55c87bad4c70 2024-09-10T21:58:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a85ffb640 1 -- 172.21.15.39:0/4139375590 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800f900 con 0x55c87bad4c70 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.819+0000 7f1a948eb640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 0x7f1a7c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a8effd640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 0x7f1a7c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a948eb640 1 -- 172.21.15.39:0/2026232539 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a880e62d0 con 0x7f1a901086d0 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- 172.21.15.39:0/4139375590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 msgr2=0x55c87bad7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a8effd640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 0x7f1a7c0b7820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a80000c00 tx=0x7f1a800314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009fa0 tx=0x7f1a780097b0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- 172.21.15.39:0/4139375590 shutdown_connections 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87badc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87bad9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 --2- 172.21.15.39:0/4139375590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bad7060 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- 172.21.15.39:0/4139375590 >> 172.21.15.39:0/4139375590 conn(0x55c87bacb9b0 msgr2=0x55c87bacc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- 172.21.15.39:0/4139375590 shutdown_connections 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- 172.21.15.39:0/4139375590 wait complete. 2024-09-10T21:58:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.820+0000 7f1a986b8740 1 -- start start 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 Processor -- start 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad75a0 0x55c87badea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad9fe0 0x55c87badf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c87b969ab0 con 0x55c87bad4c70 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c87b9d7730 con 0x55c87bad9fe0 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c87badcfc0 con 0x55c87bad75a0 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a986b8740 10 client.0 _ll_register_callbacks cb 0x55c87ba2b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50542/0 (socket says 172.21.15.39:50542) 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 -- 172.21.15.39:0/2268917882 learned_addr learned my addr 172.21.15.39:0/2268917882 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad9fe0 0x55c87badf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a87fff640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad75a0 0x55c87badea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 -- 172.21.15.39:0/2268917882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad75a0 msgr2=0x55c87badea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad75a0 0x55c87badea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 -- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad9fe0 msgr2=0x55c87badf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad9fe0 0x55c87badf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.821+0000 7f1a8effd640 1 -- 172.21.15.39:0/2268917882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87b793790 con 0x55c87bad4c70 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a8effd640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009900 tx=0x7f1a80009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7961e415ae04f51d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8004d070 con 0x55c87bad4c70 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a800035f0 con 0x55c87bad4c70 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a78010ae0 con 0x55c87bad4c70 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a80059050 con 0x55c87bad4c70 2024-09-10T21:58:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 10 client.16215 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c87b80c620 con 0x55c87bad4c70 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a78010ae0 con 0x55c87bad4c70 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1a8003da20 con 0x55c87bad4c70 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 10 client.16215 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 20 client.16215 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bae9c90 0x55c87baec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 4 client.16215 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.822+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c87ba44640 con 0x55c87bae9c90 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.823+0000 7f1a87fff640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bae9c90 0x55c87baec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.823+0000 7f1a6effd640 10 client.16215 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.823+0000 7f1a87fff640 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bae9c90 0x55c87baec110 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f227e94d6befe36e server_cookie=79d5250949925676 in_seq=0 out_seq=0 2024-09-10T21:58:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a6effd640 1 -- 172.21.15.39:0/2268917882 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c87ba44640 con 0x55c87bae9c90 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a6effd640 10 client.16215 handle_command_reply: tid=0 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 client.16215 shutdown 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 msgr2=0x55c87bade390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009900 tx=0x7f1a80009260 comp rx=0 tx=0).stop 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 shutdown_connections 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bae9c90 0x55c87baec110 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad9fe0 0x55c87badf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a6effd640 0 client.16215 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad75a0 0x55c87badea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 --2- 172.21.15.39:0/2268917882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87bade390 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 >> 172.21.15.39:0/2268917882 conn(0x55c87bacb9b0 msgr2=0x55c87bacabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 shutdown_connections 2024-09-10T21:58:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 1 -- 172.21.15.39:0/2268917882 wait complete. 2024-09-10T21:58:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.825+0000 7f1a986b8740 20 client.16215 trim_cache size 0 max 16384 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 Processor -- start 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 -- start start 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87badd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bada3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a7bc0 con 0x55c87bad4c70 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a97c0 con 0x55c87bad75a0 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a986b8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a8290 con 0x55c87bad9fe0 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50558/0 (socket says 172.21.15.39:50558) 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 -- 172.21.15.39:0/1469325218 learned_addr learned my addr 172.21.15.39:0/1469325218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a87fff640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87badd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 -- 172.21.15.39:0/1469325218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 msgr2=0x55c87bada3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bada3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bada3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 -- 172.21.15.39:0/1469325218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 msgr2=0x55c87badd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87badd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 -- 172.21.15.39:0/1469325218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87baccc10 con 0x55c87bad4c70 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a87fff640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87badd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bada3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.840+0000 7f1a8effd640 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1a800096c0 tx=0x7f1a8002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3776a4aa3e8f94fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a857fa640 1 -- 172.21.15.39:0/1469325218 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8004d040 con 0x55c87bad4c70 2024-09-10T21:58:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a857fa640 1 -- 172.21.15.39:0/1469325218 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a80062070 con 0x55c87bad4c70 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a857fa640 1 -- 172.21.15.39:0/1469325218 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80035040 con 0x55c87bad4c70 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- 172.21.15.39:0/1469325218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 msgr2=0x55c87badd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1a800096c0 tx=0x7f1a8002a410 comp rx=0 tx=0).stop 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- 172.21.15.39:0/1469325218 shutdown_connections 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bada3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad75a0 0x55c87badd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 --2- 172.21.15.39:0/1469325218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad4c70 0x55c87badd390 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- 172.21.15.39:0/1469325218 >> 172.21.15.39:0/1469325218 conn(0x55c87bacb9b0 msgr2=0x55c87bacfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- 172.21.15.39:0/1469325218 shutdown_connections 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- 172.21.15.39:0/1469325218 wait complete. 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.841+0000 7f1a986b8740 1 -- start start 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 Processor -- start 2024-09-10T21:58:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad4c70 0x55c87bae5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bae5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a9030 con 0x55c87bad75a0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a8960 con 0x55c87bad4c70 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901a5ba0 con 0x55c87bad9fe0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a986b8740 10 client.0 _ll_register_callbacks cb 0x7f1a800315a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50560/0 (socket says 172.21.15.39:50560) 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 -- 172.21.15.39:0/477912841 learned_addr learned my addr 172.21.15.39:0/477912841 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a8effd640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad4c70 0x55c87bae5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a8f7fe640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bae5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 -- 172.21.15.39:0/477912841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 msgr2=0x55c87bae5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bae5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 -- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad4c70 msgr2=0x55c87bae5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad4c70 0x55c87bae5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 -- 172.21.15.39:0/477912841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87bad73d0 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a87fff640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1a78014fd0 tx=0x7f1a78009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28708a6cc75e35a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.842+0000 7f1a6effd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a780052b0 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a78005450 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a80062070 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a78039050 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 10 client.16221 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c87badf970 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a80062070 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1a780035f0 con 0x55c87bad75a0 2024-09-10T21:58:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 10 client.16221 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 20 client.16221 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bb57260 0x55c87bb59680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 4 client.16221 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c87ba400f0 con 0x55c87bb57260 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.843+0000 7f1a8effd640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bb57260 0x55c87bb59680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.844+0000 7f1a6effd640 10 client.16221 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:19.844+0000 7f1a8effd640 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bb57260 0x55c87bb59680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8391dedf2d38dbf6 server_cookie=12332634ef567ea4 in_seq=0 out_seq=0 2024-09-10T21:58:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.616+0000 7f1a6effd640 1 -- 172.21.15.39:0/477912841 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c87ba400f0 con 0x55c87bb57260 2024-09-10T21:58:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.616+0000 7f1a6effd640 10 client.16221 handle_command_reply: tid=0 2024-09-10T21:58:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.616+0000 7f1a986b8740 1 client.16221 shutdown 2024-09-10T21:58:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 msgr2=0x55c87bae4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1a78014fd0 tx=0x7f1a78009650 comp rx=0 tx=0).stop 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 shutdown_connections 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c87bb57260 0x55c87bb59680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87bad9fe0 0x55c87bae5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c87bad75a0 0x55c87bae4cd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a6effd640 0 client.16221 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 --2- 172.21.15.39:0/477912841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c87bad4c70 0x55c87bae5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 >> 172.21.15.39:0/477912841 conn(0x55c87bacb9b0 msgr2=0x55c87badd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 shutdown_connections 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 1 -- 172.21.15.39:0/477912841 wait complete. 2024-09-10T21:58:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.617+0000 7f1a986b8740 20 client.16221 trim_cache size 0 max 16384 2024-09-10T21:58:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:58:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:58:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:58:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 msgr2=0x7f1a7c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 0x7f1a7c0b7820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a80000c00 tx=0x7f1a800314a0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 msgr2=0x7f1a9019a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800cce0 tx=0x7f1a8800a620 comp rx=0 tx=0).stop 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 shutdown_connections 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a7c0b5360 0x7f1a7c0b7820 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a901086d0 0x7f1a9019a020 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a90105b20 0x7f1a901993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 --2- 172.21.15.39:0/2026232539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a9006bf50 0x7f1a90198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 >> 172.21.15.39:0/2026232539 conn(0x7f1a900fd150 msgr2=0x7f1a90103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 shutdown_connections 2024-09-10T21:58:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:20.618+0000 7f1a958ed640 1 -- 172.21.15.39:0/2026232539 wait complete. 2024-09-10T21:58:20.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:20 smithi070 ceph-mon[34909]: pgmap v441: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 1.27k op/s 2024-09-10T21:58:20.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:20 smithi039 ceph-mon[30872]: pgmap v441: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 1.27k op/s 2024-09-10T21:58:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:20 smithi173 ceph-mon[35294]: pgmap v441: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 1.27k op/s 2024-09-10T21:58:21.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:21 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:58:21.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:21 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:58:21.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:21 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:58:21.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:21 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:58:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:21 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:58:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:21 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:58:22.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:22 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:58:22.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:22 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:58:22.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:22 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:58:22.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:22 smithi070 ceph-mon[34909]: pgmap v442: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 804 op/s 2024-09-10T21:58:22.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:22 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:58:22.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:22 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:58:22.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:22 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:58:22.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:22 smithi039 ceph-mon[30872]: pgmap v442: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 804 op/s 2024-09-10T21:58:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:22 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:58:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:22 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:58:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:22 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:58:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:22 smithi173 ceph-mon[35294]: pgmap v442: 97 pgs: 97 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 804 op/s 2024-09-10T21:58:24.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:24 smithi070 ceph-mon[34909]: pgmap v443: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T21:58:24.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:24 smithi039 ceph-mon[30872]: pgmap v443: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T21:58:24.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:24 smithi173 ceph-mon[35294]: pgmap v443: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T21:58:26.501 INFO:tasks.workunit.client.0.smithi039.stdout: 72 29637 97 19742 197 15089 322 2024-09-10T21:58:26.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:26 smithi070 ceph-mon[34909]: pgmap v444: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 497 op/s 2024-09-10T21:58:26.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:26 smithi039 ceph-mon[30872]: pgmap v444: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 497 op/s 2024-09-10T21:58:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:26 smithi173 ceph-mon[35294]: pgmap v444: 97 pgs: 97 active+clean; 242 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 497 op/s 2024-09-10T21:58:28.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:28 smithi070 ceph-mon[34909]: pgmap v445: 97 pgs: 97 active+clean; 247 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 449 op/s 2024-09-10T21:58:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:28 smithi039 ceph-mon[30872]: pgmap v445: 97 pgs: 97 active+clean; 247 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 449 op/s 2024-09-10T21:58:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:28 smithi173 ceph-mon[35294]: pgmap v445: 97 pgs: 97 active+clean; 247 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 449 op/s 2024-09-10T21:58:30.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:30 smithi070 ceph-mon[34909]: pgmap v446: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2024-09-10T21:58:30.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:30 smithi039 ceph-mon[30872]: pgmap v446: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2024-09-10T21:58:30.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:30 smithi173 ceph-mon[35294]: pgmap v446: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.0 MiB/s wr, 303 op/s 2024-09-10T21:58:32.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:32 smithi070 ceph-mon[34909]: pgmap v447: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-09-10T21:58:32.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:32 smithi039 ceph-mon[30872]: pgmap v447: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-09-10T21:58:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:32 smithi173 ceph-mon[35294]: pgmap v447: 97 pgs: 97 active+clean; 255 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-09-10T21:58:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 -- 172.21.15.39:0/4036077449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc102990 msgr2=0x7f58bc102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 --2- 172.21.15.39:0/4036077449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc102990 0x7f58bc102d90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009930 tx=0x7f58b802a420 comp rx=0 tx=0).stop 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 -- 172.21.15.39:0/4036077449 shutdown_connections 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 --2- 172.21.15.39:0/4036077449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc10ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 --2- 172.21.15.39:0/4036077449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc103ae0 0x7f58bc103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 --2- 172.21.15.39:0/4036077449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc102990 0x7f58bc102d90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 -- 172.21.15.39:0/4036077449 >> 172.21.15.39:0/4036077449 conn(0x7f58bc0fe250 msgr2=0x7f58bc100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 -- 172.21.15.39:0/4036077449 shutdown_connections 2024-09-10T21:58:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.729+0000 7f58c38a9640 1 -- 172.21.15.39:0/4036077449 wait complete. 2024-09-10T21:58:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 Processor -- start 2024-09-10T21:58:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 -- start start 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc102990 0x7f58bc076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc10e600 con 0x7f58bc103ae0 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc10e480 con 0x7f58bc1044a0 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c38a9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc10e780 con 0x7f58bc102990 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c1e46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35562/0 (socket says 172.21.15.39:35562) 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c0e44640 1 -- 172.21.15.39:0/479205419 learned_addr learned my addr 172.21.15.39:0/479205419 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c1e46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37838/0 (socket says 172.21.15.39:37838) 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.730+0000 7f58c1645640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc102990 0x7f58bc076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 -- 172.21.15.39:0/479205419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc102990 msgr2=0x7f58bc076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc102990 0x7f58bc076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 -- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 msgr2=0x7f58bc075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 -- 172.21.15.39:0/479205419 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc0762f0 con 0x7f58bc1044a0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c0e44640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c1e46640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009fd0 tx=0x7f58b400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58b27fc640 1 -- 172.21.15.39:0/479205419 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400ce20 con 0x7f58bc1044a0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58b27fc640 1 -- 172.21.15.39:0/479205419 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b4005020 con 0x7f58bc1044a0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc1a2f10 con 0x7f58bc1044a0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58b27fc640 1 -- 172.21.15.39:0/479205419 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4010690 con 0x7f58bc1044a0 2024-09-10T21:58:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.731+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc1a3380 con 0x7f58bc1044a0 2024-09-10T21:58:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.734+0000 7f58c6672740 1 Processor -- start 2024-09-10T21:58:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.734+0000 7f58b27fc640 1 -- 172.21.15.39:0/479205419 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f58b4010830 con 0x7f58bc1044a0 2024-09-10T21:58:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.734+0000 7f58c6672740 1 -- start start 2024-09-10T21:58:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5600a58496f0 con 0x5600a58da190 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5600a5838b20 con 0x5600a58d7860 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c6672740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5600a583c930 con 0x5600a58dcbd0 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37844/0 (socket says 172.21.15.39:37844) 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c0e44640 1 -- 172.21.15.39:0/4231771024 learned_addr learned my addr 172.21.15.39:0/4231771024 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c0e44640 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 -- 172.21.15.39:0/4231771024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 msgr2=0x5600a58df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 -- 172.21.15.39:0/4231771024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 msgr2=0x5600a58d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 -- 172.21.15.39:0/4231771024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a57fe530 con 0x5600a58da190 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c0e44640 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58b27fc640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 0x7f58a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.735+0000 7f58c1645640 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58dc580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005ab0 tx=0x7f58b8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74b4e2984c69db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58c0e44640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 0x7f58a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58b27fc640 1 -- 172.21.15.39:0/479205419 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f58b40e6320 con 0x7f58bc1044a0 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58a77fe640 1 -- 172.21.15.39:0/4231771024 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8040070 con 0x5600a58da190 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58a77fe640 1 -- 172.21.15.39:0/4231771024 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b8004020 con 0x5600a58da190 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58a77fe640 1 -- 172.21.15.39:0/4231771024 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035040 con 0x5600a58da190 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58c6672740 1 -- 172.21.15.39:0/4231771024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 msgr2=0x5600a58dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58c0e44640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 0x7f58a80b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f58ac012d50 tx=0x7f58ac00bc70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.736+0000 7f58c6672740 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58dc580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005ab0 tx=0x7f58b8005e80 comp rx=0 tx=0).stop 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 -- 172.21.15.39:0/4231771024 shutdown_connections 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58dc580 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 --2- 172.21.15.39:0/4231771024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 -- 172.21.15.39:0/4231771024 >> 172.21.15.39:0/4231771024 conn(0x5600a58d29b0 msgr2=0x5600a58d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 -- 172.21.15.39:0/4231771024 shutdown_connections 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 -- 172.21.15.39:0/4231771024 wait complete. 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 -- start start 2024-09-10T21:58:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.737+0000 7f58c6672740 1 Processor -- start 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5600a5770ab0 con 0x5600a58da190 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5600a57de730 con 0x5600a58d7860 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5600a58dfb50 con 0x5600a58dcbd0 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c6672740 10 client.0 _ll_register_callbacks cb 0x5600a58326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37846/0 (socket says 172.21.15.39:37846) 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35582/0 (socket says 172.21.15.39:35582) 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 -- 172.21.15.39:0/4199276570 learned_addr learned my addr 172.21.15.39:0/4199276570 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1e46640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 -- 172.21.15.39:0/4199276570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 msgr2=0x5600a58e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 -- 172.21.15.39:0/4199276570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 msgr2=0x5600a58e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.738+0000 7f58c1645640 1 -- 172.21.15.39:0/4199276570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a559a790 con 0x5600a58d7860 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58c1645640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005c40 tx=0x7f58b8004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9b1c75f067ef3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8040030 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f58b8005270 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b8004020 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58b8035040 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58c6672740 10 client.25844 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5600a5613620 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b8004020 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.739+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f58b80035f0 con 0x5600a58d7860 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 10 client.25844 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 10 client.25844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 20 client.25844 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a58ec390 0x5600a58ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 4 client.25844 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600a584b640 con 0x5600a58ec390 2024-09-10T21:58:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c0e44640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a58ec390 0x5600a58ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58a4ff9640 10 client.25844 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.740+0000 7f58c0e44640 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a58ec390 0x5600a58ee7d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b62be1bd20720d server_cookie=39064fb4369d2578 in_seq=0 out_seq=0 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58a4ff9640 1 -- 172.21.15.39:0/4199276570 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600a584b640 con 0x5600a58ec390 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58a4ff9640 10 client.25844 handle_command_reply: tid=0 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 client.25844 shutdown 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 msgr2=0x5600a58e0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58b8005c40 tx=0x7f58b8004400 comp rx=0 tx=0).stop 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 shutdown_connections 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a58ec390 0x5600a58ee7d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58dcbd0 0x5600a58e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58a4ff9640 0 client.25844 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 --2- 172.21.15.39:0/4199276570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58d7860 0x5600a58e0ef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 >> 172.21.15.39:0/4199276570 conn(0x5600a58d29b0 msgr2=0x5600a58d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 shutdown_connections 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.744+0000 7f58c6672740 1 -- 172.21.15.39:0/4199276570 wait complete. 2024-09-10T21:58:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.745+0000 7f58c6672740 20 client.25844 trim_cache size 0 max 16384 2024-09-10T21:58:33.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.759+0000 7f58c6672740 1 Processor -- start 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.759+0000 7f58c6672740 1 -- start start 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58da190 0x5600a58d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1abfd0 con 0x5600a58d7860 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1adbd0 con 0x5600a58dcbd0 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c6672740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1ac6a0 con 0x5600a58da190 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58da190 0x5600a58d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35592/0 (socket says 172.21.15.39:35592) 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 -- 172.21.15.39:0/1371131191 learned_addr learned my addr 172.21.15.39:0/1371131191 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1e46640 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 -- 172.21.15.39:0/1371131191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58da190 msgr2=0x5600a58d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58da190 0x5600a58d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 -- 172.21.15.39:0/1371131191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 msgr2=0x5600a58d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58d4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 -- 172.21.15.39:0/1371131191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a58d9fc0 con 0x5600a58d7860 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1e46640 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.760+0000 7f58c1645640 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f58b802a460 tx=0x7f58b8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbf7acda93358f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58a6ffd640 1 -- 172.21.15.39:0/1371131191 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8040070 con 0x5600a58d7860 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58a6ffd640 1 -- 172.21.15.39:0/1371131191 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b804d070 con 0x5600a58d7860 2024-09-10T21:58:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58a6ffd640 1 -- 172.21.15.39:0/1371131191 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8054980 con 0x5600a58d7860 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 -- 172.21.15.39:0/1371131191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 msgr2=0x5600a58d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f58b802a460 tx=0x7f58b8005a20 comp rx=0 tx=0).stop 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 -- 172.21.15.39:0/1371131191 shutdown_connections 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58da190 0x5600a58d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 --2- 172.21.15.39:0/1371131191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58d7860 0x5600a58d1ae0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 -- 172.21.15.39:0/1371131191 >> 172.21.15.39:0/1371131191 conn(0x5600a58d29b0 msgr2=0x5600a58d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.761+0000 7f58c6672740 1 -- 172.21.15.39:0/1371131191 shutdown_connections 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 -- 172.21.15.39:0/1371131191 wait complete. 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 -- start start 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 Processor -- start 2024-09-10T21:58:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 0x5600a58e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58e7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1ad440 con 0x5600a58da190 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1acd70 con 0x5600a58dcbd0 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1a9fb0 con 0x5600a58d7860 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c6672740 10 client.0 _ll_register_callbacks cb 0x7f58ac0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c0e44640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35606/0 (socket says 172.21.15.39:35606) 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c0e44640 1 -- 172.21.15.39:0/124505506 learned_addr learned my addr 172.21.15.39:0/124505506 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c1e46640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.762+0000 7f58c1645640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 0x5600a58e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 -- 172.21.15.39:0/124505506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 msgr2=0x5600a58e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 0x5600a58e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 -- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 msgr2=0x5600a58e7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58e7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 -- 172.21.15.39:0/124505506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a58e7e50 con 0x5600a58da190 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c1645640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 0x5600a58e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c1e46640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c0e44640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x5600a58ef010 tx=0x7f58ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce00845fcfe9581 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac021960 con 0x5600a58da190 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f58ac021b00 con 0x5600a58da190 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b804d070 con 0x5600a58da190 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58ac021d00 con 0x5600a58da190 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c6672740 10 client.16239 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5600a59592a0 con 0x5600a58da190 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.763+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b804d070 con 0x5600a58da190 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f58ac0333f0 con 0x5600a58da190 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 10 client.16239 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 20 client.16239 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a5959bf0 0x5600a595c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 4 client.16239 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600a58470f0 con 0x5600a5959bf0 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c1645640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a5959bf0 0x5600a595c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58a4ff9640 10 client.16239 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:33.764+0000 7f58c1645640 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a5959bf0 0x5600a595c010 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662738e99977a106 server_cookie=89bc92a4cf8ee9e0 in_seq=0 out_seq=0 2024-09-10T21:58:34.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:34 smithi070 ceph-mon[34909]: pgmap v448: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-09-10T21:58:34.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:34 smithi039 ceph-mon[30872]: pgmap v448: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-09-10T21:58:34.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:34 smithi173 ceph-mon[35294]: pgmap v448: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 270 op/s 2024-09-10T21:58:35.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:58:36.504 INFO:tasks.workunit.client.0.smithi039.stdout: 80 1512500 384 1015072 590 907312 1594 2024-09-10T21:58:36.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:36 smithi039 ceph-mon[30872]: pgmap v449: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.8 MiB/s wr, 151 op/s 2024-09-10T21:58:36.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:36 smithi070 ceph-mon[34909]: pgmap v449: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.8 MiB/s wr, 151 op/s 2024-09-10T21:58:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:36 smithi173 ceph-mon[35294]: pgmap v449: 97 pgs: 97 active+clean; 258 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.8 MiB/s wr, 151 op/s 2024-09-10T21:58:37.126 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.741+0000 7f991514c640 1 -- 172.21.15.39:0/3453505489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 msgr2=0x7f991011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.741+0000 7f991514c640 1 --2- 172.21.15.39:0/3453505489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f991011e490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9900009900 tx=0x7f990002a4b0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.742+0000 7f991514c640 1 -- 172.21.15.39:0/3453505489 shutdown_connections 2024-09-10T21:58:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.742+0000 7f991514c640 1 --2- 172.21.15.39:0/3453505489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f991011e490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.742+0000 7f991514c640 1 --2- 172.21.15.39:0/3453505489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a530 0x7f991010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.742+0000 7f991514c640 1 --2- 172.21.15.39:0/3453505489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a150 0x7f99101111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.742+0000 7f991514c640 1 -- 172.21.15.39:0/3453505489 >> 172.21.15.39:0/3453505489 conn(0x7f991006dfc0 msgr2=0x7f991006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:37.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.748+0000 7f991514c640 1 -- 172.21.15.39:0/3453505489 shutdown_connections 2024-09-10T21:58:37.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.748+0000 7f991514c640 1 -- 172.21.15.39:0/3453505489 wait complete. 2024-09-10T21:58:37.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.750+0000 7f991514c640 1 Processor -- start 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.759+0000 7f991514c640 1 -- start start 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.759+0000 7f991514c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 0x7f9910119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.759+0000 7f991514c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.760+0000 7f991514c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f99101127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.760+0000 7f991514c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9910121bb0 con 0x7f991010a530 2024-09-10T21:58:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.760+0000 7f991514c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9910121a30 con 0x7f991010a150 2024-09-10T21:58:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.760+0000 7f991514c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9910121d30 con 0x7f991011c0a0 2024-09-10T21:58:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.766+0000 7f990ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 0x7f9910119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.769+0000 7f990e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.769+0000 7f990e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35628/0 (socket says 172.21.15.39:35628) 2024-09-10T21:58:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.769+0000 7f990e59c640 1 -- 172.21.15.39:0/3641572839 learned_addr learned my addr 172.21.15.39:0/3641572839 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.769+0000 7f990f59e640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f99101127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990e59c640 1 -- 172.21.15.39:0/3641572839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 msgr2=0x7f99101127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990e59c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f99101127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990e59c640 1 -- 172.21.15.39:0/3641572839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 msgr2=0x7f9910119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990e59c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 0x7f9910119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990e59c640 1 -- 172.21.15.39:0/3641572839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9910113090 con 0x7f991010a530 2024-09-10T21:58:37.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.779+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 0x7f9910119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.783+0000 7f990e59c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f990800eab0 tx=0x7f990800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.788+0000 7f98f7fff640 1 -- 172.21.15.39:0/3641572839 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990800ce40 con 0x7f991010a530 2024-09-10T21:58:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.788+0000 7f98f7fff640 1 -- 172.21.15.39:0/3641572839 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9908011920 con 0x7f991010a530 2024-09-10T21:58:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.788+0000 7f98f7fff640 1 -- 172.21.15.39:0/3641572839 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990801aa60 con 0x7f991010a530 2024-09-10T21:58:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.790+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9910113380 con 0x7f991010a530 2024-09-10T21:58:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.790+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99101182c0 con 0x7f991010a530 2024-09-10T21:58:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.798+0000 7f9917521740 1 Processor -- start 2024-09-10T21:58:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.800+0000 7f98f7fff640 1 -- 172.21.15.39:0/3641572839 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9908022060 con 0x7f991010a530 2024-09-10T21:58:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.801+0000 7f98f7fff640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 0x7f98f80b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.801+0000 7f98f7fff640 1 -- 172.21.15.39:0/3641572839 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f99080e5920 con 0x7f991010a530 2024-09-10T21:58:37.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 -- start start 2024-09-10T21:58:37.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04fda0 0x557daa05b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557da9fc5e50 con 0x557daa05bd30 2024-09-10T21:58:37.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557da9fb5280 con 0x557daa04fda0 2024-09-10T21:58:37.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.806+0000 7f9917521740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557da9fb9090 con 0x557daa04f480 2024-09-10T21:58:37.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.807+0000 7f990ed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.808+0000 7f990ed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36118/0 (socket says 172.21.15.39:36118) 2024-09-10T21:58:37.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.808+0000 7f990ed9d640 1 -- 172.21.15.39:0/3283073176 learned_addr learned my addr 172.21.15.39:0/3283073176 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:37.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.809+0000 7f990e59c640 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04fda0 0x557daa05b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.810+0000 7f990ed9d640 1 -- 172.21.15.39:0/3283073176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04fda0 msgr2=0x557daa05b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.810+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04fda0 0x557daa05b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.810+0000 7f990ed9d640 1 -- 172.21.15.39:0/3283073176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 msgr2=0x557daa05e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.810+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.810+0000 7f990ed9d640 1 -- 172.21.15.39:0/3283073176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557da9d13650 con 0x557daa04f480 2024-09-10T21:58:37.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.811+0000 7f990f59e640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 0x7f98f80b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.812+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99040104d0 tx=0x7f9904010990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7468dd164f742ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.813+0000 7f98f57fa640 1 -- 172.21.15.39:0/3283073176 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904004220 con 0x557daa04f480 2024-09-10T21:58:37.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.813+0000 7f98f57fa640 1 -- 172.21.15.39:0/3283073176 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99040043c0 con 0x557daa04f480 2024-09-10T21:58:37.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.814+0000 7f9917521740 1 -- 172.21.15.39:0/3283073176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 msgr2=0x557daa04f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.814+0000 7f9917521740 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99040104d0 tx=0x7f9904010990 comp rx=0 tx=0).stop 2024-09-10T21:58:37.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.818+0000 7f990f59e640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 0x7f98f80b79a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f990002aaa0 tx=0x7f9900031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.820+0000 7f9917521740 1 -- 172.21.15.39:0/3283073176 shutdown_connections 2024-09-10T21:58:37.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.820+0000 7f9917521740 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.820+0000 7f9917521740 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04fda0 0x557daa05b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.820+0000 7f9917521740 1 --2- 172.21.15.39:0/3283073176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04f480 0x557daa04f860 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.820+0000 7f9917521740 1 -- 172.21.15.39:0/3283073176 >> 172.21.15.39:0/3283073176 conn(0x557daa04d2b0 msgr2=0x557daa04e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:37.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.822+0000 7f9917521740 1 -- 172.21.15.39:0/3283073176 shutdown_connections 2024-09-10T21:58:37.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.826+0000 7f9917521740 1 -- 172.21.15.39:0/3283073176 wait complete. 2024-09-10T21:58:37.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.826+0000 7f9917521740 1 -- start start 2024-09-10T21:58:37.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.826+0000 7f9917521740 1 Processor -- start 2024-09-10T21:58:37.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa05b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa0591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557da9e16700 con 0x557daa05bd30 2024-09-10T21:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557da9f50110 con 0x557daa04f480 2024-09-10T21:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557daa05ea00 con 0x557daa04fda0 2024-09-10T21:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.827+0000 7f9917521740 10 client.0 _ll_register_callbacks cb 0x557da9f69990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36130/0 (socket says 172.21.15.39:36130) 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 -- 172.21.15.39:0/3547887326 learned_addr learned my addr 172.21.15.39:0/3547887326 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990f59e640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa0591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 -- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 msgr2=0x557daa05b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa05b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 -- 172.21.15.39:0/3547887326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 msgr2=0x557daa0591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa0591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.831+0000 7f990e59c640 1 -- 172.21.15.39:0/3547887326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557da9f7dc40 con 0x557daa04fda0 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.832+0000 7f990f59e640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa0591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.832+0000 7f990e59c640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99080a86e0 tx=0x7f99080ab970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf9be30ea8432112 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.832+0000 7f98f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.833+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080b0bf0 con 0x557daa04fda0 2024-09-10T21:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.833+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9908011470 con 0x557daa04fda0 2024-09-10T21:58:37.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.833+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557da9fc7da0 con 0x557daa04fda0 2024-09-10T21:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.844+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f99080b56a0 con 0x557daa04fda0 2024-09-10T21:58:37.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.845+0000 7f9917521740 10 client.25837 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:37.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.845+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557daa06a510 con 0x557daa04fda0 2024-09-10T21:58:37.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.849+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557da9fc7da0 con 0x557daa04fda0 2024-09-10T21:58:37.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.849+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f990800f040 con 0x557daa04fda0 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 10 client.25837 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 20 client.25837 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa06b9d0 0x557daa06de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 4 client.25837 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.851+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557da9fc3850 con 0x557daa06b9d0 2024-09-10T21:58:37.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.854+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa06b9d0 0x557daa06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.874+0000 7f98f2ff5640 10 client.25837 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:37.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.874+0000 7f990ed9d640 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa06b9d0 0x557daa06de20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2644e721d2319ebc server_cookie=caa7dab4f97337af in_seq=0 out_seq=0 2024-09-10T21:58:37.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.888+0000 7f98f2ff5640 1 -- 172.21.15.39:0/3547887326 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557da9fc3850 con 0x557daa06b9d0 2024-09-10T21:58:37.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.888+0000 7f98f2ff5640 10 client.25837 handle_command_reply: tid=0 2024-09-10T21:58:37.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.888+0000 7f9917521740 1 client.25837 shutdown 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.891+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 msgr2=0x557daa058b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.891+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99080a86e0 tx=0x7f99080ab970 comp rx=0 tx=0).stop 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 shutdown_connections 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa06b9d0 0x557daa06de20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa0591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa058b00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 --2- 172.21.15.39:0/3547887326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa05b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 >> 172.21.15.39:0/3547887326 conn(0x557daa04d2b0 msgr2=0x557daa052e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f98f2ff5640 0 client.25837 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 shutdown_connections 2024-09-10T21:58:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 1 -- 172.21.15.39:0/3547887326 wait complete. 2024-09-10T21:58:37.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.894+0000 7f9917521740 20 client.25837 trim_cache size 0 max 16384 2024-09-10T21:58:37.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.937+0000 7f9917521740 1 Processor -- start 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 -- start start 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa067c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c5ac0 con 0x557daa05bd30 2024-09-10T21:58:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c76c0 con 0x557daa04f480 2024-09-10T21:58:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.941+0000 7f9917521740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c6190 con 0x557daa04fda0 2024-09-10T21:58:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.945+0000 7f990e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.947+0000 7f990e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:36138/0 (socket says 172.21.15.39:36138) 2024-09-10T21:58:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.947+0000 7f990e59c640 1 -- 172.21.15.39:0/1588762220 learned_addr learned my addr 172.21.15.39:0/1588762220 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.948+0000 7f990e59c640 1 -- 172.21.15.39:0/1588762220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 msgr2=0x557daa067c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:58:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.948+0000 7f990e59c640 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa067c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.948+0000 7f990e59c640 1 -- 172.21.15.39:0/1588762220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 msgr2=0x557daa05d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.948+0000 7f990e59c640 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.948+0000 7f990e59c640 1 -- 172.21.15.39:0/1588762220 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557daa05e890 con 0x557daa04fda0 2024-09-10T21:58:37.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.951+0000 7f990e59c640 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99080a9380 tx=0x7f99080ac290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818df14f9585bfea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.955+0000 7f98f4ff9640 1 -- 172.21.15.39:0/1588762220 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080c6080 con 0x557daa04fda0 2024-09-10T21:58:37.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.955+0000 7f98f4ff9640 1 -- 172.21.15.39:0/1588762220 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99080b0bf0 con 0x557daa04fda0 2024-09-10T21:58:37.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.955+0000 7f98f4ff9640 1 -- 172.21.15.39:0/1588762220 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080a7ab0 con 0x557daa04fda0 2024-09-10T21:58:37.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.956+0000 7f9917521740 1 -- 172.21.15.39:0/1588762220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 msgr2=0x557daa05a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.956+0000 7f9917521740 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99080a9380 tx=0x7f99080ac290 comp rx=0 tx=0).stop 2024-09-10T21:58:37.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.960+0000 7f9917521740 1 -- 172.21.15.39:0/1588762220 shutdown_connections 2024-09-10T21:58:37.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.960+0000 7f9917521740 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa05d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.960+0000 7f9917521740 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa05a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.960+0000 7f9917521740 1 --2- 172.21.15.39:0/1588762220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa067c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.960+0000 7f9917521740 1 -- 172.21.15.39:0/1588762220 >> 172.21.15.39:0/1588762220 conn(0x557daa04d2b0 msgr2=0x557daa05a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:37.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.961+0000 7f9917521740 1 -- 172.21.15.39:0/1588762220 shutdown_connections 2024-09-10T21:58:37.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.961+0000 7f9917521740 1 -- 172.21.15.39:0/1588762220 wait complete. 2024-09-10T21:58:37.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.961+0000 7f9917521740 1 -- start start 2024-09-10T21:58:37.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.962+0000 7f9917521740 1 Processor -- start 2024-09-10T21:58:37.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.962+0000 7f9917521740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa064580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.962+0000 7f9917521740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.962+0000 7f9917521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.963+0000 7f9917521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c6f30 con 0x557daa05bd30 2024-09-10T21:58:37.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.963+0000 7f9917521740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c6860 con 0x557daa04f480 2024-09-10T21:58:37.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.963+0000 7f9917521740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99101c3aa0 con 0x557daa04fda0 2024-09-10T21:58:37.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.963+0000 7f9917521740 10 client.0 _ll_register_callbacks cb 0x7f99080a8760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.964+0000 7f990e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.964+0000 7f990ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.964+0000 7f990ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa064580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37928/0 (socket says 172.21.15.39:37928) 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.964+0000 7f990ed9d640 1 -- 172.21.15.39:0/1718666456 learned_addr learned my addr 172.21.15.39:0/1718666456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.965+0000 7f990f59e640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 -- 172.21.15.39:0/1718666456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 msgr2=0x557daa073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 -- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 msgr2=0x557daa064580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa064580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 -- 172.21.15.39:0/1718666456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557daa0631e0 con 0x557daa05bd30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f990f59e640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa073af0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99000058c0 tx=0x7f9900009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0e8f8bafac9e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.966+0000 7f98f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000316a0 con 0x557daa05bd30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557da9fc0c80 con 0x557daa05bd30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9900031840 con 0x557daa05bd30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9900003e50 con 0x557daa05bd30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f9917521740 10 client.16248 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:37.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.968+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557daa0d8ae0 con 0x557daa05bd30 2024-09-10T21:58:37.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557da9fc0c80 con 0x557daa05bd30 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f990004e020 con 0x557daa05bd30 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 10 client.16248 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 20 client.16248 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa0d93a0 0x557daa0db7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 4 client.16248 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.977+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557da9f36a50 con 0x557daa0d93a0 2024-09-10T21:58:37.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.978+0000 7f990ed9d640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa0d93a0 0x557daa0db7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:37.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.980+0000 7f990ed9d640 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa0d93a0 0x557daa0db7c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd81320fe42cc1f server_cookie=83541155fb2e571d in_seq=0 out_seq=0 2024-09-10T21:58:37.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.980+0000 7f98f2ff5640 10 client.16248 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:37.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.984+0000 7f98f2ff5640 1 -- 172.21.15.39:0/1718666456 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x557da9f36a50 con 0x557daa0d93a0 2024-09-10T21:58:37.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.984+0000 7f98f2ff5640 10 client.16248 handle_command_reply: tid=0 2024-09-10T21:58:37.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.984+0000 7f9917521740 1 client.16248 shutdown 2024-09-10T21:58:37.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 msgr2=0x557daa073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa073af0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99000058c0 tx=0x7f9900009260 comp rx=0 tx=0).stop 2024-09-10T21:58:37.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 shutdown_connections 2024-09-10T21:58:37.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557daa0d93a0 0x557daa0db7c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557daa05bd30 0x557daa073af0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557daa04fda0 0x557daa073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 --2- 172.21.15.39:0/1718666456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557daa04f480 0x557daa064580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 >> 172.21.15.39:0/1718666456 conn(0x557daa04d2b0 msgr2=0x557daa05a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.989+0000 7f98f2ff5640 0 client.16248 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.990+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 shutdown_connections 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.990+0000 7f9917521740 1 -- 172.21.15.39:0/1718666456 wait complete. 2024-09-10T21:58:37.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.990+0000 7f9917521740 20 client.16248 trim_cache size 0 max 16384 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:37.993 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:37.994 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:37.995 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:37.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:37.998 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:37.998 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:58:37.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 msgr2=0x7f98f80b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 0x7f98f80b79a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f990002aaa0 tx=0x7f9900031400 comp rx=0 tx=0).stop 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 msgr2=0x7f99101199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f990800eab0 tx=0x7f990800ef70 comp rx=0 tx=0).stop 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 shutdown_connections 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f98f80b54e0 0x7f98f80b79a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f991011c0a0 0x7f99101127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:37.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f991010a530 0x7f99101199c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:38.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 --2- 172.21.15.39:0/3641572839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f991010a150 0x7f9910119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:38.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.992+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 >> 172.21.15.39:0/3641572839 conn(0x7f991006dfc0 msgr2=0x7f991011c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:38.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.993+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 shutdown_connections 2024-09-10T21:58:38.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:37.995+0000 7f991514c640 1 -- 172.21.15.39:0/3641572839 wait complete. 2024-09-10T21:58:38.821 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:38 smithi039 ceph-mon[30872]: pgmap v450: 97 pgs: 97 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-09-10T21:58:38.863 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:58:38.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:58:38.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:38 smithi070 ceph-mon[34909]: pgmap v450: 97 pgs: 97 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-09-10T21:58:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:38 smithi173 ceph-mon[35294]: pgmap v450: 97 pgs: 97 active+clean; 263 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-09-10T21:58:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:39.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1598513986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f41076a0 msgr2=0x7f17f4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:39.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1598513986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f41076a0 0x7f17f4107ae0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009860 tx=0x7f17e402a340 comp rx=0 tx=0).stop 2024-09-10T21:58:39.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1598513986 shutdown_connections 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1598513986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4108020 0x7f17f410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1598513986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f41076a0 0x7f17f4107ae0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1598513986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1598513986 >> 172.21.15.39:0/1598513986 conn(0x7f17f40fd700 msgr2=0x7f17f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1598513986 shutdown_connections 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.762+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1598513986 wait complete. 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 Processor -- start 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 -- start start 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41076a0 0x7f17f419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 0x7f17f419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:39.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4111ca0 con 0x7f17f4108020 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4111b20 con 0x7f17f4101c90 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17fb2a1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4111e20 con 0x7f17f41076a0 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 0x7f17f419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f903d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f903d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f419a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:37938/0 (socket says 172.21.15.39:37938) 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f903d640 1 -- 172.21.15.39:0/1865612710 learned_addr learned my addr 172.21.15.39:0/1865612710 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f883c640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41076a0 0x7f17f419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 -- 172.21.15.39:0/1865612710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41076a0 msgr2=0x7f17f419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41076a0 0x7f17f419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 -- 172.21.15.39:0/1865612710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 msgr2=0x7f17f419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.763+0000 7f17f983e640 1 -- 172.21.15.39:0/1865612710 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41a54b0 con 0x7f17f4108020 2024-09-10T21:58:39.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17f983e640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 0x7f17f419ab70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009fd0 tx=0x7f17ec00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00ce20 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f41a57a0 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17ec005020 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec010690 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.764+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f41a5d00 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.765+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f4102070 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.766+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f17ec0054d0 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.767+0000 7f17ea7fc640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 0x7f17e00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.767+0000 7f17f903d640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 0x7f17e00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.767+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f17ec0e6270 con 0x7f17f4108020 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.768+0000 7f17f903d640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 0x7f17e00b7820 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17f00058c0 tx=0x7f17f0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:39.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:39.771+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17ec0ad140 con 0x7f17f4108020 2024-09-10T21:58:40.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.028+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f406aec0 con 0x7f17f4108020 2024-09-10T21:58:40.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.029+0000 7f17ea7fc640 1 -- 172.21.15.39:0/1865612710 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11980 (secure 0 0 0) 0x7f17f406aec0 con 0x7f17f4108020 2024-09-10T21:58:40.030 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:58:40.031 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"btime":"2024-09-10T21:56:56:565338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:56:55.941400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:58:40.031 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 msgr2=0x7f17e00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 0x7f17e00b7820 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17f00058c0 tx=0x7f17f0009260 comp rx=0 tx=0).stop 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 msgr2=0x7f17f419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 0x7f17f419ab70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009fd0 tx=0x7f17ec00ef10 comp rx=0 tx=0).stop 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 shutdown_connections 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f17e00b5360 0x7f17e00b7820 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:40.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17f4108020 0x7f17f419ab70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:40.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41076a0 0x7f17f419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:40.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 --2- 172.21.15.39:0/1865612710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4101c90 0x7f17f419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:40.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.031+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 >> 172.21.15.39:0/1865612710 conn(0x7f17f40fd700 msgr2=0x7f17f40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:40.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.032+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 shutdown_connections 2024-09-10T21:58:40.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:40.032+0000 7f17fb2a1640 1 -- 172.21.15.39:0/1865612710 wait complete. 2024-09-10T21:58:40.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:58:40.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:40 smithi070 ceph-mon[34909]: pgmap v451: 97 pgs: 97 active+clean; 262 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-10T21:58:40.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:40 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1865612710' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:58:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:40 smithi039 ceph-mon[30872]: pgmap v451: 97 pgs: 97 active+clean; 262 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-10T21:58:40.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:40 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1865612710' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:58:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:40 smithi173 ceph-mon[35294]: pgmap v451: 97 pgs: 97 active+clean; 262 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-10T21:58:40.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:40 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1865612710' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:58:41.054 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.593+0000 7f58a4ff9640 1 -- 172.21.15.39:0/124505506 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600a58470f0 con 0x5600a5959bf0 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.593+0000 7f58a4ff9640 10 client.16239 handle_command_reply: tid=0 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.593+0000 7f58c6672740 1 client.16239 shutdown 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.593+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 msgr2=0x5600a58e73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.593+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x5600a58ef010 tx=0x7f58ac004730 comp rx=0 tx=0).stop 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 shutdown_connections 2024-09-10T21:58:41.595 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5600a5959bf0 0x5600a595c010 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600a58dcbd0 0x5600a58e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600a58da190 0x5600a58e73d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58a4ff9640 0 client.16239 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 --2- 172.21.15.39:0/124505506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5600a58d7860 0x5600a58e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 >> 172.21.15.39:0/124505506 conn(0x5600a58d29b0 msgr2=0x5600a58d47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 shutdown_connections 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 1 -- 172.21.15.39:0/124505506 wait complete. 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c6672740 20 client.16239 trim_cache size 0 max 16384 2024-09-10T21:58:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:58:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:58:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:58:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:58:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 msgr2=0x7f58a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 0x7f58a80b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f58ac012d50 tx=0x7f58ac00bc70 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 msgr2=0x7f58bc075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009fd0 tx=0x7f58b400ef10 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 shutdown_connections 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f58a80b52e0 0x7f58a80b77a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc1044a0 0x7f58bc075a80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58bc103ae0 0x7f58bc075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.594+0000 7f58c38a9640 1 --2- 172.21.15.39:0/479205419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc102990 0x7f58bc076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.595+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 >> 172.21.15.39:0/479205419 conn(0x7f58bc0fe250 msgr2=0x7f58bc106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.595+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 shutdown_connections 2024-09-10T21:58:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:41.595+0000 7f58c38a9640 1 -- 172.21.15.39:0/479205419 wait complete. 2024-09-10T21:58:41.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- 172.21.15.39:0/1116401864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec1087d0 msgr2=0x7f31ec108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1116401864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec1087d0 0x7f31ec108c10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009900 tx=0x7f31dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:58:41.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- 172.21.15.39:0/1116401864 shutdown_connections 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1116401864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 0x7f31ec10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1116401864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec1087d0 0x7f31ec108c10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1116401864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec102dc0 0x7f31ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- 172.21.15.39:0/1116401864 >> 172.21.15.39:0/1116401864 conn(0x7f31ec0fe870 msgr2=0x7f31ec100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- 172.21.15.39:0/1116401864 shutdown_connections 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- 172.21.15.39:0/1116401864 wait complete. 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 Processor -- start 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.722+0000 7f31f3b08640 1 -- start start 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec1087d0 0x7f31ec0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 0x7f31ec075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec112da0 con 0x7f31ec102dc0 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec112c20 con 0x7f31ec1087d0 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f3b08640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec112f20 con 0x7f31ec109150 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35490/0 (socket says 172.21.15.39:35490) 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f10a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec1087d0 0x7f31ec0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 -- 172.21.15.39:0/1316887949 learned_addr learned my addr 172.21.15.39:0/1316887949 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f20a5640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 0x7f31ec075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 -- 172.21.15.39:0/1316887949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 msgr2=0x7f31ec075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 0x7f31ec075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 -- 172.21.15.39:0/1316887949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec1087d0 msgr2=0x7f31ec0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec1087d0 0x7f31ec0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 -- 172.21.15.39:0/1316887949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec1a76b0 con 0x7f31ec102dc0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31f18a4640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f31e800d950 tx=0x7f31e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31e2ffd640 1 -- 172.21.15.39:0/1316887949 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8017030 con 0x7f31ec102dc0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.723+0000 7f31e2ffd640 1 -- 172.21.15.39:0/1316887949 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e8004020 con 0x7f31ec102dc0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.724+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec1a79a0 con 0x7f31ec102dc0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.724+0000 7f31e2ffd640 1 -- 172.21.15.39:0/1316887949 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e80047a0 con 0x7f31ec102dc0 2024-09-10T21:58:41.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.724+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec1a7eb0 con 0x7f31ec102dc0 2024-09-10T21:58:41.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.726+0000 7f31f5edd740 1 Processor -- start 2024-09-10T21:58:41.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.726+0000 7f31f5edd740 1 -- start start 2024-09-10T21:58:41.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561bce731ea0 con 0x561bce7bba10 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561bce7212d0 con 0x561bce7bb0f0 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f5edd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561bce7250e0 con 0x561bce7c79a0 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31e2ffd640 1 -- 172.21.15.39:0/1316887949 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f31e8009a30 con 0x7f31ec102dc0 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:39920/0 (socket says 172.21.15.39:39920) 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 -- 172.21.15.39:0/2540542931 learned_addr learned my addr 172.21.15.39:0/2540542931 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f18a4640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 -- 172.21.15.39:0/2540542931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 msgr2=0x561bce7c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 -- 172.21.15.39:0/2540542931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 msgr2=0x561bce7c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f20a5640 1 -- 172.21.15.39:0/2540542931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bce47f650 con 0x561bce7bb0f0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.727+0000 7f31f18a4640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009f50 tx=0x7f31e4010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72d16c62db01bba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31d7fff640 1 -- 172.21.15.39:0/2540542931 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4016070 con 0x561bce7bb0f0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31d7fff640 1 -- 172.21.15.39:0/2540542931 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e401bb10 con 0x561bce7bb0f0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31d7fff640 1 -- 172.21.15.39:0/2540542931 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4012b40 con 0x561bce7bb0f0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31e2ffd640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 0x7f31d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31f18a4640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 0x7f31d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.728+0000 7f31e2ffd640 1 -- 172.21.15.39:0/1316887949 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31e80e5630 con 0x7f31ec102dc0 2024-09-10T21:58:41.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- 172.21.15.39:0/2540542931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 msgr2=0x561bce7bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f18a4640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 0x7f31d80b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f31e80e34b0 tx=0x7f31e8093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009f50 tx=0x7f31e4010800 comp rx=0 tx=0).stop 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- 172.21.15.39:0/2540542931 shutdown_connections 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2540542931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7bb4d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- 172.21.15.39:0/2540542931 >> 172.21.15.39:0/2540542931 conn(0x561bce7b8f20 msgr2=0x561bce7ba0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- 172.21.15.39:0/2540542931 shutdown_connections 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- 172.21.15.39:0/2540542931 wait complete. 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 -- start start 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.729+0000 7f31f5edd740 1 Processor -- start 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561bce582700 con 0x561bce7bba10 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561bce6bc160 con 0x561bce7bb0f0 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561bce7ca620 con 0x561bce7c79a0 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f5edd740 10 client.0 _ll_register_callbacks cb 0x561bce6d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:39930/0 (socket says 172.21.15.39:39930) 2024-09-10T21:58:41.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f20a5640 1 -- 172.21.15.39:0/2947455339 learned_addr learned my addr 172.21.15.39:0/2947455339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 -- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 msgr2=0x561bce7c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 -- 172.21.15.39:0/2947455339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 msgr2=0x561bce7c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 -- 172.21.15.39:0/2947455339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bce6e9c90 con 0x561bce7bba10 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:41.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c4690 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009230 tx=0x7f31dc0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d775eb799f98ab1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.730+0000 7f31d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc035040 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31dc004040 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31e401bb10 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31dc0318d0 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 10 client.16266 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561bce7d5f40 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e401bb10 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31dc004870 con 0x561bce7bba10 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 10 client.16266 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:41.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 10 client.16266 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 20 client.16266 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce7d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 4 client.16266 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.731+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bce733df0 con 0x561bce7d7400 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.732+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce7d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.732+0000 7f31d57fa640 10 client.16266 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.732+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce7d97f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ef6109f7da426ab server_cookie=7035e57103fee102 in_seq=0 out_seq=0 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31d57fa640 1 -- 172.21.15.39:0/2947455339 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561bce733df0 con 0x561bce7d7400 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31d57fa640 10 client.16266 handle_command_reply: tid=0 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 client.16266 shutdown 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 msgr2=0x561bce7c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c4690 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009230 tx=0x7f31dc0314a0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 shutdown_connections 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce7d97f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7c79a0 0x561bce7c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31d57fa640 0 client.16266 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7bba10 0x561bce7c4690 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2947455339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 >> 172.21.15.39:0/2947455339 conn(0x561bce7b8f20 msgr2=0x561bce7beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 shutdown_connections 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.733+0000 7f31f5edd740 1 -- 172.21.15.39:0/2947455339 wait complete. 2024-09-10T21:58:41.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.734+0000 7f31f5edd740 20 client.16266 trim_cache size 0 max 16384 2024-09-10T21:58:41.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 Processor -- start 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 -- start start 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bb0f0 0x561bce7b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 0x561bce7b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1b0590 con 0x561bce7c79a0 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1b2190 con 0x561bce7bba10 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f5edd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1b0c60 con 0x561bce7bb0f0 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35506/0 (socket says 172.21.15.39:35506) 2024-09-10T21:58:41.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 -- 172.21.15.39:0/3894998292 learned_addr learned my addr 172.21.15.39:0/3894998292 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f10a3640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 0x561bce7b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bb0f0 0x561bce7b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 -- 172.21.15.39:0/3894998292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bb0f0 msgr2=0x561bce7b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bb0f0 0x561bce7b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 -- 172.21.15.39:0/3894998292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 msgr2=0x561bce7b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 0x561bce7b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 -- 172.21.15.39:0/3894998292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bce7b45b0 con 0x561bce7c79a0 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f10a3640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 0x561bce7b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.747+0000 7f31f20a5640 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f31e40126f0 tx=0x7f31e4012720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7eb75d4879a04d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31d77fe640 1 -- 172.21.15.39:0/3894998292 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4016040 con 0x561bce7c79a0 2024-09-10T21:58:41.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31d77fe640 1 -- 172.21.15.39:0/3894998292 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e4023040 con 0x561bce7c79a0 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31d77fe640 1 -- 172.21.15.39:0/3894998292 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40145f0 con 0x561bce7c79a0 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 -- 172.21.15.39:0/3894998292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 msgr2=0x561bce7ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f31e40126f0 tx=0x7f31e4012720 comp rx=0 tx=0).stop 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 -- 172.21.15.39:0/3894998292 shutdown_connections 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ba520 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bba10 0x561bce7b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 --2- 172.21.15.39:0/3894998292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bb0f0 0x561bce7b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 -- 172.21.15.39:0/3894998292 >> 172.21.15.39:0/3894998292 conn(0x561bce7b8f20 msgr2=0x561bce7bf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 -- 172.21.15.39:0/3894998292 shutdown_connections 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.748+0000 7f31f5edd740 1 -- 172.21.15.39:0/3894998292 wait complete. 2024-09-10T21:58:41.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 -- start start 2024-09-10T21:58:41.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 Processor -- start 2024-09-10T21:58:41.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 0x561bce7d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1b1a00 con 0x561bce7c79a0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1b1330 con 0x561bce7bb0f0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1ae570 con 0x561bce7bba10 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f5edd740 10 client.0 _ll_register_callbacks cb 0x7f31dc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f20a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35518/0 (socket says 172.21.15.39:35518) 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f20a5640 1 -- 172.21.15.39:0/2381448016 learned_addr learned my addr 172.21.15.39:0/2381448016 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 0x561bce7d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.749+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 -- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 msgr2=0x561bce7d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 0x561bce7d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 -- 172.21.15.39:0/2381448016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 msgr2=0x561bce7cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 -- 172.21.15.39:0/2381448016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bce7caf90 con 0x561bce7c79a0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 0x561bce7d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f20a5640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009d10 tx=0x7f31e4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d06bbf15628c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4016040 con 0x561bce7c79a0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f31e403d030 con 0x561bce7c79a0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31e4023040 con 0x561bce7c79a0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31e4014cc0 con 0x561bce7c79a0 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f5edd740 10 client.16272 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:41.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561bce844c60 con 0x561bce7c79a0 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.750+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e4023040 con 0x561bce7c79a0 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31e4040020 con 0x561bce7c79a0 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 10 client.16272 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 10 client.16272 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 20 client.16272 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce8470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 4 client.16272 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561bce72f8a0 con 0x561bce7d7400 2024-09-10T21:58:41.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce8470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31d57fa640 10 client.16272 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f10a3640 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce8470e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a488ef3ba2034fa9 server_cookie=fe33098b98a73d5a in_seq=0 out_seq=0 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31d57fa640 1 -- 172.21.15.39:0/2381448016 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561bce72f8a0 con 0x561bce7d7400 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31d57fa640 10 client.16272 handle_command_reply: tid=0 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.751+0000 7f31f5edd740 1 client.16272 shutdown 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 msgr2=0x561bce7ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009d10 tx=0x7f31e4005bd0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 shutdown_connections 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x561bce7d7400 0x561bce8470e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561bce7c79a0 0x561bce7ca8a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561bce7bba10 0x561bce7d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 --2- 172.21.15.39:0/2381448016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bce7bb0f0 0x561bce7cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31d57fa640 0 client.16272 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:58:41.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 >> 172.21.15.39:0/2381448016 conn(0x561bce7b8f20 msgr2=0x561bce7b9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 shutdown_connections 2024-09-10T21:58:41.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 1 -- 172.21.15.39:0/2381448016 wait complete. 2024-09-10T21:58:41.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f5edd740 20 client.16272 trim_cache size 0 max 16384 2024-09-10T21:58:41.760 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:41.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 msgr2=0x7f31d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 0x7f31d80b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f31e80e34b0 tx=0x7f31e8093040 comp rx=0 tx=0).stop 2024-09-10T21:58:41.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 msgr2=0x7f31ec0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:41.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f31e800d950 tx=0x7f31e800de10 comp rx=0 tx=0).stop 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 shutdown_connections 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f31d80b52e0 0x7f31d80b77a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31ec109150 0x7f31ec075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec1087d0 0x7f31ec0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.752+0000 7f31f3b08640 1 --2- 172.21.15.39:0/1316887949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec102dc0 0x7f31ec0754a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.753+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 >> 172.21.15.39:0/1316887949 conn(0x7f31ec0fe870 msgr2=0x7f31ec100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.753+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 shutdown_connections 2024-09-10T21:58:41.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:41.753+0000 7f31f3b08640 1 -- 172.21.15.39:0/1316887949 wait complete. 2024-09-10T21:58:42.441 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:58:42.716 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:42.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:42 smithi070 ceph-mon[34909]: pgmap v452: 97 pgs: 97 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 379 op/s 2024-09-10T21:58:42.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:42 smithi039 ceph-mon[30872]: pgmap v452: 97 pgs: 97 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 379 op/s 2024-09-10T21:58:42.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:42 smithi173 ceph-mon[35294]: pgmap v452: 97 pgs: 97 active+clean; 265 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 379 op/s 2024-09-10T21:58:43.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 -- 172.21.15.39:0/2439658709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 msgr2=0x7f9e9410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/2439658709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9410e820 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009ca0 tx=0x7f9e8c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 -- 172.21.15.39:0/2439658709 shutdown_connections 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/2439658709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9410e820 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/2439658709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e941076a0 0x7f9e94107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/2439658709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e94101c90 0x7f9e94102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 -- 172.21.15.39:0/2439658709 >> 172.21.15.39:0/2439658709 conn(0x7f9e940fd700 msgr2=0x7f9e940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 -- 172.21.15.39:0/2439658709 shutdown_connections 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.195+0000 7f9e99bb8640 1 -- 172.21.15.39:0/2439658709 wait complete. 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.196+0000 7f9e99bb8640 1 Processor -- start 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.196+0000 7f9e99bb8640 1 -- start start 2024-09-10T21:58:43.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94101c90 0x7f9e9419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e941076a0 0x7f9e9419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94111ca0 con 0x7f9e94108020 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94111b20 con 0x7f9e941076a0 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94111e20 con 0x7f9e94101c90 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35534/0 (socket says 172.21.15.39:35534) 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 -- 172.21.15.39:0/3343492006 learned_addr learned my addr 172.21.15.39:0/3343492006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e941076a0 0x7f9e9419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e937fe640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94101c90 0x7f9e9419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 -- 172.21.15.39:0/3343492006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94101c90 msgr2=0x7f9e9419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94101c90 0x7f9e9419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 -- 172.21.15.39:0/3343492006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e941076a0 msgr2=0x7f9e9419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e941076a0 0x7f9e9419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 -- 172.21.15.39:0/3343492006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e941a5430 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e93fff640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098d0 tx=0x7f9e8c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e90ff9640 1 -- 172.21.15.39:0/3343492006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c003b70 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941a56c0 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e90ff9640 1 -- 172.21.15.39:0/3343492006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c003d10 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.197+0000 7f9e90ff9640 1 -- 172.21.15.39:0/3343492006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c02fa20 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.198+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941a5c00 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.200+0000 7f9e9bf8d740 1 Processor -- start 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.200+0000 7f9e90ff9640 1 -- 172.21.15.39:0/3343492006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9e8c02fc40 con 0x7f9e94108020 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.200+0000 7f9e9bf8d740 1 -- start start 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.200+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.200+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f270170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561e1f1d7ea0 con 0x561e1f26dd80 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561e1f1c72d0 con 0x561e1f2614d0 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561e1f1cb0e0 con 0x561e1f261df0 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:39990/0 (socket says 172.21.15.39:39990) 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 -- 172.21.15.39:0/3904227258 learned_addr learned my addr 172.21.15.39:0/3904227258 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f270170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e937fe640 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e90ff9640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 0x7f9e7c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 -- 172.21.15.39:0/3904227258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 msgr2=0x561e1f26d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 -- 172.21.15.39:0/3904227258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 msgr2=0x561e1f270170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f270170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 -- 172.21.15.39:0/3904227258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1ef25650 con 0x561e1f2614d0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e93fff640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 0x7f9e7c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e88011730 tx=0x7f9e8800a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7765f131b07b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.201+0000 7f9e90ff9640 1 -- 172.21.15.39:0/3343492006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e8c106ef0 con 0x7f9e94108020 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e79ffb640 1 -- 172.21.15.39:0/3904227258 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004020 con 0x561e1f2614d0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e79ffb640 1 -- 172.21.15.39:0/3904227258 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e880054d0 con 0x561e1f2614d0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e79ffb640 1 -- 172.21.15.39:0/3904227258 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004ac0 con 0x561e1f2614d0 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/3904227258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 msgr2=0x561e1f2618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e93fff640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 0x7f9e7c0b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0c9c90 tx=0x7f9e8c09aca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e88011730 tx=0x7f9e8800a6a0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/3904227258 shutdown_connections 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f270170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/3904227258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f2618b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/3904227258 >> 172.21.15.39:0/3904227258 conn(0x561e1f25f300 msgr2=0x561e1f2604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/3904227258 shutdown_connections 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.202+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/3904227258 wait complete. 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 -- start start 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 Processor -- start 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f26b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561e1f028700 con 0x561e1f2614d0 2024-09-10T21:58:43.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561e1f162160 con 0x561e1f26dd80 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561e1f270a00 con 0x561e1f261df0 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e9bf8d740 10 client.0 _ll_register_callbacks cb 0x561e1f17b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.203+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35560/0 (socket says 172.21.15.39:35560) 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 -- 172.21.15.39:0/4159472149 learned_addr learned my addr 172.21.15.39:0/4159472149 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e937fe640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f26b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 -- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 msgr2=0x561e1f26aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 -- 172.21.15.39:0/4159472149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 msgr2=0x561e1f26b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f26b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 -- 172.21.15.39:0/4159472149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e1f18fc90 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e937fe640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005490 tx=0x7f9e88004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d9da2a139e42f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004cc0 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.204+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e8800f7c0 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e880054d0 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e88034050 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 10 client.16284 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e1f27c360 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e880054d0 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9e8801e810 con 0x561e1f2614d0 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 10 client.16284 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 10 client.16284 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:58:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 20 client.16284 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f27faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 4 client.16284 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e1f1d9df0 con 0x561e1f27d6b0 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.205+0000 7f9e937fe640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f27faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.206+0000 7f9e937fe640 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f27faa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=86d03ec988559893 server_cookie=689310e5fc2a47ff in_seq=0 out_seq=0 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.206+0000 7f9e72ffd640 10 client.16284 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e72ffd640 1 -- 172.21.15.39:0/4159472149 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e1f1d9df0 con 0x561e1f27d6b0 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e72ffd640 10 client.16284 handle_command_reply: tid=0 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 client.16284 shutdown 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 msgr2=0x561e1f26d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005490 tx=0x7f9e88004500 comp rx=0 tx=0).stop 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 shutdown_connections 2024-09-10T21:58:43.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f27faa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f26b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f26aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e72ffd640 0 client.16284 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/4159472149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f26d690 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 >> 172.21.15.39:0/4159472149 conn(0x561e1f25f300 msgr2=0x561e1f264e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 shutdown_connections 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/4159472149 wait complete. 2024-09-10T21:58:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.207+0000 7f9e9bf8d740 20 client.16284 trim_cache size 0 max 16384 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.220+0000 7f9e9bf8d740 1 Processor -- start 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.220+0000 7f9e9bf8d740 1 -- start start 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f279c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f25e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ae310 con 0x561e1f26dd80 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941aff10 con 0x561e1f2614d0 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ae9e0 con 0x561e1f261df0 2024-09-10T21:58:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35576/0 (socket says 172.21.15.39:35576) 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 -- 172.21.15.39:0/2136217333 learned_addr learned my addr 172.21.15.39:0/2136217333 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f279c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e937fe640 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f25e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 -- 172.21.15.39:0/2136217333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 msgr2=0x561e1f25e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f25e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 -- 172.21.15.39:0/2136217333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 msgr2=0x561e1f279c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f279c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 -- 172.21.15.39:0/2136217333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1f25ffe0 con 0x561e1f26dd80 2024-09-10T21:58:43.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.221+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005da0 tx=0x7f9e88025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9a519eb261bbfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e797fa640 1 -- 172.21.15.39:0/2136217333 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880054d0 con 0x561e1f26dd80 2024-09-10T21:58:43.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e797fa640 1 -- 172.21.15.39:0/2136217333 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e88015040 con 0x561e1f26dd80 2024-09-10T21:58:43.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e797fa640 1 -- 172.21.15.39:0/2136217333 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800a9b0 con 0x561e1f26dd80 2024-09-10T21:58:43.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2136217333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 msgr2=0x561e1f26f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005da0 tx=0x7f9e88025040 comp rx=0 tx=0).stop 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2136217333 shutdown_connections 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f26dd80 0x561e1f26f170 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f25e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2136217333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f2614d0 0x561e1f279c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2136217333 >> 172.21.15.39:0/2136217333 conn(0x561e1f25f300 msgr2=0x561e1f25dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.222+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2136217333 shutdown_connections 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2136217333 wait complete. 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 -- start start 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 Processor -- start 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f284e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f2853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941af780 con 0x561e1f2614d0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941af0b0 con 0x561e1f26dd80 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ac2f0 con 0x561e1f261df0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.223+0000 7f9e9bf8d740 10 client.0 _ll_register_callbacks cb 0x7f9e8800adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f284e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35590/0 (socket says 172.21.15.39:35590) 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e92ffd640 1 -- 172.21.15.39:0/2759583697 learned_addr learned my addr 172.21.15.39:0/2759583697 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f2853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 -- 172.21.15.39:0/2759583697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 msgr2=0x561e1f2853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f2853b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 -- 172.21.15.39:0/2759583697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 msgr2=0x561e1f276490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 -- 172.21.15.39:0/2759583697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e1f285be0 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e937fe640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f284e70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e84004700 tx=0x7f9e84012c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80cc3cf0be3afead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84029030 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e84004240 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.224+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e88015040 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e84004440 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 10 client.25879 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e1f2ea570 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e88015040 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9e84003c10 con 0x561e1f261df0 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 10 client.25879 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 10 client.25879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:58:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 20 client.25879 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f2ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 4 client.25879 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e1f1d58a0 con 0x561e1f27d6b0 2024-09-10T21:58:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.225+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f2ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e72ffd640 10 client.25879 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e92ffd640 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f2ecd60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0e040fd4217f8ef server_cookie=b1fc08c06b57cce7 in_seq=0 out_seq=0 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e72ffd640 1 -- 172.21.15.39:0/2759583697 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e1f1d58a0 con 0x561e1f27d6b0 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e72ffd640 10 client.25879 handle_command_reply: tid=0 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 client.25879 shutdown 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 msgr2=0x561e1f284e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f284e70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e84004700 tx=0x7f9e84012c90 comp rx=0 tx=0).stop 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 shutdown_connections 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x561e1f27d6b0 0x561e1f2ecd60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e1f26dd80 0x561e1f2853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561e1f261df0 0x561e1f284e70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e72ffd640 0 client.25879 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 --2- 172.21.15.39:0/2759583697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e1f2614d0 0x561e1f276490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 >> 172.21.15.39:0/2759583697 conn(0x561e1f25f300 msgr2=0x561e1f26c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 shutdown_connections 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.226+0000 7f9e9bf8d740 1 -- 172.21.15.39:0/2759583697 wait complete. 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e9bf8d740 20 client.25879 trim_cache size 0 max 16384 2024-09-10T21:58:43.232 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 msgr2=0x7f9e7c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 0x7f9e7c0b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0c9c90 tx=0x7f9e8c09aca0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 msgr2=0x7f9e9419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098d0 tx=0x7f9e8c0317b0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 shutdown_connections 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e7c0b52e0 0x7f9e7c0b77a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e94108020 0x7f9e9419aaf0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e941076a0 0x7f9e9419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 --2- 172.21.15.39:0/3343492006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94101c90 0x7f9e9419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 >> 172.21.15.39:0/3343492006 conn(0x7f9e940fd700 msgr2=0x7f9e940fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 shutdown_connections 2024-09-10T21:58:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:43.227+0000 7f9e99bb8640 1 -- 172.21.15.39:0/3343492006 wait complete. 2024-09-10T21:58:43.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:58:44.245 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:44.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3444575156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 msgr2=0x7fd90810cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3444575156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90810cae0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009900 tx=0x7fd8f802a410 comp rx=0 tx=0).stop 2024-09-10T21:58:44.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3444575156 shutdown_connections 2024-09-10T21:58:44.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3444575156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd90810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3444575156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90810cae0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3444575156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 0x7fd9081040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3444575156 >> 172.21.15.39:0/3444575156 conn(0x7fd9080fd770 msgr2=0x7fd9080ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3444575156 shutdown_connections 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3444575156 wait complete. 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 Processor -- start 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.741+0000 7fd90eb7a640 1 -- start start 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 0x7fd90819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd9081a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd908112da0 con 0x7fd9081045f0 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd908112c20 con 0x7fd908103cd0 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90eb7a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd908112f20 con 0x7fd90810d130 2024-09-10T21:58:44.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35610/0 (socket says 172.21.15.39:35610) 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 -- 172.21.15.39:0/3236521958 learned_addr learned my addr 172.21.15.39:0/3236521958 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90c916640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 0x7fd90819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90d117640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd9081a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 -- 172.21.15.39:0/3236521958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 msgr2=0x7fd9081a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd9081a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 -- 172.21.15.39:0/3236521958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 msgr2=0x7fd90819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 0x7fd90819b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 -- 172.21.15.39:0/3236521958 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9081a15a0 con 0x7fd9081045f0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd90d117640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd9081a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.742+0000 7fd8fffff640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8032fd0 tx=0x7fd8f8031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.743+0000 7fd8fdffb640 1 -- 172.21.15.39:0/3236521958 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f803f030 con 0x7fd9081045f0 2024-09-10T21:58:44.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.743+0000 7fd8fdffb640 1 -- 172.21.15.39:0/3236521958 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f8004490 con 0x7fd9081045f0 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.743+0000 7fd8fdffb640 1 -- 172.21.15.39:0/3236521958 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8035070 con 0x7fd9081045f0 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.743+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9081a1830 con 0x7fd9081045f0 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.743+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9081a7f50 con 0x7fd9081045f0 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.746+0000 7fd910f4f740 1 Processor -- start 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.746+0000 7fd8fdffb640 1 -- 172.21.15.39:0/3236521958 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd8f803ba30 con 0x7fd9081045f0 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.746+0000 7fd910f4f740 1 -- start start 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c31df0 0x558920c3d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c40170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40056/0 (socket says 172.21.15.39:40056) 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 -- 172.21.15.39:0/2266832996 learned_addr learned my addr 172.21.15.39:0/2266832996 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd8fffff640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c40170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558920ba7ea0 con 0x558920c3dd80 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90c916640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c31df0 0x558920c3d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558920b972d0 con 0x558920c314d0 2024-09-10T21:58:44.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558920b9b0e0 con 0x558920c31df0 2024-09-10T21:58:44.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 -- 172.21.15.39:0/2266832996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c31df0 msgr2=0x558920c3d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c31df0 0x558920c3d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 -- 172.21.15.39:0/2266832996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 msgr2=0x558920c40170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c40170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd90d117640 1 -- 172.21.15.39:0/2266832996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589208f5650 con 0x558920c314d0 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd8fffff640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c40170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.747+0000 7fd8fdffb640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 0x7fd8f00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd90c916640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 0x7fd8f00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd8fdffb640 1 -- 172.21.15.39:0/3236521958 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd8f8105f50 con 0x7fd9081045f0 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd90d117640 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd900009ea0 tx=0x7fd900009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f94083300fe3270 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd8eeffd640 1 -- 172.21.15.39:0/2266832996 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004d20 con 0x558920c314d0 2024-09-10T21:58:44.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd8eeffd640 1 -- 172.21.15.39:0/2266832996 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9000054d0 con 0x558920c314d0 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.748+0000 7fd8eeffd640 1 -- 172.21.15.39:0/2266832996 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900011860 con 0x558920c314d0 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 msgr2=0x558920c318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd900009ea0 tx=0x7fd900009f90 comp rx=0 tx=0).stop 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd90c916640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 0x7fd8f00b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x558920c301e0 tx=0x7fd904005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 shutdown_connections 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c40170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c31df0 0x558920c3d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2266832996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c314d0 0x558920c318b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 >> 172.21.15.39:0/2266832996 conn(0x558920c2f300 msgr2=0x558920c304a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 shutdown_connections 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- 172.21.15.39:0/2266832996 wait complete. 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 -- start start 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.749+0000 7fd910f4f740 1 Processor -- start 2024-09-10T21:58:44.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c3d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5589209f8700 con 0x558920c3dd80 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558920b32160 con 0x558920c31df0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558920c40a00 con 0x558920c314d0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd910f4f740 10 client.0 _ll_register_callbacks cb 0x558920b4b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40068/0 (socket says 172.21.15.39:40068) 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd90c916640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c3d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 -- 172.21.15.39:0/4280480218 learned_addr learned my addr 172.21.15.39:0/4280480218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd90d117640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 -- 172.21.15.39:0/4280480218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 msgr2=0x558920c3d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c3d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 -- 172.21.15.39:0/4280480218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 msgr2=0x558920c3b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd8fffff640 1 -- 172.21.15.39:0/4280480218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558920b5fc90 con 0x558920c31df0 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.750+0000 7fd90d117640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8fffff640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80c8cf0 tx=0x7fd8f8109be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a25ca22455c1fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:44.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80c8d70 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd8f803bd50 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9000054d0 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd8f80cbe90 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 10 client.25913 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558920c4c3b0 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9000054d0 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd8f80c8990 con 0x558920c31df0 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 10 client.25913 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 10 client.25913 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 20 client.25913 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920c4d8b0 0x558920c4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 4 client.25913 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.751+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558920ba9df0 con 0x558920c4d8b0 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.752+0000 7fd90c916640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920c4d8b0 0x558920c4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.752+0000 7fd90c916640 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920c4d8b0 0x558920c4fcd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee87b92de701d81b server_cookie=1b3b02f39191d278 in_seq=0 out_seq=0 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.752+0000 7fd8e7fff640 10 client.25913 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.752+0000 7fd8e7fff640 1 -- 172.21.15.39:0/4280480218 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558920ba9df0 con 0x558920c4d8b0 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd8e7fff640 10 client.25913 handle_command_reply: tid=0 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 client.25913 shutdown 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 msgr2=0x558920c3ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80c8cf0 tx=0x7fd8f8109be0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 shutdown_connections 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920c4d8b0 0x558920c4fcd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3ab10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 --2- 172.21.15.39:0/4280480218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c3d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 >> 172.21.15.39:0/4280480218 conn(0x558920c2f300 msgr2=0x558920c34e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd8e7fff640 0 client.25913 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 shutdown_connections 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 1 -- 172.21.15.39:0/4280480218 wait complete. 2024-09-10T21:58:44.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.753+0000 7fd910f4f740 20 client.25913 trim_cache size 0 max 16384 2024-09-10T21:58:44.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.766+0000 7fd910f4f740 1 Processor -- start 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.766+0000 7fd910f4f740 1 -- start start 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c49c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081b05e0 con 0x558920c3dd80 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081b21e0 con 0x558920c31df0 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd910f4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081b0cb0 con 0x558920c314d0 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35646/0 (socket says 172.21.15.39:35646) 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 -- 172.21.15.39:0/2012785399 learned_addr learned my addr 172.21.15.39:0/2012785399 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:44.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90c916640 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c49c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 -- 172.21.15.39:0/2012785399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 msgr2=0x558920c49c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c49c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 -- 172.21.15.39:0/2012785399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 msgr2=0x558920c3f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 -- 172.21.15.39:0/2012785399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558920c2ffe0 con 0x558920c3dd80 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd8fffff640 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.767+0000 7fd90d117640 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e70 tx=0x7fd900011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a801587343c291 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd8ee7fc640 1 -- 172.21.15.39:0/2012785399 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90002a070 con 0x558920c3dd80 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd8ee7fc640 1 -- 172.21.15.39:0/2012785399 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd900009a90 con 0x558920c3dd80 2024-09-10T21:58:44.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd8ee7fc640 1 -- 172.21.15.39:0/2012785399 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000052a0 con 0x558920c3dd80 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 -- 172.21.15.39:0/2012785399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 msgr2=0x558920c3f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e70 tx=0x7fd900011460 comp rx=0 tx=0).stop 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 -- 172.21.15.39:0/2012785399 shutdown_connections 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c3dd80 0x558920c3f6b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c3f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 --2- 172.21.15.39:0/2012785399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c314d0 0x558920c49c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 -- 172.21.15.39:0/2012785399 >> 172.21.15.39:0/2012785399 conn(0x558920c2f300 msgr2=0x558920c30350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 -- 172.21.15.39:0/2012785399 shutdown_connections 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.768+0000 7fd910f4f740 1 -- 172.21.15.39:0/2012785399 wait complete. 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 -- start start 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 Processor -- start 2024-09-10T21:58:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c3dd80 0x558920c55b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081b1a50 con 0x558920c314d0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081b1380 con 0x558920c31df0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081ae5c0 con 0x558920c3dd80 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd910f4f740 10 client.0 _ll_register_callbacks cb 0x7fd8f803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd90c916640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd90c916640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35648/0 (socket says 172.21.15.39:35648) 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd90c916640 1 -- 172.21.15.39:0/150408529 learned_addr learned my addr 172.21.15.39:0/150408529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd8fffff640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.769+0000 7fd90d117640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c3dd80 0x558920c55b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 -- 172.21.15.39:0/150408529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c3dd80 msgr2=0x558920c55b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c3dd80 0x558920c55b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 -- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 msgr2=0x558920c553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 -- 172.21.15.39:0/150408529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558920c452f0 con 0x558920c314d0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd90c916640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x558920c50540 tx=0x7fd9040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f39b2814d1b260 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd8e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904003ac0 con 0x558920c314d0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd904003c60 con 0x558920c314d0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd900009a90 con 0x558920c314d0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd904003ea0 con 0x558920c314d0 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd910f4f740 10 client.16308 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558920cbaaa0 con 0x558920c314d0 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.770+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd900009a90 con 0x558920c314d0 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd904005510 con 0x558920c314d0 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 10 client.16308 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 10 client.16308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 20 client.16308 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920cbb280 0x558920cbd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 4 client.16308 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558920ba58a0 con 0x558920cbb280 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8fffff640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920cbb280 0x558920cbd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8fffff640 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920cbb280 0x558920cbd6a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74d8242c60fefa76 server_cookie=f249d913537184cd in_seq=0 out_seq=0 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8e7fff640 10 client.16308 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8e7fff640 1 -- 172.21.15.39:0/150408529 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558920ba58a0 con 0x558920cbb280 2024-09-10T21:58:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd8e7fff640 10 client.16308 handle_command_reply: tid=0 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.771+0000 7fd910f4f740 1 client.16308 shutdown 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 msgr2=0x558920c46690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x558920c50540 tx=0x7fd9040046c0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 shutdown_connections 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558920cbb280 0x558920cbd6a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558920c3dd80 0x558920c55b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558920c31df0 0x558920c553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 --2- 172.21.15.39:0/150408529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558920c314d0 0x558920c46690 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 >> 172.21.15.39:0/150408529 conn(0x558920c2f300 msgr2=0x558920c2dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd8e7fff640 0 client.16308 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 shutdown_connections 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 1 -- 172.21.15.39:0/150408529 wait complete. 2024-09-10T21:58:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd910f4f740 20 client.16308 trim_cache size 0 max 16384 2024-09-10T21:58:44.779 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:44.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 msgr2=0x7fd8f00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.772+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 0x7fd8f00b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x558920c301e0 tx=0x7fd904005f90 comp rx=0 tx=0).stop 2024-09-10T21:58:44.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 msgr2=0x7fd90819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:44.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8032fd0 tx=0x7fd8f8031a20 comp rx=0 tx=0).stop 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 shutdown_connections 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd8f00b5360 0x7fd8f00b7820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd90810d130 0x7fd9081a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9081045f0 0x7fd90819ba30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 --2- 172.21.15.39:0/3236521958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908103cd0 0x7fd90819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 >> 172.21.15.39:0/3236521958 conn(0x7fd9080fd770 msgr2=0x7fd9080fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 shutdown_connections 2024-09-10T21:58:44.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:44.773+0000 7fd90eb7a640 1 -- 172.21.15.39:0/3236521958 wait complete. 2024-09-10T21:58:44.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:44 smithi070 ceph-mon[34909]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 671 op/s 2024-09-10T21:58:44.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:44 smithi039 ceph-mon[30872]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 671 op/s 2024-09-10T21:58:44.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:44 smithi173 ceph-mon[35294]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 671 op/s 2024-09-10T21:58:45.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:58:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:46.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 -- 172.21.15.39:0/2284729120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 msgr2=0x7f4178103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 --2- 172.21.15.39:0/2284729120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178103190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4168009860 tx=0x7f416802a340 comp rx=0 tx=0).stop 2024-09-10T21:58:46.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 -- 172.21.15.39:0/2284729120 shutdown_connections 2024-09-10T21:58:46.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 --2- 172.21.15.39:0/2284729120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4178109140 0x7f417810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 --2- 172.21.15.39:0/2284729120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f4178108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 --2- 172.21.15.39:0/2284729120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178103190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.298+0000 7f417cd95640 1 -- 172.21.15.39:0/2284729120 >> 172.21.15.39:0/2284729120 conn(0x7f41780fe800 msgr2=0x7f4178100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.299+0000 7f417cd95640 1 -- 172.21.15.39:0/2284729120 shutdown_connections 2024-09-10T21:58:46.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.299+0000 7f417cd95640 1 -- 172.21.15.39:0/2284729120 wait complete. 2024-09-10T21:58:46.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.300+0000 7f417cd95640 1 Processor -- start 2024-09-10T21:58:46.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 -- start start 2024-09-10T21:58:46.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f41780754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4178109140 0x7f4178075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4178112e00 con 0x7f41781087c0 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4178112c80 con 0x7f4178102db0 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417cd95640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4178112f80 con 0x7f4178109140 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40110/0 (socket says 172.21.15.39:40110) 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.302+0000 7f417659c640 1 -- 172.21.15.39:0/718900408 learned_addr learned my addr 172.21.15.39:0/718900408 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f416ffff640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f41780754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 -- 172.21.15.39:0/718900408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4178109140 msgr2=0x7f4178075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4178109140 0x7f4178075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 -- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 msgr2=0x7f41780754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f41780754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 -- 172.21.15.39:0/718900408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417819d350 con 0x7f4178102db0 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f416ffff640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f41780754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417659c640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4168035040 tx=0x7f4168032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f416f7fe640 1 -- 172.21.15.39:0/718900408 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168037040 con 0x7f4178102db0 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f416f7fe640 1 -- 172.21.15.39:0/718900408 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4168041070 con 0x7f4178102db0 2024-09-10T21:58:46.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f416f7fe640 1 -- 172.21.15.39:0/718900408 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680035f0 con 0x7f4178102db0 2024-09-10T21:58:46.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.303+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417819d5e0 con 0x7f4178102db0 2024-09-10T21:58:46.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.304+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417819d9b0 con 0x7f4178102db0 2024-09-10T21:58:46.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.307+0000 7f416f7fe640 1 -- 172.21.15.39:0/718900408 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4168003830 con 0x7f4178102db0 2024-09-10T21:58:46.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.309+0000 7f416f7fe640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 0x7f41640b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.309+0000 7f416f7fe640 1 -- 172.21.15.39:0/718900408 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f4168105910 con 0x7f4178102db0 2024-09-10T21:58:46.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.309+0000 7f416ffff640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 0x7f41640b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.313+0000 7f417f16a740 1 Processor -- start 2024-09-10T21:58:46.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.315+0000 7f416ffff640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 0x7f41640b78a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f417819d140 tx=0x7f4160009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 -- start start 2024-09-10T21:58:46.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255cdf0 0x55d082568840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d082568d80 0x55d08256b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d0824d2ea0 con 0x55d082568d80 2024-09-10T21:58:46.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0824c22d0 con 0x55d08255c4d0 2024-09-10T21:58:46.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.317+0000 7f417f16a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d0824c60e0 con 0x55d08255cdf0 2024-09-10T21:58:46.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.318+0000 7f417659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.319+0000 7f417659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40120/0 (socket says 172.21.15.39:40120) 2024-09-10T21:58:46.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.319+0000 7f417659c640 1 -- 172.21.15.39:0/3584526076 learned_addr learned my addr 172.21.15.39:0/3584526076 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:46.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.320+0000 7f417659c640 1 -- 172.21.15.39:0/3584526076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255cdf0 msgr2=0x55d082568840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:58:46.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.320+0000 7f417659c640 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255cdf0 0x55d082568840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.320+0000 7f417659c640 1 -- 172.21.15.39:0/3584526076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d082568d80 msgr2=0x55d08256b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.320+0000 7f417659c640 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d082568d80 0x55d08256b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.320+0000 7f417659c640 1 -- 172.21.15.39:0/3584526076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d082220650 con 0x55d08255c4d0 2024-09-10T21:58:46.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.322+0000 7f417659c640 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41680ca240 tx=0x7f41680303b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52106cc42096399 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.323+0000 7f416cff9640 1 -- 172.21.15.39:0/3584526076 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168030450 con 0x55d08255c4d0 2024-09-10T21:58:46.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.323+0000 7f416cff9640 1 -- 172.21.15.39:0/3584526076 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41680328f0 con 0x55d08255c4d0 2024-09-10T21:58:46.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.324+0000 7f417f16a740 1 -- 172.21.15.39:0/3584526076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 msgr2=0x55d08255c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.324+0000 7f417f16a740 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41680ca240 tx=0x7f41680303b0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.325+0000 7f417f16a740 1 -- 172.21.15.39:0/3584526076 shutdown_connections 2024-09-10T21:58:46.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.325+0000 7f417f16a740 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d082568d80 0x55d08256b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.325+0000 7f417f16a740 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255cdf0 0x55d082568840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.325+0000 7f417f16a740 1 --2- 172.21.15.39:0/3584526076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d08255c8b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.325+0000 7f417f16a740 1 -- 172.21.15.39:0/3584526076 >> 172.21.15.39:0/3584526076 conn(0x55d08255a300 msgr2=0x55d08255b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.326+0000 7f417f16a740 1 -- 172.21.15.39:0/3584526076 shutdown_connections 2024-09-10T21:58:46.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.327+0000 7f417f16a740 1 -- 172.21.15.39:0/3584526076 wait complete. 2024-09-10T21:58:46.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.327+0000 7f417f16a740 1 -- start start 2024-09-10T21:58:46.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.327+0000 7f417f16a740 1 Processor -- start 2024-09-10T21:58:46.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255c4d0 0x55d082568680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082565ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d082323700 con 0x55d08255cdf0 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d08245d160 con 0x55d082568d80 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d08256b7c0 con 0x55d08255c4d0 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417f16a740 10 client.0 _ll_register_callbacks cb 0x55d0824769e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40126/0 (socket says 172.21.15.39:40126) 2024-09-10T21:58:46.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f4176d9d640 1 -- 172.21.15.39:0/1460858896 learned_addr learned my addr 172.21.15.39:0/1460858896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f417659c640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255c4d0 0x55d082568680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.329+0000 7f416ffff640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082565ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 -- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255c4d0 msgr2=0x55d082568680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255c4d0 0x55d082568680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 -- 172.21.15.39:0/1460858896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 msgr2=0x55d082565ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082565ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 -- 172.21.15.39:0/1460858896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08248ac90 con 0x55d082568d80 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f4176d9d640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f417000e750 tx=0x7f417000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa8572b2b458bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f415dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.330+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417000cc40 con 0x55d082568d80 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.331+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f417000cde0 con 0x55d082568d80 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.331+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41680328f0 con 0x55d082568d80 2024-09-10T21:58:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.331+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f417000eea0 con 0x55d082568d80 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.331+0000 7f417f16a740 10 client.25931 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.331+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0825771b0 con 0x55d082568d80 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41680328f0 con 0x55d082568d80 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4170018770 con 0x55d082568d80 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 10 client.25931 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 10 client.25931 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 20 client.25931 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d082578ae0 0x55d08257af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 4 client.25931 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.334+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0824d4df0 con 0x55d082578ae0 2024-09-10T21:58:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.335+0000 7f417659c640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d082578ae0 0x55d08257af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.340+0000 7f417659c640 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d082578ae0 0x55d08257af00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=517b0ba68488ebce server_cookie=640a9196d38fc7dd in_seq=0 out_seq=0 2024-09-10T21:58:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.340+0000 7f415dffb640 10 client.25931 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:58:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.346+0000 7f415dffb640 1 -- 172.21.15.39:0/1460858896 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0824d4df0 con 0x55d082578ae0 2024-09-10T21:58:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.346+0000 7f415dffb640 10 client.25931 handle_command_reply: tid=0 2024-09-10T21:58:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.346+0000 7f417f16a740 1 client.25931 shutdown 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.347+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 msgr2=0x55d0825660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.347+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f417000e750 tx=0x7f417000ec10 comp rx=0 tx=0).stop 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 shutdown_connections 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d082578ae0 0x55d08257af00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d082568d80 0x55d0825660e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082565ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 --2- 172.21.15.39:0/1460858896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d08255c4d0 0x55d082568680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.348+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 >> 172.21.15.39:0/1460858896 conn(0x55d08255a300 msgr2=0x55d08255fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.349+0000 7f415dffb640 0 client.25931 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:58:46.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.350+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 shutdown_connections 2024-09-10T21:58:46.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.350+0000 7f417f16a740 1 -- 172.21.15.39:0/1460858896 wait complete. 2024-09-10T21:58:46.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.351+0000 7f417f16a740 20 client.25931 trim_cache size 0 max 16384 2024-09-10T21:58:46.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.381+0000 7f417f16a740 1 Processor -- start 2024-09-10T21:58:46.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.381+0000 7f417f16a740 1 -- start start 2024-09-10T21:58:46.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.381+0000 7f417f16a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417f16a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 0x55d08255b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35706/0 (socket says 172.21.15.39:35706) 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417f16a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08255b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417f16a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f415800e4b0 con 0x55d08255c4d0 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417f16a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f41580100b0 con 0x55d08255cdf0 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417f16a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f415800eb80 con 0x55d082568d80 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f417659c640 1 -- 172.21.15.39:0/2705676076 learned_addr learned my addr 172.21.15.39:0/2705676076 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:46.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.382+0000 7f4176d9d640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08255b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f416ffff640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 0x55d08255b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f417659c640 1 -- 172.21.15.39:0/2705676076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 msgr2=0x55d08255b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f417659c640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08255b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f417659c640 1 -- 172.21.15.39:0/2705676076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 msgr2=0x55d08255b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f417659c640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 0x55d08255b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f417659c640 1 -- 172.21.15.39:0/2705676076 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08255cc20 con 0x55d08255c4d0 2024-09-10T21:58:46.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.383+0000 7f416ffff640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 0x55d08255b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:58:46.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.384+0000 7f417659c640 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f41680045d0 tx=0x7f41680306d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8975fc6d20143a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.386+0000 7f415ffff640 1 -- 172.21.15.39:0/2705676076 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168030450 con 0x55d08255c4d0 2024-09-10T21:58:46.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.386+0000 7f415ffff640 1 -- 172.21.15.39:0/2705676076 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41680328f0 con 0x55d08255c4d0 2024-09-10T21:58:46.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.386+0000 7f415ffff640 1 -- 172.21.15.39:0/2705676076 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680cc230 con 0x55d08255c4d0 2024-09-10T21:58:46.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.387+0000 7f417f16a740 1 -- 172.21.15.39:0/2705676076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 msgr2=0x55d082559c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.387+0000 7f417f16a740 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f41680045d0 tx=0x7f41680306d0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.388+0000 7f417f16a740 1 -- 172.21.15.39:0/2705676076 shutdown_connections 2024-09-10T21:58:46.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.388+0000 7f417f16a740 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08255b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.388+0000 7f417f16a740 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255cdf0 0x55d08255b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.388+0000 7f417f16a740 1 --2- 172.21.15.39:0/2705676076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255c4d0 0x55d082559c10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.388+0000 7f417f16a740 1 -- 172.21.15.39:0/2705676076 >> 172.21.15.39:0/2705676076 conn(0x55d08255a300 msgr2=0x55d082565a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.390+0000 7f417f16a740 1 -- 172.21.15.39:0/2705676076 shutdown_connections 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.391+0000 7f417f16a740 1 -- 172.21.15.39:0/2705676076 wait complete. 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.391+0000 7f417f16a740 1 -- start start 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.391+0000 7f417f16a740 1 Processor -- start 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d082570a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082570fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f415800f920 con 0x55d08255cdf0 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f415800f250 con 0x55d08255c4d0 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f415800c490 con 0x55d082568d80 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.392+0000 7f417f16a740 10 client.0 _ll_register_callbacks cb 0x7f41700098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.393+0000 7f417659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d082570a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.393+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.393+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:59254/0 (socket says 172.21.15.39:59254) 2024-09-10T21:58:46.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.393+0000 7f4176d9d640 1 -- 172.21.15.39:0/1921047063 learned_addr learned my addr 172.21.15.39:0/1921047063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f416ffff640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082570fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 -- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 msgr2=0x55d08256ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 -- 172.21.15.39:0/1921047063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 msgr2=0x55d082570fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082570fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 -- 172.21.15.39:0/1921047063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0825716a0 con 0x55d08255c4d0 2024-09-10T21:58:46.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f4176d9d640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:46.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.395+0000 7f417659c640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d082570a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41680cccd0 tx=0x7f41680304d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a338f991d6304d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:46.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.396+0000 7f415dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:46.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.396+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680ef0e0 con 0x55d08255c4d0 2024-09-10T21:58:46.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.396+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f41680d0dd0 con 0x55d08255c4d0 2024-09-10T21:58:46.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.396+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41680328f0 con 0x55d08255c4d0 2024-09-10T21:58:46.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.400+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41680ccae0 con 0x55d08255c4d0 2024-09-10T21:58:46.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.402+0000 7f417f16a740 10 client.25937 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:46.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.402+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0825e5eb0 con 0x55d08255c4d0 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.405+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41680328f0 con 0x55d08255c4d0 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.405+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f41680b81a0 con 0x55d08255c4d0 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 10 client.25937 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 10 client.25937 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 20 client.25937 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d0825e60e0 0x55d0825e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 4 client.25937 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.406+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0824d08a0 con 0x55d0825e60e0 2024-09-10T21:58:46.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.407+0000 7f416ffff640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d0825e60e0 0x55d0825e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:46.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.409+0000 7f416ffff640 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d0825e60e0 0x55d0825e84d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d1965ab686092c3 server_cookie=a6beb2134841eab8 in_seq=0 out_seq=0 2024-09-10T21:58:46.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.409+0000 7f415dffb640 10 client.25937 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:58:46.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.411+0000 7f415dffb640 1 -- 172.21.15.39:0/1921047063 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0824d08a0 con 0x55d0825e60e0 2024-09-10T21:58:46.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.411+0000 7f415dffb640 10 client.25937 handle_command_reply: tid=0 2024-09-10T21:58:46.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 client.25937 shutdown 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 msgr2=0x55d082570a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d082570a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41680cccd0 tx=0x7f41680304d0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 shutdown_connections 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55d0825e60e0 0x55d0825e84d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d082568d80 0x55d08256ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d08255cdf0 0x55d082570fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 --2- 172.21.15.39:0/1921047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d08255c4d0 0x55d082570a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.412+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 >> 172.21.15.39:0/1921047063 conn(0x55d08255a300 msgr2=0x55d082565880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.413+0000 7f415dffb640 0 client.25937 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:58:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.413+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 shutdown_connections 2024-09-10T21:58:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.414+0000 7f417f16a740 1 -- 172.21.15.39:0/1921047063 wait complete. 2024-09-10T21:58:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.415+0000 7f417f16a740 20 client.25937 trim_cache size 0 max 16384 2024-09-10T21:58:46.416 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 msgr2=0x7f41640b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 0x7f41640b78a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f417819d140 tx=0x7f4160009260 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 msgr2=0x7f4178076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4168035040 tx=0x7f4168032d50 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 shutdown_connections 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f41640b53e0 0x7f41640b78a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4178109140 0x7f4178075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41781087c0 0x7f41780754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 --2- 172.21.15.39:0/718900408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4178102db0 0x7f4178076f50 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4168035040 tx=0x7f4168032d50 comp rx=0 tx=0).stop 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 >> 172.21.15.39:0/718900408 conn(0x7f41780fe800 msgr2=0x7f4178100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 shutdown_connections 2024-09-10T21:58:46.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:46.420+0000 7f417cd95640 1 -- 172.21.15.39:0/718900408 wait complete. 2024-09-10T21:58:46.501 INFO:tasks.workunit.client.0.smithi039.stdout: 90 357548 433 243893 447 219362 1779 2024-09-10T21:58:46.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:46 smithi070 ceph-mon[34909]: pgmap v454: 97 pgs: 97 active+clean; 257 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 656 op/s 2024-09-10T21:58:46.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:46 smithi039 ceph-mon[30872]: pgmap v454: 97 pgs: 97 active+clean; 257 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 656 op/s 2024-09-10T21:58:46.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:46 smithi173 ceph-mon[35294]: pgmap v454: 97 pgs: 97 active+clean; 257 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 656 op/s 2024-09-10T21:58:47.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:58:47.474 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 -- 172.21.15.39:0/1186171753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c108020 msgr2=0x7fab5c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 --2- 172.21.15.39:0/1186171753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c108020 0x7fab5c10e820 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fab54009900 tx=0x7fab5402a410 comp rx=0 tx=0).stop 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 -- 172.21.15.39:0/1186171753 shutdown_connections 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 --2- 172.21.15.39:0/1186171753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c108020 0x7fab5c10e820 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 --2- 172.21.15.39:0/1186171753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.214+0000 7fab6090d640 1 --2- 172.21.15.39:0/1186171753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c101c90 0x7fab5c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.215+0000 7fab6090d640 1 -- 172.21.15.39:0/1186171753 >> 172.21.15.39:0/1186171753 conn(0x7fab5c0fd700 msgr2=0x7fab5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.215+0000 7fab6090d640 1 -- 172.21.15.39:0/1186171753 shutdown_connections 2024-09-10T21:58:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.215+0000 7fab6090d640 1 -- 172.21.15.39:0/1186171753 wait complete. 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.215+0000 7fab6090d640 1 Processor -- start 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 -- start start 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c108020 0x7fab5c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c111ce0 con 0x7fab5c101c90 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c111b60 con 0x7fab5c1076a0 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab6090d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c111e60 con 0x7fab5c108020 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35730/0 (socket says 172.21.15.39:35730) 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab5a59c640 1 -- 172.21.15.39:0/2823887559 learned_addr learned my addr 172.21.15.39:0/2823887559 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab53fff640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.216+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c108020 0x7fab5c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 -- 172.21.15.39:0/2823887559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c108020 msgr2=0x7fab5c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c108020 0x7fab5c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 -- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 msgr2=0x7fab5c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 -- 172.21.15.39:0/2823887559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c1a7620 con 0x7fab5c1076a0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab5a59c640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab53fff640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c0fe140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab4400e9f0 tx=0x7fab4400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab537fe640 1 -- 172.21.15.39:0/2823887559 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4400cd80 con 0x7fab5c1076a0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab537fe640 1 -- 172.21.15.39:0/2823887559 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab440035f0 con 0x7fab5c1076a0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab537fe640 1 -- 172.21.15.39:0/2823887559 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44010670 con 0x7fab5c1076a0 2024-09-10T21:58:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c1a7910 con 0x7fab5c1076a0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.217+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c1a7e00 con 0x7fab5c1076a0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.220+0000 7fab62ce2740 1 Processor -- start 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 -- start start 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557fb5b7bea0 con 0x557fb5c1a590 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fb5b6b2d0 con 0x557fb5c054d0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab62ce2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557fb5b6f0e0 con 0x557fb5c05df0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab5ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab5ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40170/0 (socket says 172.21.15.39:40170) 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.221+0000 7fab5ad9d640 1 -- 172.21.15.39:0/2715318300 learned_addr learned my addr 172.21.15.39:0/2715318300 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab537fe640 1 -- 172.21.15.39:0/2823887559 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fab44004000 con 0x7fab5c1076a0 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab53fff640 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 -- 172.21.15.39:0/2715318300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 msgr2=0x557fb5c1a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 -- 172.21.15.39:0/2715318300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 msgr2=0x557fb5c1c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 -- 172.21.15.39:0/2715318300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb58c9650 con 0x557fb5c054d0 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.222+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab5402a930 tx=0x7fab54032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e881de13aa3cb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.223+0000 7fab537fe640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 0x7fab480b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.223+0000 7fab50ff9640 1 -- 172.21.15.39:0/2715318300 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54040070 con 0x557fb5c054d0 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.223+0000 7fab50ff9640 1 -- 172.21.15.39:0/2715318300 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab54004030 con 0x557fb5c054d0 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.223+0000 7fab50ff9640 1 -- 172.21.15.39:0/2715318300 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54035040 con 0x557fb5c054d0 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.224+0000 7fab5a59c640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 0x7fab480b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.224+0000 7fab537fe640 1 -- 172.21.15.39:0/2823887559 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fab440e5df0 con 0x7fab5c1076a0 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.224+0000 7fab62ce2740 1 -- 172.21.15.39:0/2715318300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 msgr2=0x557fb5c058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.224+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab5402a930 tx=0x7fab54032b20 comp rx=0 tx=0).stop 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 -- 172.21.15.39:0/2715318300 shutdown_connections 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2715318300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c058b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 -- 172.21.15.39:0/2715318300 >> 172.21.15.39:0/2715318300 conn(0x557fb5c03300 msgr2=0x557fb5c044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab5a59c640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 0x7fab480b78a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x557fb5c08650 tx=0x7fab4c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 -- 172.21.15.39:0/2715318300 shutdown_connections 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.225+0000 7fab62ce2740 1 -- 172.21.15.39:0/2715318300 wait complete. 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 -- start start 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 Processor -- start 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557fb59cc700 con 0x557fb5c1a590 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fb5b06160 con 0x557fb5c054d0 2024-09-10T21:58:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557fb5c1d1e0 con 0x557fb5c05df0 2024-09-10T21:58:48.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab62ce2740 10 client.0 _ll_register_callbacks cb 0x557fb5b1f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:48.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab5ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.226+0000 7fab5ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c178f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35760/0 (socket says 172.21.15.39:35760) 2024-09-10T21:58:48.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab5ad9d640 1 -- 172.21.15.39:0/1860378024 learned_addr learned my addr 172.21.15.39:0/1860378024 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab5a59c640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 -- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 msgr2=0x557fb5c19e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c19e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 -- 172.21.15.39:0/1860378024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 msgr2=0x557fb5c178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c178f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.227+0000 7fab53fff640 1 -- 172.21.15.39:0/1860378024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fb5b33c90 con 0x557fb5c05df0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab53fff640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c172c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557fb5c05480 tx=0x7fab440abf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a90c1a460f11e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab440ac560 con 0x557fb5c05df0 2024-09-10T21:58:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fab44009310 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab54004030 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab440b1040 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab62ce2740 10 client.25918 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.228+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fb5c28b90 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.229+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab54004030 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fab440e9020 con 0x557fb5c05df0 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 10 client.25918 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 10 client.25918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 20 client.25918 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c2a040 0x557fb5c2c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 4 client.25918 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fb5b7ddf0 con 0x557fb5c2a040 2024-09-10T21:58:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.230+0000 7fab5a59c640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c2a040 0x557fb5c2c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.232+0000 7fab41ffb640 10 client.25918 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.232+0000 7fab5a59c640 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c2a040 0x557fb5c2c470 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b7462eb9e97e8 server_cookie=718c43fc1957578f in_seq=0 out_seq=0 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.235+0000 7fab41ffb640 1 -- 172.21.15.39:0/1860378024 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fb5b7ddf0 con 0x557fb5c2a040 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.235+0000 7fab41ffb640 10 client.25918 handle_command_reply: tid=0 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 client.25918 shutdown 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 msgr2=0x557fb5c172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c172c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557fb5c05480 tx=0x7fab440abf70 comp rx=0 tx=0).stop 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 shutdown_connections 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c2a040 0x557fb5c2c470 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c172c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 --2- 172.21.15.39:0/1860378024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 >> 172.21.15.39:0/1860378024 conn(0x557fb5c03300 msgr2=0x557fb5c08ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.236+0000 7fab41ffb640 0 client.25918 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.237+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 shutdown_connections 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.237+0000 7fab62ce2740 1 -- 172.21.15.39:0/1860378024 wait complete. 2024-09-10T21:58:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.237+0000 7fab62ce2740 20 client.25918 trim_cache size 0 max 16384 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 Processor -- start 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 -- start start 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c054d0 0x557fb5c26440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 0x557fb5c322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ac060 con 0x557fb5c05df0 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1adc60 con 0x557fb5c1a590 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab62ce2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ac730 con 0x557fb5c054d0 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35762/0 (socket says 172.21.15.39:35762) 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 -- 172.21.15.39:0/2066444692 learned_addr learned my addr 172.21.15.39:0/2066444692 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 0x557fb5c322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab5a59c640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c054d0 0x557fb5c26440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 -- 172.21.15.39:0/2066444692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c054d0 msgr2=0x557fb5c26440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c054d0 0x557fb5c26440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 -- 172.21.15.39:0/2066444692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 msgr2=0x557fb5c322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 0x557fb5c322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab53fff640 1 -- 172.21.15.39:0/2066444692 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb5c2caf0 con 0x557fb5c05df0 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.255+0000 7fab5ad9d640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 0x557fb5c322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.256+0000 7fab53fff640 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fab440ac260 tx=0x7fab440ac330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779424cedfaa53bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.256+0000 7fab43fff640 1 -- 172.21.15.39:0/2066444692 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab440ac560 con 0x557fb5c05df0 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.256+0000 7fab43fff640 1 -- 172.21.15.39:0/2066444692 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab440b5af0 con 0x557fb5c05df0 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.256+0000 7fab43fff640 1 -- 172.21.15.39:0/2066444692 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44004320 con 0x557fb5c05df0 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- 172.21.15.39:0/2066444692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 msgr2=0x557fb5c31d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fab440ac260 tx=0x7fab440ac330 comp rx=0 tx=0).stop 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- 172.21.15.39:0/2066444692 shutdown_connections 2024-09-10T21:58:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c1a590 0x557fb5c322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c05df0 0x557fb5c31d80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 --2- 172.21.15.39:0/2066444692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c054d0 0x557fb5c26440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- 172.21.15.39:0/2066444692 >> 172.21.15.39:0/2066444692 conn(0x557fb5c03300 msgr2=0x557fb5c15b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- 172.21.15.39:0/2066444692 shutdown_connections 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- 172.21.15.39:0/2066444692 wait complete. 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 -- start start 2024-09-10T21:58:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.257+0000 7fab62ce2740 1 Processor -- start 2024-09-10T21:58:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ad4d0 con 0x557fb5c1a590 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1ace00 con 0x557fb5c054d0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1aa040 con 0x557fb5c05df0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab62ce2740 10 client.0 _ll_register_callbacks cb 0x7fab440a84f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40184/0 (socket says 172.21.15.39:40184) 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 -- 172.21.15.39:0/3738388887 learned_addr learned my addr 172.21.15.39:0/3738388887 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab53fff640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 -- 172.21.15.39:0/3738388887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 msgr2=0x557fb5c1d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 -- 172.21.15.39:0/3738388887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 msgr2=0x557fb5c1dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 -- 172.21.15.39:0/3738388887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fb5c1d120 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab5a59c640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x557fb5c2cd20 tx=0x7fab4c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba86bd12dded0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.258+0000 7fab41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c01f8a0 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fab4c01fa40 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab440b5af0 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab4c01fc40 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 10 client.25955 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557fb5c98110 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab4c01fde0 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fab4c011460 con 0x557fb5c054d0 2024-09-10T21:58:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 10 client.25955 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 10 client.25955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 20 client.25955 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c98a00 0x557fb5c9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 4 client.25955 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fab440b5af0 con 0x557fb5c98a00 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.259+0000 7fab53fff640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c98a00 0x557fb5c9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.260+0000 7fab53fff640 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c98a00 0x557fb5c9ae20 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=742efa0b9f89e93e server_cookie=880a93543c74e95e in_seq=0 out_seq=0 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.260+0000 7fab41ffb640 10 client.25955 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab41ffb640 1 -- 172.21.15.39:0/3738388887 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fab440b5af0 con 0x557fb5c98a00 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab41ffb640 10 client.25955 handle_command_reply: tid=0 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 client.25955 shutdown 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 msgr2=0x557fb5c1d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x557fb5c2cd20 tx=0x7fab4c004a40 comp rx=0 tx=0).stop 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 shutdown_connections 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x557fb5c98a00 0x557fb5c9ae20 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fb5c1a590 0x557fb5c1dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab41ffb640 0 client.25955 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557fb5c05df0 0x557fb5c1d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 --2- 172.21.15.39:0/3738388887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fb5c054d0 0x557fb5c1d460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 >> 172.21.15.39:0/3738388887 conn(0x557fb5c03300 msgr2=0x557fb5c19110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 shutdown_connections 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 1 -- 172.21.15.39:0/3738388887 wait complete. 2024-09-10T21:58:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.262+0000 7fab62ce2740 20 client.25955 trim_cache size 0 max 16384 2024-09-10T21:58:48.269 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 msgr2=0x7fab480b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 0x7fab480b78a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x557fb5c08650 tx=0x7fab4c009500 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 msgr2=0x7fab5c0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c0fe140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab4400e9f0 tx=0x7fab4400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 shutdown_connections 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fab480b53e0 0x7fab480b78a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab5c108020 0x7fab5c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab5c1076a0 0x7fab5c0fe140 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab4400e9f0 tx=0x7fab4400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 --2- 172.21.15.39:0/2823887559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab5c101c90 0x7fab5c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 >> 172.21.15.39:0/2823887559 conn(0x7fab5c0fd700 msgr2=0x7fab5c06acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 shutdown_connections 2024-09-10T21:58:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:48.263+0000 7fab6090d640 1 -- 172.21.15.39:0/2823887559 wait complete. 2024-09-10T21:58:48.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:48 smithi070 ceph-mon[34909]: pgmap v455: 97 pgs: 97 active+clean; 277 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 798 op/s 2024-09-10T21:58:48.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:48 smithi039 ceph-mon[30872]: pgmap v455: 97 pgs: 97 active+clean; 277 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 798 op/s 2024-09-10T21:58:48.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:48 smithi173 ceph-mon[35294]: pgmap v455: 97 pgs: 97 active+clean; 277 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 798 op/s 2024-09-10T21:58:49.974 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:58:49.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:58:50.254 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:50.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:50 smithi039 ceph-mon[30872]: pgmap v456: 97 pgs: 97 active+clean; 302 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 918 op/s 2024-09-10T21:58:50.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:50 smithi070 ceph-mon[34909]: pgmap v456: 97 pgs: 97 active+clean; 302 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 918 op/s 2024-09-10T21:58:50.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 -- 172.21.15.39:0/1360285326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63401076a0 msgr2=0x7f6340107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 --2- 172.21.15.39:0/1360285326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63401076a0 0x7f6340107ae0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6330009900 tx=0x7f633002a410 comp rx=0 tx=0).stop 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 -- 172.21.15.39:0/1360285326 shutdown_connections 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 --2- 172.21.15.39:0/1360285326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6340108020 0x7f634010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 --2- 172.21.15.39:0/1360285326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63401076a0 0x7f6340107ae0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 --2- 172.21.15.39:0/1360285326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340101c90 0x7f6340102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.924+0000 7f6348553640 1 -- 172.21.15.39:0/1360285326 >> 172.21.15.39:0/1360285326 conn(0x7f63400fd700 msgr2=0x7f63400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.925+0000 7f6348553640 1 -- 172.21.15.39:0/1360285326 shutdown_connections 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.925+0000 7f6348553640 1 -- 172.21.15.39:0/1360285326 wait complete. 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.925+0000 7f6348553640 1 Processor -- start 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.925+0000 7f6348553640 1 -- start start 2024-09-10T21:58:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.925+0000 7f6348553640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340101c90 0x7f6340199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6348553640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6348553640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340108020 0x7f634019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6348553640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111c70 con 0x7f6340101c90 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6348553640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111af0 con 0x7f63401076a0 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6348553640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111df0 con 0x7f6340108020 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:35812/0 (socket says 172.21.15.39:35812) 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6346af0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340108020 0x7f634019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 -- 172.21.15.39:0/4075193036 learned_addr learned my addr 172.21.15.39:0/4075193036 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f63462ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340101c90 0x7f6340199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 -- 172.21.15.39:0/4075193036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340108020 msgr2=0x7f634019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340108020 0x7f634019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 -- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340101c90 msgr2=0x7f6340199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340101c90 0x7f6340199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 -- 172.21.15.39:0/4075193036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634019f3b0 con 0x7f63401076a0 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.926+0000 7f6345aee640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6330005940 tx=0x7f6330004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.927+0000 7f63377fe640 1 -- 172.21.15.39:0/4075193036 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633003f030 con 0x7f63401076a0 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.927+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634019f640 con 0x7f63401076a0 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.927+0000 7f63377fe640 1 -- 172.21.15.39:0/4075193036 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6330003aa0 con 0x7f63401076a0 2024-09-10T21:58:50.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.928+0000 7f63377fe640 1 -- 172.21.15.39:0/4075193036 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330035070 con 0x7f63401076a0 2024-09-10T21:58:50.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.928+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a5d60 con 0x7f63401076a0 2024-09-10T21:58:50.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.930+0000 7f63377fe640 1 -- 172.21.15.39:0/4075193036 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f63300035f0 con 0x7f63401076a0 2024-09-10T21:58:50.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.930+0000 7f634a928740 1 Processor -- start 2024-09-10T21:58:50.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.930+0000 7f634a928740 1 -- start start 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b50012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63377fe640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 0x7f632c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b5013f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5591b4f77e60 con 0x5591b5011ba0 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5591b4f67290 con 0x5591b5001800 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f634a928740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5591b4f6b0a0 con 0x5591b5000ee0 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:35820/0 (socket says 172.21.15.39:35820) 2024-09-10T21:58:50.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 -- 172.21.15.39:0/1424818219 learned_addr learned my addr 172.21.15.39:0/1424818219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:50.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f6345aee640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 0x7f632c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f6346af0640 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b5013f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 -- 172.21.15.39:0/1424818219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 msgr2=0x5591b50012c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:58:50.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b50012c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 -- 172.21.15.39:0/1424818219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 msgr2=0x5591b5013f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b5013f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f63462ef640 1 -- 172.21.15.39:0/1424818219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b4cc5930 con 0x5591b5001800 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.931+0000 7f6346af0640 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b5013f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f63462ef640 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f633c00bd10 tx=0x7f633c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561fc0eaa4e72239 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f6334ff9640 1 -- 172.21.15.39:0/1424818219 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004030 con 0x5591b5001800 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f6334ff9640 1 -- 172.21.15.39:0/1424818219 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c0035f0 con 0x5591b5001800 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f6334ff9640 1 -- 172.21.15.39:0/1424818219 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c0117b0 con 0x5591b5001800 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f6345aee640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 0x7f632c0b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63300f4430 tx=0x7f63300c9460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.932+0000 7f63377fe640 1 -- 172.21.15.39:0/4075193036 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6330106510 con 0x7f63401076a0 2024-09-10T21:58:50.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- 172.21.15.39:0/1424818219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 msgr2=0x5591b5011660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f633c00bd10 tx=0x7f633c0107a0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- 172.21.15.39:0/1424818219 shutdown_connections 2024-09-10T21:58:50.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b5013f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b5011660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 --2- 172.21.15.39:0/1424818219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b50012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- 172.21.15.39:0/1424818219 >> 172.21.15.39:0/1424818219 conn(0x5591b4ffed10 msgr2=0x5591b4fffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- 172.21.15.39:0/1424818219 shutdown_connections 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- 172.21.15.39:0/1424818219 wait complete. 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.933+0000 7f634a928740 1 -- start start 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 Processor -- start 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b500f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5591b4dc8890 con 0x5591b5011ba0 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5591b4f01d40 con 0x5591b5001800 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5591b5014850 con 0x5591b5000ee0 2024-09-10T21:58:50.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f634a928740 10 client.0 _ll_register_callbacks cb 0x5591b4f65c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f6346af0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b500f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f6346af0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b500f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59212/0 (socket says 172.21.15.39:59212) 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:35822/0 (socket says 172.21.15.39:35822) 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f6346af0640 1 -- 172.21.15.39:0/1462958399 learned_addr learned my addr 172.21.15.39:0/1462958399 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f6346af0640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 -- 172.21.15.39:0/1462958399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 msgr2=0x5591b500eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 -- 172.21.15.39:0/1462958399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 msgr2=0x5591b500f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b500f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.934+0000 7f63462ef640 1 -- 172.21.15.39:0/1462958399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b501dc30 con 0x5591b5001800 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f63462ef640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c00b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897eaca510f8af46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:50.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004190 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c0035f0 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f633c004330 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f633c003a30 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f634a928740 10 client.25967 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5591b5020630 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c0035f0 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.935+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f633c023070 con 0x5591b5001800 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 10 client.25967 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 20 client.25967 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5021980 0x5591b5023d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 4 client.25967 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:50.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591b4f79db0 con 0x5591b5021980 2024-09-10T21:58:50.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f6346af0640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5021980 0x5591b5023d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f6329ffb640 10 client.25967 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:50.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.936+0000 7f6346af0640 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5021980 0x5591b5023d70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c78e0b97609d57 server_cookie=f64d5479c498a80c in_seq=0 out_seq=0 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f6329ffb640 1 -- 172.21.15.39:0/1462958399 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591b4f79db0 con 0x5591b5021980 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f6329ffb640 10 client.25967 handle_command_reply: tid=0 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 client.25967 shutdown 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 msgr2=0x5591b500f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c00b970 comp rx=0 tx=0).stop 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 shutdown_connections 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5021980 0x5591b5023d70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5011ba0 0x5591b500f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5001800 0x5591b500f0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f6329ffb640 0 client.25967 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 --2- 172.21.15.39:0/1462958399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 >> 172.21.15.39:0/1462958399 conn(0x5591b4ffed10 msgr2=0x5591b4ffdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 shutdown_connections 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 1 -- 172.21.15.39:0/1462958399 wait complete. 2024-09-10T21:58:50.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.938+0000 7f634a928740 20 client.25967 trim_cache size 0 max 16384 2024-09-10T21:58:50.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.971+0000 7f634a928740 1 Processor -- start 2024-09-10T21:58:50.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 -- start start 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5001800 0x5591b500c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63401ac1c0 con 0x5591b5001800 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63401addc0 con 0x5591b4ffed10 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f634a928740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63401ac890 con 0x5591b5000ee0 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f6346af0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f6346af0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:35836/0 (socket says 172.21.15.39:35836) 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f6346af0640 1 -- 172.21.15.39:0/3605023006 learned_addr learned my addr 172.21.15.39:0/3605023006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.974+0000 7f6346af0640 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5001800 0x5591b500c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.977+0000 7f63462ef640 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.979+0000 7f6346af0640 1 -- 172.21.15.39:0/3605023006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 msgr2=0x5591b500c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.979+0000 7f6346af0640 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.979+0000 7f6346af0640 1 -- 172.21.15.39:0/3605023006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5001800 msgr2=0x5591b500c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.979+0000 7f6346af0640 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5001800 0x5591b500c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.979+0000 7f6346af0640 1 -- 172.21.15.39:0/3605023006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b500d060 con 0x5591b4ffed10 2024-09-10T21:58:50.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.983+0000 7f6346af0640 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5591b50244f0 tx=0x7f6338004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca04c4ded62a99f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.986+0000 7f632bfff640 1 -- 172.21.15.39:0/3605023006 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338019040 con 0x5591b4ffed10 2024-09-10T21:58:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.986+0000 7f632bfff640 1 -- 172.21.15.39:0/3605023006 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6338003b70 con 0x5591b4ffed10 2024-09-10T21:58:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.986+0000 7f632bfff640 1 -- 172.21.15.39:0/3605023006 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338021470 con 0x5591b4ffed10 2024-09-10T21:58:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.987+0000 7f634a928740 1 -- 172.21.15.39:0/3605023006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 msgr2=0x5591b500e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.987+0000 7f634a928740 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5591b50244f0 tx=0x7f6338004a40 comp rx=0 tx=0).stop 2024-09-10T21:58:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.988+0000 7f634a928740 1 -- 172.21.15.39:0/3605023006 shutdown_connections 2024-09-10T21:58:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.988+0000 7f634a928740 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b5001800 0x5591b500c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.988+0000 7f634a928740 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5000ee0 0x5591b500c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.988+0000 7f634a928740 1 --2- 172.21.15.39:0/3605023006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b4ffed10 0x5591b500e3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.988+0000 7f634a928740 1 -- 172.21.15.39:0/3605023006 >> 172.21.15.39:0/3605023006 conn(0x5591b5010dc0 msgr2=0x5591b5000210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.991+0000 7f634a928740 1 -- 172.21.15.39:0/3605023006 shutdown_connections 2024-09-10T21:58:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.991+0000 7f634a928740 1 -- 172.21.15.39:0/3605023006 wait complete. 2024-09-10T21:58:50.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:50 smithi173 ceph-mon[35294]: pgmap v456: 97 pgs: 97 active+clean; 302 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 918 op/s 2024-09-10T21:58:50.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 -- start start 2024-09-10T21:58:50.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 Processor -- start 2024-09-10T21:58:50.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 0x5591b5019ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5001800 0x5591b5009fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63401ad630 con 0x5591b4ffed10 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63401acf60 con 0x5591b5000ee0 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63401aa1a0 con 0x5591b5001800 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.992+0000 7f634a928740 10 client.0 _ll_register_callbacks cb 0x7f633c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.993+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.993+0000 7f63462ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:35852/0 (socket says 172.21.15.39:35852) 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.993+0000 7f63462ef640 1 -- 172.21.15.39:0/983389798 learned_addr learned my addr 172.21.15.39:0/983389798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.993+0000 7f6346af0640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 0x5591b5019ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f63462ef640 1 -- 172.21.15.39:0/983389798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5001800 msgr2=0x5591b5009fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f63462ef640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5001800 0x5591b5009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f63462ef640 1 -- 172.21.15.39:0/983389798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 msgr2=0x5591b5019ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f63462ef640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 0x5591b5019ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f63462ef640 1 -- 172.21.15.39:0/983389798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b501a850 con 0x5591b5000ee0 2024-09-10T21:58:50.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.994+0000 7f6346af0640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 0x5591b5019ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:51.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.999+0000 7f63462ef640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f633c004c10 tx=0x7f633c01bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ad2df0909186d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:51.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:50.999+0000 7f6329ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:58:51.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.000+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004e80 con 0x5591b5000ee0 2024-09-10T21:58:51.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.000+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f633c005020 con 0x5591b5000ee0 2024-09-10T21:58:51.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.000+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6338003b70 con 0x5591b5000ee0 2024-09-10T21:58:51.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.004+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f633c005240 con 0x5591b5000ee0 2024-09-10T21:58:51.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.006+0000 7f634a928740 10 client.25973 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:51.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.006+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5591b5086e30 con 0x5591b5000ee0 2024-09-10T21:58:51.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6338003b70 con 0x5591b5000ee0 2024-09-10T21:58:51.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f633c023040 con 0x5591b5000ee0 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 10 client.25973 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 10 client.25973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 20 client.25973 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5011ba0 0x5591b5089690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 4 client.25973 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:58:51.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.007+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5591b4f75860 con 0x5591b5011ba0 2024-09-10T21:58:51.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.008+0000 7f6346af0640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5011ba0 0x5591b5089690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:51.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.012+0000 7f6329ffb640 10 client.25973 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:51.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.012+0000 7f6346af0640 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5011ba0 0x5591b5089690 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5d6582cff17efd7 server_cookie=ad9238977f3ca186 in_seq=0 out_seq=0 2024-09-10T21:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f6329ffb640 1 -- 172.21.15.39:0/983389798 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591b4f75860 con 0x5591b5011ba0 2024-09-10T21:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f6329ffb640 10 client.25973 handle_command_reply: tid=0 2024-09-10T21:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 client.25973 shutdown 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 msgr2=0x5591b501a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f633c004c10 tx=0x7f633c01bc90 comp rx=0 tx=0).stop 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 shutdown_connections 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5591b5011ba0 0x5591b5089690 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5591b5001800 0x5591b5009fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591b5000ee0 0x5591b501a020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 --2- 172.21.15.39:0/983389798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591b4ffed10 0x5591b5019ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.401+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 >> 172.21.15.39:0/983389798 conn(0x5591b5010dc0 msgr2=0x5591b500f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.402+0000 7f6329ffb640 0 client.25973 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.402+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 shutdown_connections 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.402+0000 7f634a928740 1 -- 172.21.15.39:0/983389798 wait complete. 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.402+0000 7f634a928740 20 client.25973 trim_cache size 0 max 16384 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:58:51.404 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "a08bf2b3-c577-4804-9533-3881b07a580c", 2024-09-10T21:58:51.405 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:58:51.405 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:58:51.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 msgr2=0x7f632c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:51.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 0x7f632c0b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63300f4430 tx=0x7f63300c9460 comp rx=0 tx=0).stop 2024-09-10T21:58:51.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 msgr2=0x7f6340199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6330005940 tx=0x7f6330004270 comp rx=0 tx=0).stop 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 shutdown_connections 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f632c0b52e0 0x7f632c0b77a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6340108020 0x7f634019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63401076a0 0x7f6340199840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 --2- 172.21.15.39:0/4075193036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340101c90 0x7f6340199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 >> 172.21.15.39:0/4075193036 conn(0x7f63400fd700 msgr2=0x7f6340100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 shutdown_connections 2024-09-10T21:58:51.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:51.403+0000 7f6348553640 1 -- 172.21.15.39:0/4075193036 wait complete. 2024-09-10T21:58:52.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:58:52.825 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: pgmap v457: 97 pgs: 97 active+clean; 308 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:52.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:52 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: pgmap v457: 97 pgs: 97 active+clean; 308 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:52.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:52 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:58:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: pgmap v457: 97 pgs: 97 active+clean; 308 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2024-09-10T21:58:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:52.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:52.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:52.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:52 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:53.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 -- 172.21.15.39:0/268277526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c10d0e0 msgr2=0x7f147c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 --2- 172.21.15.39:0/268277526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c10d0e0 0x7f147c10f550 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1474009ca0 tx=0x7f147402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 -- 172.21.15.39:0/268277526 shutdown_connections 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 --2- 172.21.15.39:0/268277526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c10d0e0 0x7f147c10f550 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 --2- 172.21.15.39:0/268277526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 0x7f147c10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 --2- 172.21.15.39:0/268277526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c103b30 0x7f147c103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 -- 172.21.15.39:0/268277526 >> 172.21.15.39:0/268277526 conn(0x7f147c0fd700 msgr2=0x7f147c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 -- 172.21.15.39:0/268277526 shutdown_connections 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.366+0000 7f1480b5e640 1 -- 172.21.15.39:0/268277526 wait complete. 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 Processor -- start 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 -- start start 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 0x7f147c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c10d0e0 0x7f147c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f147c112d60 con 0x7f147c103b30 2024-09-10T21:58:53.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f147c112be0 con 0x7f147c10d0e0 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1480b5e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f147c112ee0 con 0x7f147c104530 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f147a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f147a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59242/0 (socket says 172.21.15.39:59242) 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f147a59c640 1 -- 172.21.15.39:0/4208436082 learned_addr learned my addr 172.21.15.39:0/4208436082 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f147ad9d640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c10d0e0 0x7f147c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.367+0000 7f1473fff640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 0x7f147c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 -- 172.21.15.39:0/4208436082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 msgr2=0x7f147c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 0x7f147c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 -- 172.21.15.39:0/4208436082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c10d0e0 msgr2=0x7f147c19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c10d0e0 0x7f147c19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 -- 172.21.15.39:0/4208436082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c19f2a0 con 0x7f147c103b30 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f147a59c640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e9f0 tx=0x7f146c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f14737fe640 1 -- 172.21.15.39:0/4208436082 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c00cd80 con 0x7f147c103b30 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f14737fe640 1 -- 172.21.15.39:0/4208436082 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f146c0108e0 con 0x7f147c103b30 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c19f590 con 0x7f147c103b30 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f14737fe640 1 -- 172.21.15.39:0/4208436082 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c018980 con 0x7f147c103b30 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.368+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c1a5e20 con 0x7f147c103b30 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 Processor -- start 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 -- start start 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 0x56528e3c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3d8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56528e33ee50 con 0x56528e3d8d60 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56528e32e280 con 0x56528e3c80a0 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1482f33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56528e332090 con 0x56528e3c89c0 2024-09-10T21:58:53.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f14737fe640 1 -- 172.21.15.39:0/4208436082 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f146c010430 con 0x7f147c103b30 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59244/0 (socket says 172.21.15.39:59244) 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f147ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 0x56528e3c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f1473fff640 1 -- 172.21.15.39:0/2591044831 learned_addr learned my addr 172.21.15.39:0/2591044831 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.371+0000 7f147a59c640 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3d8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 -- 172.21.15.39:0/2591044831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 msgr2=0x56528e3d8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3d8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 -- 172.21.15.39:0/2591044831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 msgr2=0x56528e3c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 0x56528e3c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 -- 172.21.15.39:0/2591044831 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528e08c650 con 0x56528e3d8d60 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f147ad9d640 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 0x56528e3c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1473fff640 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1464009c50 tx=0x7f14640117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5471aaf5935868ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1470ff9640 1 -- 172.21.15.39:0/2591044831 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464012450 con 0x56528e3d8d60 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1470ff9640 1 -- 172.21.15.39:0/2591044831 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1464012aa0 con 0x56528e3d8d60 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f1470ff9640 1 -- 172.21.15.39:0/2591044831 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146400fb40 con 0x56528e3d8d60 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f14737fe640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 0x7f14680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.372+0000 7f147ad9d640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 0x7f14680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f14737fe640 1 -- 172.21.15.39:0/4208436082 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f146c0e5f60 con 0x7f147c103b30 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- 172.21.15.39:0/2591044831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 msgr2=0x56528e3db150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f147ad9d640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 0x7f14680b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f147402f500 tx=0x7f1474005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1464009c50 tx=0x7f14640117b0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- 172.21.15.39:0/2591044831 shutdown_connections 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3d8d60 0x56528e3db150 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 --2- 172.21.15.39:0/2591044831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3c80a0 0x56528e3c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- 172.21.15.39:0/2591044831 >> 172.21.15.39:0/2591044831 conn(0x56528e3c5ed0 msgr2=0x56528e3c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- 172.21.15.39:0/2591044831 shutdown_connections 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- 172.21.15.39:0/2591044831 wait complete. 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.373+0000 7f1482f33740 1 -- start start 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 Processor -- start 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3d8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56528e18f700 con 0x56528e3c89c0 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56528e2c9110 con 0x56528e3d8d60 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56528e3dba10 con 0x56528e3c80a0 2024-09-10T21:58:53.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1482f33740 10 client.0 _ll_register_callbacks cb 0x56528e2e2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (13763 inodes in the stack)", 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "a08bf2b3-c577-4804-9533-3881b07a580c", 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T21:58:53.429 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.431 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:58:53.432 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:58:53.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59260/0 (socket says 172.21.15.39:59260) 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 -- 172.21.15.39:0/2325111580 learned_addr learned my addr 172.21.15.39:0/2325111580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f147a59c640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3d8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f147ad9d640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 -- 172.21.15.39:0/2325111580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 msgr2=0x56528e3d8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3d8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 -- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 msgr2=0x56528e3d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f1473fff640 1 -- 172.21.15.39:0/2325111580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528e2f6c40 con 0x56528e3c89c0 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.374+0000 7f147a59c640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3d8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1473fff640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1464004600 tx=0x7f1464009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaeb76abe5d335d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464028020 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1464012aa0 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1464005260 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1464005460 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 10 client.16368 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56528e3e7390 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1464012aa0 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1464004750 con 0x56528e3c89c0 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 10 client.16368 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 20 client.16368 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e3e87a0 0x56528e3eab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 4 client.16368 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:53.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.375+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56528e340da0 con 0x56528e3e87a0 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.376+0000 7f147a59c640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e3e87a0 0x56528e3eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.376+0000 7f1461ffb640 10 client.16368 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.376+0000 7f147a59c640 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e3e87a0 0x56528e3eab90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dcb28e2f2a8579b server_cookie=e949b1ada53ce615 in_seq=0 out_seq=0 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1461ffb640 1 -- 172.21.15.39:0/2325111580 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56528e340da0 con 0x56528e3e87a0 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1461ffb640 10 client.16368 handle_command_reply: tid=0 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 client.16368 shutdown 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 msgr2=0x56528e3d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1464004600 tx=0x7f1464009f70 comp rx=0 tx=0).stop 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 shutdown_connections 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e3e87a0 0x56528e3eab90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3d5a90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1461ffb640 0 client.16368 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:53.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 --2- 172.21.15.39:0/2325111580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3d8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 >> 172.21.15.39:0/2325111580 conn(0x56528e3c5ed0 msgr2=0x56528e3cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 shutdown_connections 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 1 -- 172.21.15.39:0/2325111580 wait complete. 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.379+0000 7f1482f33740 20 client.16368 trim_cache size 0 max 16384 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 Processor -- start 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 -- start start 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ac0f0 con 0x56528e3c80a0 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1adcf0 con 0x56528e3d8d60 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1482f33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ac7c0 con 0x56528e3c89c0 2024-09-10T21:58:53.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59274/0 (socket says 172.21.15.39:59274) 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 -- 172.21.15.39:0/3335776926 learned_addr learned my addr 172.21.15.39:0/3335776926 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f1473fff640 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 -- 172.21.15.39:0/3335776926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 msgr2=0x56528e3c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 -- 172.21.15.39:0/3335776926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 msgr2=0x56528e3c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.398+0000 7f147a59c640 1 -- 172.21.15.39:0/3335776926 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528e3d6430 con 0x56528e3c80a0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.399+0000 7f147a59c640 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c6a0 tx=0x7f146c018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff45e5548fff8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.399+0000 7f1463fff640 1 -- 172.21.15.39:0/3335776926 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0ac240 con 0x56528e3c80a0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.399+0000 7f1463fff640 1 -- 172.21.15.39:0/3335776926 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f146c0ace30 con 0x56528e3c80a0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.399+0000 7f1463fff640 1 -- 172.21.15.39:0/3335776926 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0ab990 con 0x56528e3c80a0 2024-09-10T21:58:53.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- 172.21.15.39:0/3335776926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 msgr2=0x56528e3e4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c6a0 tx=0x7f146c018420 comp rx=0 tx=0).stop 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- 172.21.15.39:0/3335776926 shutdown_connections 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c89c0 0x56528e3c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 --2- 172.21.15.39:0/3335776926 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c80a0 0x56528e3e4ca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- 172.21.15.39:0/3335776926 >> 172.21.15.39:0/3335776926 conn(0x56528e3c5ed0 msgr2=0x56528e3d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- 172.21.15.39:0/3335776926 shutdown_connections 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- 172.21.15.39:0/3335776926 wait complete. 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 -- start start 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.400+0000 7f1482f33740 1 Processor -- start 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3de100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ad560 con 0x56528e3c89c0 2024-09-10T21:58:53.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ace90 con 0x56528e3d8d60 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1aa0f0 con 0x56528e3c80a0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1482f33740 10 client.0 _ll_register_callbacks cb 0x7f1464005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59282/0 (socket says 172.21.15.39:59282) 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 -- 172.21.15.39:0/626366471 learned_addr learned my addr 172.21.15.39:0/626366471 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f147ad9d640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f147a59c640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 -- 172.21.15.39:0/626366471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 msgr2=0x56528e3de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3de100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 -- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 msgr2=0x56528e3d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 -- 172.21.15.39:0/626366471 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528e3deef0 con 0x56528e3c89c0 2024-09-10T21:58:53.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1473fff640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1464004d10 tx=0x7f1464004fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146fb851139d1107 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.401+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146403c060 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1464004630 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f146c0ace30 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1464028070 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 10 client.16374 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56528e459c70 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f146c0ace30 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1464036030 con 0x56528e3c89c0 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 10 client.16374 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 20 client.16374 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e45a3c0 0x56528e45c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 4 client.16374 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56528e33c850 con 0x56528e45a3c0 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.402+0000 7f147a59c640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e45a3c0 0x56528e45c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.403+0000 7f147a59c640 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e45a3c0 0x56528e45c7e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597c3b3ff03c42e3 server_cookie=da16ec5e45981f03 in_seq=0 out_seq=0 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.403+0000 7f1461ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.404+0000 7f1461ffb640 1 -- 172.21.15.39:0/626366471 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2000 (crc 0 0 0) 0x56528e33c850 con 0x56528e45a3c0 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.404+0000 7f1461ffb640 10 client.16374 handle_command_reply: tid=0 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.404+0000 7f1482f33740 1 client.16374 shutdown 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 msgr2=0x56528e3de640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1464004d10 tx=0x7f1464004fc0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 shutdown_connections 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x56528e45a3c0 0x56528e45c7e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528e3d8d60 0x56528e3d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56528e3c89c0 0x56528e3de640 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 --2- 172.21.15.39:0/626366471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528e3c80a0 0x56528e3de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 >> 172.21.15.39:0/626366471 conn(0x56528e3c5ed0 msgr2=0x56528e3d70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1461ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 shutdown_connections 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 1 -- 172.21.15.39:0/626366471 wait complete. 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1482f33740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 msgr2=0x7f14680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 0x7f14680b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f147402f500 tx=0x7f1474005f50 comp rx=0 tx=0).stop 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 msgr2=0x7f147c1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e9f0 tx=0x7f146c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 shutdown_connections 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f14680b5360 0x7f14680b7820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c10d0e0 0x7f147c19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f147c104530 0x7f147c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 --2- 172.21.15.39:0/4208436082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c103b30 0x7f147c1991f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 >> 172.21.15.39:0/4208436082 conn(0x7f147c0fd700 msgr2=0x7f147c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.405+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 shutdown_connections 2024-09-10T21:58:53.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:58:53.406+0000 7f1480b5e640 1 -- 172.21.15.39:0/4208436082 wait complete. 2024-09-10T21:58:53.905 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:53 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:53.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:53.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:58:53.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:53 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:58:53.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:53.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:53 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:58:54.221 INFO:tasks.cephfs.filesystem:scrub status for tag:a08bf2b3-c577-4804-9533-3881b07a580c - {'path': '/', 'tag': 'a08bf2b3-c577-4804-9533-3881b07a580c', 'options': 'recursive,force'} 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 -- 172.21.15.39:0/1435207096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 msgr2=0x7f6e88109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 --2- 172.21.15.39:0/1435207096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e88109cf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009cd0 tx=0x7f6e8002a8e0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 -- 172.21.15.39:0/1435207096 shutdown_connections 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 --2- 172.21.15.39:0/1435207096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e88109cf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 --2- 172.21.15.39:0/1435207096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 0x7f6e88102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 --2- 172.21.15.39:0/1435207096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e88101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 -- 172.21.15.39:0/1435207096 >> 172.21.15.39:0/1435207096 conn(0x7f6e880fd140 msgr2=0x7f6e880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 -- 172.21.15.39:0/1435207096 shutdown_connections 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 -- 172.21.15.39:0/1435207096 wait complete. 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.688+0000 7f6e8d033640 1 Processor -- start 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 -- start start 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e8806b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 0x7f6e8819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8810d500 con 0x7f6e88103370 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8810d380 con 0x7f6e88101860 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8d033640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8810d680 con 0x7f6e881029b0 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e8806b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59304/0 (socket says 172.21.15.39:59304) 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 -- 172.21.15.39:0/932163948 learned_addr learned my addr 172.21.15.39:0/932163948 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8659c640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 0x7f6e8819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 -- 172.21.15.39:0/932163948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 msgr2=0x7f6e8819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 0x7f6e8819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 -- 172.21.15.39:0/932163948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 msgr2=0x7f6e8806b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e8806b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 -- 172.21.15.39:0/932163948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e881a08e0 con 0x7f6e88103370 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e8806b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.689+0000 7f6e8759e640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e8002ae00 tx=0x7f6e80003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.690+0000 7f6e6ffff640 1 -- 172.21.15.39:0/932163948 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80004040 con 0x7f6e88103370 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.690+0000 7f6e6ffff640 1 -- 172.21.15.39:0/932163948 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e80004690 con 0x7f6e88103370 2024-09-10T21:58:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.690+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e881a0b70 con 0x7f6e88103370 2024-09-10T21:58:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.690+0000 7f6e6ffff640 1 -- 172.21.15.39:0/932163948 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8003a420 con 0x7f6e88103370 2024-09-10T21:58:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.690+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e881a1110 con 0x7f6e88103370 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.692+0000 7f6e8fe03740 1 Processor -- start 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.692+0000 7f6e6ffff640 1 -- 172.21.15.39:0/932163948 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6e80030070 con 0x7f6e88103370 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 -- start start 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab8037ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80380090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ab802ea6f0 con 0x55ab8037b190 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ab802d9b20 con 0x55ab8037dbd0 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ab802dd930 con 0x55ab80378860 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59308/0 (socket says 172.21.15.39:59308) 2024-09-10T21:58:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 -- 172.21.15.39:0/3214167290 learned_addr learned my addr 172.21.15.39:0/3214167290 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80380090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab8037ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 -- 172.21.15.39:0/3214167290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 msgr2=0x55ab8037ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab8037ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 -- 172.21.15.39:0/3214167290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 msgr2=0x55ab80380090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80380090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 -- 172.21.15.39:0/3214167290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8029f530 con 0x55ab8037b190 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab8037ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:58:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e6ffff640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 0x7f6e700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.693+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e78011540 tx=0x7f6e78011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc7f95f046d6a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e8659c640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 0x7f6e700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e6ffff640 1 -- 172.21.15.39:0/932163948 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6e8002e030 con 0x7f6e88103370 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e6d7fa640 1 -- 172.21.15.39:0/3214167290 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800f640 con 0x55ab8037b190 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e6d7fa640 1 -- 172.21.15.39:0/3214167290 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e7800fc90 con 0x55ab8037b190 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e6d7fa640 1 -- 172.21.15.39:0/3214167290 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78019ca0 con 0x55ab8037b190 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3214167290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 msgr2=0x55ab8037d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e8659c640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 0x7f6e700b7820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005fd0 tx=0x7f6e7c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e78011540 tx=0x7f6e78011a00 comp rx=0 tx=0).stop 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.694+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3214167290 shutdown_connections 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80380090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab8037d580 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3214167290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab8037ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3214167290 >> 172.21.15.39:0/3214167290 conn(0x55ab803739b0 msgr2=0x55ab80374740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3214167290 shutdown_connections 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3214167290 wait complete. 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- start start 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 Processor -- start 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80381ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80383160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ab80211ab0 con 0x55ab8037b190 2024-09-10T21:58:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ab8027f730 con 0x55ab8037dbd0 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ab80380bb0 con 0x55ab80378860 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8fe03740 10 client.0 _ll_register_callbacks cb 0x55ab802d36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59316/0 (socket says 172.21.15.39:59316) 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8659c640 1 -- 172.21.15.39:0/3612819115 learned_addr learned my addr 172.21.15.39:0/3612819115 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8759e640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80383160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80381ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.695+0000 7f6e8659c640 1 -- 172.21.15.39:0/3612819115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 msgr2=0x55ab80381ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80381ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8659c640 1 -- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 msgr2=0x55ab80383160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80383160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8659c640 1 -- 172.21.15.39:0/3612819115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8003b790 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8659c640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c011c00 tx=0x7f6e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab27133e783a840 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c027400 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6e7c0275a0 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7800fc90 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c0277a0 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8fe03740 10 client.16386 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ab800b4620 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e7800fc90 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.696+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6e7c01f960 con 0x55ab8037b190 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 10 client.16386 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 10 client.16386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 20 client.16386 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab8038d8b0 0x55ab8038fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 4 client.16386 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab802ec640 con 0x55ab8038d8b0 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab8038d8b0 0x55ab8038fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab8038d8b0 0x55ab8038fd10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0085507c6071cc server_cookie=f42bdee287c02191 in_seq=0 out_seq=0 2024-09-10T21:58:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.697+0000 7f6e6aff5640 10 client.16386 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e6aff5640 1 -- 172.21.15.39:0/3612819115 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab802ec640 con 0x55ab8038d8b0 2024-09-10T21:58:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e6aff5640 10 client.16386 handle_command_reply: tid=0 2024-09-10T21:58:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 client.16386 shutdown 2024-09-10T21:58:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 msgr2=0x55ab80382590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c011c00 tx=0x7f6e7c0046c0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 shutdown_connections 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab8038d8b0 0x55ab8038fd10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037dbd0 0x55ab80383160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80382590 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/3612819115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80381ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 >> 172.21.15.39:0/3612819115 conn(0x55ab803739b0 msgr2=0x55ab80372bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e6aff5640 0 client.16386 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 shutdown_connections 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 1 -- 172.21.15.39:0/3612819115 wait complete. 2024-09-10T21:58:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.700+0000 7f6e8fe03740 20 client.16386 trim_cache size 0 max 16384 2024-09-10T21:58:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 Processor -- start 2024-09-10T21:58:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 -- start start 2024-09-10T21:58:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80377cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037b190 0x55ab80378230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 0x55ab80376a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881a9e40 con 0x55ab8037dbd0 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881aba40 con 0x55ab8037b190 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.715+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881aa510 con 0x55ab80378860 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 0x55ab80376a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80377cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80377cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:43980/0 (socket says 172.21.15.39:43980) 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e86d9d640 1 -- 172.21.15.39:0/661400234 learned_addr learned my addr 172.21.15.39:0/661400234 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8659c640 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037b190 0x55ab80378230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 -- 172.21.15.39:0/661400234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 msgr2=0x55ab80377cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80377cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 -- 172.21.15.39:0/661400234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037b190 msgr2=0x55ab80378230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037b190 0x55ab80378230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 -- 172.21.15.39:0/661400234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab803834d0 con 0x55ab8037dbd0 2024-09-10T21:58:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e8759e640 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 0x55ab80376a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e800049d0 tx=0x7f6e800093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1ea9321d73d7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e6cff9640 1 -- 172.21.15.39:0/661400234 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e800cc740 con 0x55ab8037dbd0 2024-09-10T21:58:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e6cff9640 1 -- 172.21.15.39:0/661400234 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e80036040 con 0x55ab8037dbd0 2024-09-10T21:58:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.716+0000 7f6e6cff9640 1 -- 172.21.15.39:0/661400234 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e800d1ab0 con 0x55ab8037dbd0 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- 172.21.15.39:0/661400234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 msgr2=0x55ab80376a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 0x55ab80376a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e800049d0 tx=0x7f6e800093d0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- 172.21.15.39:0/661400234 shutdown_connections 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037dbd0 0x55ab80376a00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab8037b190 0x55ab80378230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/661400234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab80378860 0x55ab80377cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- 172.21.15.39:0/661400234 >> 172.21.15.39:0/661400234 conn(0x55ab803739b0 msgr2=0x55ab80374650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- 172.21.15.39:0/661400234 shutdown_connections 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- 172.21.15.39:0/661400234 wait complete. 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 -- start start 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 Processor -- start 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab80378860 0x55ab80386ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.717+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab8037dbd0 0x55ab80387f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881ab2b0 con 0x55ab8037b190 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881aabe0 con 0x55ab80378860 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881a7e20 con 0x55ab8037dbd0 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 10 client.0 _ll_register_callbacks cb 0x7f6e7c00cdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e86d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab80378860 0x55ab80386ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59342/0 (socket says 172.21.15.39:59342) 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 -- 172.21.15.39:0/2433987515 learned_addr learned my addr 172.21.15.39:0/2433987515 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8759e640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab8037dbd0 0x55ab80387f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 -- 172.21.15.39:0/2433987515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab8037dbd0 msgr2=0x55ab80387f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab8037dbd0 0x55ab80387f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 -- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab80378860 msgr2=0x55ab80386ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab80378860 0x55ab80386ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 -- 172.21.15.39:0/2433987515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8037d8f0 con 0x55ab8037b190 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8659c640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01fd00 tx=0x7f6e7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa74c71727a66656 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c027940 con 0x55ab8037b190 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6e7c027ae0 con 0x55ab8037b190 2024-09-10T21:58:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e80036040 con 0x55ab8037b190 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c027ce0 con 0x55ab8037b190 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 10 client.16392 fetch_fsmap learned FSMap version 30 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.718+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ab803899a0 con 0x55ab8037b190 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e80036040 con 0x55ab8037b190 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6e7c0049d0 con 0x55ab8037b190 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 10 client.16392 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 20 client.16392 populate_metadata read hostname 'smithi039' 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab803fa930 0x55ab803fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 4 client.16392 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab802e80f0 con 0x55ab803fa930 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab803fa930 0x55ab803fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:58:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e86d9d640 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab803fa930 0x55ab803fcd50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08eb5ce304c4d8d server_cookie=34b1a48e228f77c in_seq=0 out_seq=0 2024-09-10T21:58:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:54.719+0000 7f6e6aff5640 10 client.16392 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:54.927 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:54 smithi039 ceph-mon[30872]: pgmap v458: 97 pgs: 97 active+clean; 336 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 898 op/s 2024-09-10T21:58:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:54 smithi173 ceph-mon[35294]: pgmap v458: 97 pgs: 97 active+clean; 336 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 898 op/s 2024-09-10T21:58:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:54 smithi070 ceph-mon[34909]: pgmap v458: 97 pgs: 97 active+clean; 336 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 898 op/s 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e6aff5640 1 -- 172.21.15.39:0/2433987515 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab802e80f0 con 0x55ab803fa930 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e6aff5640 10 client.16392 handle_command_reply: tid=0 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 client.16392 shutdown 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 msgr2=0x55ab80387340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01fd00 tx=0x7f6e7c00c890 comp rx=0 tx=0).stop 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 shutdown_connections 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ab803fa930 0x55ab803fcd50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ab8037dbd0 0x55ab80387f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab8037b190 0x55ab80387340 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e6aff5640 0 client.16392 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 --2- 172.21.15.39:0/2433987515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab80378860 0x55ab80386ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 >> 172.21.15.39:0/2433987515 conn(0x55ab803739b0 msgr2=0x55ab80377cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 shutdown_connections 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 1 -- 172.21.15.39:0/2433987515 wait complete. 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.673+0000 7f6e8fe03740 20 client.16392 trim_cache size 0 max 16384 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:58:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:58:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 msgr2=0x7f6e700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 0x7f6e700b7820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005fd0 tx=0x7f6e7c004730 comp rx=0 tx=0).stop 2024-09-10T21:58:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 msgr2=0x7f6e881a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e8002ae00 tx=0x7f6e80003ba0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 shutdown_connections 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6e700b5360 0x7f6e700b7820 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e88103370 0x7f6e881a0020 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e881029b0 0x7f6e8819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 --2- 172.21.15.39:0/932163948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e88101860 0x7f6e8806b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 >> 172.21.15.39:0/932163948 conn(0x7f6e880fd140 msgr2=0x7f6e88105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 shutdown_connections 2024-09-10T21:58:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:58:55.674+0000 7f6e8d033640 1 -- 172.21.15.39:0/932163948 wait complete. 2024-09-10T21:58:56.501 INFO:tasks.workunit.client.0.smithi039.stdout: 91 155529 135 107409 108 94579 324 2024-09-10T21:58:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:56 smithi039 ceph-mon[30872]: pgmap v459: 97 pgs: 97 active+clean; 341 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-09-10T21:58:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:56 smithi173 ceph-mon[35294]: pgmap v459: 97 pgs: 97 active+clean; 341 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-09-10T21:58:57.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:56 smithi070 ceph-mon[34909]: pgmap v459: 97 pgs: 97 active+clean; 341 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-09-10T21:58:58.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:58:58 smithi039 ceph-mon[30872]: pgmap v460: 97 pgs: 97 active+clean; 325 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 1.18k op/s 2024-09-10T21:58:58.957 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:58:58 smithi070 ceph-mon[34909]: pgmap v460: 97 pgs: 97 active+clean; 325 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 1.18k op/s 2024-09-10T21:58:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:58:58 smithi173 ceph-mon[35294]: pgmap v460: 97 pgs: 97 active+clean; 325 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.1 MiB/s wr, 1.18k op/s 2024-09-10T21:59:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:00 smithi039 ceph-mon[30872]: pgmap v461: 97 pgs: 97 active+clean; 314 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 1.59k op/s 2024-09-10T21:59:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:00 smithi173 ceph-mon[35294]: pgmap v461: 97 pgs: 97 active+clean; 314 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 1.59k op/s 2024-09-10T21:59:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:00 smithi070 ceph-mon[34909]: pgmap v461: 97 pgs: 97 active+clean; 314 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 1.59k op/s 2024-09-10T21:59:02.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:02 smithi039 ceph-mon[30872]: pgmap v462: 97 pgs: 97 active+clean; 306 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 1.49k op/s 2024-09-10T21:59:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:02 smithi173 ceph-mon[35294]: pgmap v462: 97 pgs: 97 active+clean; 306 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 1.49k op/s 2024-09-10T21:59:03.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:02 smithi070 ceph-mon[34909]: pgmap v462: 97 pgs: 97 active+clean; 306 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 1.49k op/s 2024-09-10T21:59:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:04 smithi039 ceph-mon[30872]: pgmap v463: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 1.86k op/s 2024-09-10T21:59:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:04 smithi173 ceph-mon[35294]: pgmap v463: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 1.86k op/s 2024-09-10T21:59:05.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:04 smithi070 ceph-mon[34909]: pgmap v463: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 1.86k op/s 2024-09-10T21:59:06.501 INFO:tasks.workunit.client.0.smithi039.stdout: 91 2125 1 1127 0 884 4 2024-09-10T21:59:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:06 smithi039 ceph-mon[30872]: pgmap v464: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.71k op/s 2024-09-10T21:59:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:06 smithi173 ceph-mon[35294]: pgmap v464: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.71k op/s 2024-09-10T21:59:07.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:06 smithi070 ceph-mon[34909]: pgmap v464: 97 pgs: 97 active+clean; 310 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.71k op/s 2024-09-10T21:59:07.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:07 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:07 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:08.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:07 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 -- 172.21.15.39:0/1468660948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb884108670 msgr2=0x7fb88410ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1468660948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb884108670 0x7fb88410ab30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009ca0 tx=0x7fb87c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 -- 172.21.15.39:0/1468660948 shutdown_connections 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1468660948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb884108670 0x7fb88410ab30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1468660948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1468660948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb88406b470 0x7fb884105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 -- 172.21.15.39:0/1468660948 >> 172.21.15.39:0/1468660948 conn(0x7fb8840fd140 msgr2=0x7fb8840ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 -- 172.21.15.39:0/1468660948 shutdown_connections 2024-09-10T21:59:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.784+0000 7fb889cc6640 1 -- 172.21.15.39:0/1468660948 wait complete. 2024-09-10T21:59:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.785+0000 7fb889cc6640 1 Processor -- start 2024-09-10T21:59:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.785+0000 7fb889cc6640 1 -- start start 2024-09-10T21:59:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 0x7fb884199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb88410e5a0 con 0x7fb88406b470 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb88410e420 con 0x7fb884108670 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb889cc6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb88410e720 con 0x7fb884105ac0 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40622/0 (socket says 172.21.15.39:40622) 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb8837fe640 1 -- 172.21.15.39:0/1019460113 learned_addr learned my addr 172.21.15.39:0/1019460113 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb883fff640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 0x7fb884199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 -- 172.21.15.39:0/1019460113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 msgr2=0x7fb884199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 0x7fb884199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 -- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 msgr2=0x7fb884198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb882ffd640 1 -- 172.21.15.39:0/1019460113 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88419a830 con 0x7fb884105ac0 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.786+0000 7fb883fff640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 0x7fb884199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb882ffd640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884199340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e9f0 tx=0x7fb87800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb880ff9640 1 -- 172.21.15.39:0/1019460113 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87800ccc0 con 0x7fb884105ac0 2024-09-10T21:59:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb880ff9640 1 -- 172.21.15.39:0/1019460113 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8780108e0 con 0x7fb884105ac0 2024-09-10T21:59:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb880ff9640 1 -- 172.21.15.39:0/1019460113 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878018880 con 0x7fb884105ac0 2024-09-10T21:59:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88419ab20 con 0x7fb884105ac0 2024-09-10T21:59:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.787+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8841a11f0 con 0x7fb884105ac0 2024-09-10T21:59:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 Processor -- start 2024-09-10T21:59:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb880ff9640 1 -- 172.21.15.39:0/1019460113 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb878010430 con 0x7fb884105ac0 2024-09-10T21:59:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 -- start start 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 0x5645206a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56452060e6f0 con 0x5645206a0c70 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5645205fdb20 con 0x5645206a35a0 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb88ca97740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564520601930 con 0x5645206a5fe0 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40634/0 (socket says 172.21.15.39:40634) 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb883fff640 1 -- 172.21.15.39:0/3740334670 learned_addr learned my addr 172.21.15.39:0/3740334670 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb882ffd640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 0x5645206a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.790+0000 7fb8837fe640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 -- 172.21.15.39:0/3740334670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 msgr2=0x5645206a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 0x5645206a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 -- 172.21.15.39:0/3740334670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 msgr2=0x5645206a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 -- 172.21.15.39:0/3740334670 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645205c3530 con 0x5645206a0c70 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb8837fe640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb882ffd640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 0x5645206a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb883fff640 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb87c02ade0 tx=0x7fb87c0093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b0078360bdd5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb880ff9640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 0x7fb86c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb869ffb640 1 -- 172.21.15.39:0/3740334670 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c031650 con 0x5645206a0c70 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb869ffb640 1 -- 172.21.15.39:0/3740334670 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c036040 con 0x5645206a0c70 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 0x7fb86c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb869ffb640 1 -- 172.21.15.39:0/3740334670 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c004650 con 0x5645206a0c70 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.791+0000 7fb880ff9640 1 -- 172.21.15.39:0/1019460113 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb8780e5e70 con 0x7fb884105ac0 2024-09-10T21:59:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- 172.21.15.39:0/3740334670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 msgr2=0x5645206a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 0x7fb86c0b7820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8740126c0 tx=0x7fb874005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb87c02ade0 tx=0x7fb87c0093a0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- 172.21.15.39:0/3740334670 shutdown_connections 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a5fe0 0x5645206a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 --2- 172.21.15.39:0/3740334670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206a3060 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- 172.21.15.39:0/3740334670 >> 172.21.15.39:0/3740334670 conn(0x56452069bdc0 msgr2=0x56452069cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- 172.21.15.39:0/3740334670 shutdown_connections 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- 172.21.15.39:0/3740334670 wait complete. 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.792+0000 7fb88ca97740 1 -- start start 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 Processor -- start 2024-09-10T21:59:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x5645206aa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564520535ab0 con 0x5645206a5fe0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5645205a3730 con 0x5645206a0c70 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5645206a8de0 con 0x5645206a35a0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb88ca97740 10 client.0 _ll_register_callbacks cb 0x5645205f76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:36296/0 (socket says 172.21.15.39:36296) 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40640/0 (socket says 172.21.15.39:40640) 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb8837fe640 1 -- 172.21.15.39:0/1952001120 learned_addr learned my addr 172.21.15.39:0/1952001120 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.793+0000 7fb882ffd640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x5645206aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 -- 172.21.15.39:0/1952001120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 msgr2=0x5645206aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x5645206aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 -- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 msgr2=0x5645206aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 -- 172.21.15.39:0/1952001120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452035f790 con 0x5645206a5fe0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb883fff640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009430 tx=0x7fb87c004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4c6e3fe8856fea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c052070 con 0x5645206a5fe0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb87c003b80 con 0x5645206a5fe0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb87c036040 con 0x5645206a5fe0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb87c003dc0 con 0x5645206a5fe0 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb88ca97740 10 client.16404 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.794+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5645203d8620 con 0x5645206a5fe0 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c036040 con 0x5645206a5fe0 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb87c055020 con 0x5645206a5fe0 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 10 client.16404 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 20 client.16404 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645206b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 4 client.16404 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564520610640 con 0x5645206b56f0 2024-09-10T21:59:08.803 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.795+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645206b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.796+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645206b7ae0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5ca20dc9b41b09c server_cookie=ecfe6162ad615334 in_seq=0 out_seq=0 2024-09-10T21:59:08.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.796+0000 7fb862ffd640 10 client.16404 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:08.804 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.797+0000 7fb862ffd640 1 -- 172.21.15.39:0/1952001120 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564520610640 con 0x5645206b56f0 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.797+0000 7fb862ffd640 10 client.16404 handle_command_reply: tid=0 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.797+0000 7fb88ca97740 1 client.16404 shutdown 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 msgr2=0x5645206ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009430 tx=0x7fb87c004700 comp rx=0 tx=0).stop 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 shutdown_connections 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645206b7ae0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb862ffd640 0 client.16404 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645206ab340 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x5645206aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1952001120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 >> 172.21.15.39:0/1952001120 conn(0x56452069bdc0 msgr2=0x5645206a3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 shutdown_connections 2024-09-10T21:59:08.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 1 -- 172.21.15.39:0/1952001120 wait complete. 2024-09-10T21:59:08.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.798+0000 7fb88ca97740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 Processor -- start 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 -- start start 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x56452069c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a5fe0 0x5645206a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a7c80 con 0x5645206a0c70 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a9880 con 0x5645206a5fe0 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb88ca97740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a8350 con 0x5645206a35a0 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb883fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a5fe0 0x5645206a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40648/0 (socket says 172.21.15.39:40648) 2024-09-10T21:59:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 -- 172.21.15.39:0/1340440416 learned_addr learned my addr 172.21.15.39:0/1340440416 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb882ffd640 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x56452069c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 -- 172.21.15.39:0/1340440416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 msgr2=0x56452069c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x56452069c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 -- 172.21.15.39:0/1340440416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a5fe0 msgr2=0x5645206a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a5fe0 0x5645206a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.818+0000 7fb8837fe640 1 -- 172.21.15.39:0/1340440416 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645206a9ea0 con 0x5645206a0c70 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.819+0000 7fb8837fe640 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb874005e00 tx=0x7fb87401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8185e86cf6af3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.819+0000 7fb8697fa640 1 -- 172.21.15.39:0/1340440416 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87401f600 con 0x5645206a0c70 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.819+0000 7fb8697fa640 1 -- 172.21.15.39:0/1340440416 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87401fc50 con 0x5645206a0c70 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.819+0000 7fb8697fa640 1 -- 172.21.15.39:0/1340440416 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87402bd20 con 0x5645206a0c70 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- 172.21.15.39:0/1340440416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 msgr2=0x5645206aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb874005e00 tx=0x7fb87401a000 comp rx=0 tx=0).stop 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- 172.21.15.39:0/1340440416 shutdown_connections 2024-09-10T21:59:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a5fe0 0x5645206a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a35a0 0x56452069c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 --2- 172.21.15.39:0/1340440416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a0c70 0x5645206aa0d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- 172.21.15.39:0/1340440416 >> 172.21.15.39:0/1340440416 conn(0x56452069bdc0 msgr2=0x5645206a9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- 172.21.15.39:0/1340440416 shutdown_connections 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- 172.21.15.39:0/1340440416 wait complete. 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.820+0000 7fb88ca97740 1 -- start start 2024-09-10T21:59:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 Processor -- start 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a0c70 0x5645206a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a90f0 con 0x5645206a5fe0 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a8a20 con 0x5645206a35a0 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841a5c60 con 0x5645206a0c70 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb88ca97740 10 client.0 _ll_register_callbacks cb 0x7fb87c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40658/0 (socket says 172.21.15.39:40658) 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:36308/0 (socket says 172.21.15.39:36308) 2024-09-10T21:59:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 -- 172.21.15.39:0/4040044755 learned_addr learned my addr 172.21.15.39:0/4040044755 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb8837fe640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a0c70 0x5645206a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 -- 172.21.15.39:0/4040044755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a0c70 msgr2=0x5645206a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a0c70 0x5645206a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 -- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 msgr2=0x5645206a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb883fff640 1 -- 172.21.15.39:0/4040044755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564520720bd0 con 0x5645206a5fe0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.821+0000 7fb882ffd640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb883fff640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009620 tx=0x7fb87c02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0edfbf8ccfc43d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c040020 con 0x5645206a5fe0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb87c031760 con 0x5645206a5fe0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb87401fc50 con 0x5645206a5fe0 2024-09-10T21:59:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb87c067050 con 0x5645206a5fe0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb88ca97740 10 client.16410 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564520721f10 con 0x5645206a5fe0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.822+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87401fc50 con 0x5645206a5fe0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb87c055040 con 0x5645206a5fe0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 10 client.16410 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 20 client.16410 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645207249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 4 client.16410 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56452060c0f0 con 0x5645206b56f0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb8837fe640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645207249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb862ffd640 10 client.16410 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:08.823+0000 7fb8837fe640 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645207249e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728a76e776e09327 server_cookie=217d4ded4d197328 in_seq=0 out_seq=0 2024-09-10T21:59:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:08 smithi173 ceph-mon[35294]: pgmap v465: 97 pgs: 97 active+clean; 316 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-10T21:59:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:08 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:59:09.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:08 smithi070 ceph-mon[34909]: pgmap v465: 97 pgs: 97 active+clean; 316 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-10T21:59:09.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:08 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:59:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:08 smithi039 ceph-mon[30872]: pgmap v465: 97 pgs: 97 active+clean; 316 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.4 MiB/s wr, 1.86k op/s 2024-09-10T21:59:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:08 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:59:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.266+0000 7fb862ffd640 1 -- 172.21.15.39:0/4040044755 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56452060c0f0 con 0x5645206b56f0 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.266+0000 7fb862ffd640 10 client.16410 handle_command_reply: tid=0 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.266+0000 7fb88ca97740 1 client.16410 shutdown 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 msgr2=0x5645207205c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009620 tx=0x7fb87c02f310 comp rx=0 tx=0).stop 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 shutdown_connections 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5645206b56f0 0x5645207249e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb862ffd640 0 client.16410 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5645206a5fe0 0x5645207205c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645206a35a0 0x5645206a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 --2- 172.21.15.39:0/4040044755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645206a0c70 0x5645206a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 >> 172.21.15.39:0/4040044755 conn(0x56452069bdc0 msgr2=0x5645206963d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 shutdown_connections 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 1 -- 172.21.15.39:0/4040044755 wait complete. 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.267+0000 7fb88ca97740 20 client.16410 trim_cache size 0 max 16384 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:59:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 msgr2=0x7fb86c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 0x7fb86c0b7820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8740126c0 tx=0x7fb874005f90 comp rx=0 tx=0).stop 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 msgr2=0x7fb884199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884199340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e9f0 tx=0x7fb87800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 shutdown_connections 2024-09-10T21:59:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb86c0b5360 0x7fb86c0b7820 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb884108670 0x7fb884199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb884105ac0 0x7fb884199340 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 --2- 172.21.15.39:0/1019460113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb88406b470 0x7fb884198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 >> 172.21.15.39:0/1019460113 conn(0x7fb8840fd140 msgr2=0x7fb884103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.268+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 shutdown_connections 2024-09-10T21:59:09.274 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:09.269+0000 7fb889cc6640 1 -- 172.21.15.39:0/1019460113 wait complete. 2024-09-10T21:59:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:59:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:59:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:59:10.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:59:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:59:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:59:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:59:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:59:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T21:59:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:10 smithi173 ceph-mon[35294]: pgmap v466: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.3 MiB/s wr, 1.48k op/s 2024-09-10T21:59:11.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:10 smithi070 ceph-mon[34909]: pgmap v466: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.3 MiB/s wr, 1.48k op/s 2024-09-10T21:59:11.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:10 smithi039 ceph-mon[30872]: pgmap v466: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.3 MiB/s wr, 1.48k op/s 2024-09-10T21:59:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:12 smithi173 ceph-mon[35294]: pgmap v467: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1014 KiB/s wr, 941 op/s 2024-09-10T21:59:13.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:12 smithi070 ceph-mon[34909]: pgmap v467: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1014 KiB/s wr, 941 op/s 2024-09-10T21:59:13.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:12 smithi039 ceph-mon[30872]: pgmap v467: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1014 KiB/s wr, 941 op/s 2024-09-10T21:59:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:14 smithi173 ceph-mon[35294]: pgmap v468: 97 pgs: 97 active+clean; 309 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-09-10T21:59:15.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:14 smithi070 ceph-mon[34909]: pgmap v468: 97 pgs: 97 active+clean; 309 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-09-10T21:59:15.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:14 smithi039 ceph-mon[30872]: pgmap v468: 97 pgs: 97 active+clean; 309 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-09-10T21:59:16.501 INFO:tasks.workunit.client.0.smithi039.stdout: 91 6920 80 3352 78 2469 233 2024-09-10T21:59:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:16 smithi173 ceph-mon[35294]: pgmap v469: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 732 op/s 2024-09-10T21:59:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:59:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:59:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:59:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:16 smithi070 ceph-mon[34909]: pgmap v469: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 732 op/s 2024-09-10T21:59:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:59:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:59:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:59:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:16 smithi039 ceph-mon[30872]: pgmap v469: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 732 op/s 2024-09-10T21:59:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:59:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:59:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:59:17.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:17 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:59:17.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:17 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T21:59:18.074 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:17 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:59:18.074 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:17 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T21:59:18.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:17 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:59:18.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:17 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T21:59:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:18 smithi173 ceph-mon[35294]: pgmap v470: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-10T21:59:19.091 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:18 smithi039 ceph-mon[30872]: pgmap v470: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-10T21:59:19.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:18 smithi070 ceph-mon[34909]: pgmap v470: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-10T21:59:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:20 smithi173 ceph-mon[35294]: pgmap v471: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-10T21:59:21.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:20 smithi070 ceph-mon[34909]: pgmap v471: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-10T21:59:21.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:20 smithi039 ceph-mon[30872]: pgmap v471: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-10T21:59:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- 172.21.15.39:0/2060074512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e4103370 msgr2=0x7f73e4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- 172.21.15.39:0/2060074512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e4103370 0x7f73e4109cf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009cd0 tx=0x7f73dc02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- 172.21.15.39:0/2060074512 shutdown_connections 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- 172.21.15.39:0/2060074512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e4103370 0x7f73e4109cf0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- 172.21.15.39:0/2060074512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e41029b0 0x7f73e4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- 172.21.15.39:0/2060074512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- 172.21.15.39:0/2060074512 >> 172.21.15.39:0/2060074512 conn(0x7f73e40fd140 msgr2=0x7f73e40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- 172.21.15.39:0/2060074512 shutdown_connections 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- 172.21.15.39:0/2060074512 wait complete. 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 Processor -- start 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- start start 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 0x7f73e419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e4103370 0x7f73e419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73e410d4b0 con 0x7f73e41029b0 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73e410d330 con 0x7f73e4101860 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.365+0000 7f73eac2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73e410d630 con 0x7f73e4103370 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73e89c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 0x7f73e419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73e89c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51286/0 (socket says 172.21.15.39:51286) 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73e89c6640 1 -- 172.21.15.39:0/158650303 learned_addr learned my addr 172.21.15.39:0/158650303 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 -- 172.21.15.39:0/158650303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e4103370 msgr2=0x7f73e419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73e91c7640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e4103370 0x7f73e419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e4103370 0x7f73e419c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 -- 172.21.15.39:0/158650303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 msgr2=0x7f73e419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 -- 172.21.15.39:0/158650303 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e419ca60 con 0x7f73e41029b0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73e89c6640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73dbfff640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 0x7f73e419b570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73d400d6d0 tx=0x7f73d400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73d9ffb640 1 -- 172.21.15.39:0/158650303 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4017070 con 0x7f73e41029b0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73d9ffb640 1 -- 172.21.15.39:0/158650303 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73d4009820 con 0x7f73e41029b0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73d9ffb640 1 -- 172.21.15.39:0/158650303 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4004c40 con 0x7f73e41029b0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.366+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e419cd50 con 0x7f73e41029b0 2024-09-10T21:59:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.367+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e41a3420 con 0x7f73e41029b0 2024-09-10T21:59:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 Processor -- start 2024-09-10T21:59:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73d9ffb640 1 -- 172.21.15.39:0/158650303 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f73d4005220 con 0x7f73e41029b0 2024-09-10T21:59:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 -- start start 2024-09-10T21:59:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1fbd0 0x55864bb22090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55864ba8c6f0 con 0x55864bb1a860 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55864ba7bb20 con 0x55864bb1d190 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55864ba7f930 con 0x55864bb1fbd0 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e89c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35282/0 (socket says 172.21.15.39:35282) 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e89c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51288/0 (socket says 172.21.15.39:51288) 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 -- 172.21.15.39:0/2846312443 learned_addr learned my addr 172.21.15.39:0/2846312443 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73dbfff640 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1fbd0 0x55864bb22090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 -- 172.21.15.39:0/2846312443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1fbd0 msgr2=0x55864bb22090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1fbd0 0x55864bb22090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 -- 172.21.15.39:0/2846312443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 msgr2=0x55864bb1f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e91c7640 1 -- 172.21.15.39:0/2846312443 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55864ba41530 con 0x55864bb1a860 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.370+0000 7f73e89c6640 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73d9ffb640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 0x7f73cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73e91c7640 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f73dc004ae0 tx=0x7f73dc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884551115c87793c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73e89c6640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 0x7f73cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73d9ffb640 1 -- 172.21.15.39:0/158650303 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f73d40e56c0 con 0x7f73e41029b0 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73caffd640 1 -- 172.21.15.39:0/2846312443 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc031570 con 0x55864bb1a860 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73caffd640 1 -- 172.21.15.39:0/2846312443 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73dc036040 con 0x55864bb1a860 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.371+0000 7f73caffd640 1 -- 172.21.15.39:0/2846312443 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc004560 con 0x55864bb1a860 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- 172.21.15.39:0/2846312443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 msgr2=0x55864bb1cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73e89c6640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 0x7f73cc0b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009620 tx=0x7f73e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f73dc004ae0 tx=0x7f73dc009a20 comp rx=0 tx=0).stop 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- 172.21.15.39:0/2846312443 shutdown_connections 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1fbd0 0x55864bb22090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb1f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/2846312443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1a860 0x55864bb1cc50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- 172.21.15.39:0/2846312443 >> 172.21.15.39:0/2846312443 conn(0x55864bb159b0 msgr2=0x55864bb16740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- 172.21.15.39:0/2846312443 shutdown_connections 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- 172.21.15.39:0/2846312443 wait complete. 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 -- start start 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.372+0000 7f73ed9fb740 1 Processor -- start 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb23ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55864b9b3ab0 con 0x55864bb1fbd0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55864ba21730 con 0x55864bb1d190 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55864bb22b50 con 0x55864bb1a860 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 10 client.0 _ll_register_callbacks cb 0x55864ba756b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35284/0 (socket says 172.21.15.39:35284) 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 -- 172.21.15.39:0/3869297770 learned_addr learned my addr 172.21.15.39:0/3869297770 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73dbfff640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb24560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e89c6640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb23ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 -- 172.21.15.39:0/3869297770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 msgr2=0x55864bb23ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb23ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 -- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 msgr2=0x55864bb24560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb24560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 -- 172.21.15.39:0/3869297770 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55864b7dd790 con 0x55864bb1fbd0 2024-09-10T21:59:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73e91c7640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006010 tx=0x7f73dc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7913f6863798a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc031570 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73dc036040 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.373+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f73dc004d40 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73dc0042a0 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 10 client.16422 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55864b856620 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73dc036040 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f73dc04f030 con 0x55864bb1fbd0 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 10 client.16422 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 10 client.16422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 20 client.16422 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb2f3d0 0x55864bb317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 4 client.16422 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55864ba8e640 con 0x55864bb2f3d0 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.374+0000 7f73e89c6640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb2f3d0 0x55864bb317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.375+0000 7f73e89c6640 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb2f3d0 0x55864bb317c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d55fa1959d6adcc server_cookie=c8bc4836df64634b in_seq=0 out_seq=0 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.375+0000 7f73c3fff640 10 client.16422 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73c3fff640 1 -- 172.21.15.39:0/3869297770 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55864ba8e640 con 0x55864bb2f3d0 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73c3fff640 10 client.16422 handle_command_reply: tid=0 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 client.16422 shutdown 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 msgr2=0x55864bb25130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006010 tx=0x7f73dc003c20 comp rx=0 tx=0).stop 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 shutdown_connections 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb2f3d0 0x55864bb317c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb25130 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73c3fff640 0 client.16422 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1d190 0x55864bb24560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/3869297770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb23ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 >> 172.21.15.39:0/3869297770 conn(0x55864bb159b0 msgr2=0x55864bb14bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 shutdown_connections 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 1 -- 172.21.15.39:0/3869297770 wait complete. 2024-09-10T21:59:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.378+0000 7f73ed9fb740 20 client.16422 trim_cache size 0 max 16384 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 Processor -- start 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 -- start start 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 0x55864bb23100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1d190 0x55864bb23640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41abfe0 con 0x55864bb1fbd0 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41adbe0 con 0x55864bb1a860 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41ac6b0 con 0x55864bb1d190 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35290/0 (socket says 172.21.15.39:35290) 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 -- 172.21.15.39:0/1839326513 learned_addr learned my addr 172.21.15.39:0/1839326513 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 0x55864bb23100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 -- 172.21.15.39:0/1839326513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1d190 msgr2=0x55864bb23640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1d190 0x55864bb23640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 -- 172.21.15.39:0/1839326513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 msgr2=0x55864bb23100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 0x55864bb23100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e91c7640 1 -- 172.21.15.39:0/1839326513 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55864bb248d0 con 0x55864bb1fbd0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.393+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 0x55864bb23100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73e91c7640 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f73dc02a920 tx=0x7f73dc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ea2cb40091b132 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ca7fc640 1 -- 172.21.15.39:0/1839326513 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc031570 con 0x55864bb1fbd0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ca7fc640 1 -- 172.21.15.39:0/1839326513 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73dc036040 con 0x55864bb1fbd0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ca7fc640 1 -- 172.21.15.39:0/1839326513 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc004440 con 0x55864bb1fbd0 2024-09-10T21:59:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1839326513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 msgr2=0x55864bb177e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f73dc02a920 tx=0x7f73dc009a20 comp rx=0 tx=0).stop 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1839326513 shutdown_connections 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1fbd0 0x55864bb177e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1d190 0x55864bb23640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1839326513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1a860 0x55864bb23100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1839326513 >> 172.21.15.39:0/1839326513 conn(0x55864bb159b0 msgr2=0x55864bb19d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1839326513 shutdown_connections 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.394+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1839326513 wait complete. 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 -- start start 2024-09-10T21:59:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 Processor -- start 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb2aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1fbd0 0x55864bb2b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41ad450 con 0x55864bb1d190 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41acd80 con 0x55864bb1fbd0 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73e41a9fc0 con 0x55864bb1a860 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73ed9fb740 10 client.0 _ll_register_callbacks cb 0x7f73dc03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35294/0 (socket says 172.21.15.39:35294) 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73dbfff640 1 -- 172.21.15.39:0/1789637570 learned_addr learned my addr 172.21.15.39:0/1789637570 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73e91c7640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1fbd0 0x55864bb2b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.395+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb2aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 -- 172.21.15.39:0/1789637570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 msgr2=0x55864bb2aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb2aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 -- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1fbd0 msgr2=0x55864bb2b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1fbd0 0x55864bb2b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 -- 172.21.15.39:0/1789637570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55864bb29810 con 0x55864bb1d190 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb2aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73dbfff640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f73d40abb90 tx=0x7f73d4009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d099c6aafd4127f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4020040 con 0x55864bb1d190 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f73d40a8100 con 0x55864bb1d190 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73dc036040 con 0x55864bb1d190 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73d40ac590 con 0x55864bb1d190 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73ed9fb740 10 client.16428 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55864bb9c7b0 con 0x55864bb1d190 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73dc036040 con 0x55864bb1d190 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.396+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f73d40930b0 con 0x55864bb1d190 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 10 client.16428 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 10 client.16428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 20 client.16428 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb9d250 0x55864bb9f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 4 client.16428 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55864ba8a0f0 con 0x55864bb9d250 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb9d250 0x55864bb9f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73c3fff640 10 client.16428 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:22.397+0000 7f73e89c6640 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb9d250 0x55864bb9f670 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6037039bf6e9499 server_cookie=a2b2cd4586bc9aab in_seq=0 out_seq=0 2024-09-10T21:59:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:22 smithi173 ceph-mon[35294]: pgmap v472: 97 pgs: 97 active+clean; 315 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-09-10T21:59:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:22 smithi070 ceph-mon[34909]: pgmap v472: 97 pgs: 97 active+clean; 315 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-09-10T21:59:23.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:22 smithi039 ceph-mon[30872]: pgmap v472: 97 pgs: 97 active+clean; 315 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-09-10T21:59:24.222 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:59:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.322+0000 7f73c3fff640 1 -- 172.21.15.39:0/1789637570 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55864ba8a0f0 con 0x55864bb9d250 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.322+0000 7f73c3fff640 10 client.16428 handle_command_reply: tid=0 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.322+0000 7f73ed9fb740 1 client.16428 shutdown 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.322+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 msgr2=0x55864bb2b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.322+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f73d40abb90 tx=0x7f73d4009f00 comp rx=0 tx=0).stop 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 shutdown_connections 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55864bb9d250 0x55864bb9f670 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55864bb1fbd0 0x55864bb2b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55864bb1d190 0x55864bb2b030 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 --2- 172.21.15.39:0/1789637570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55864bb1a860 0x55864bb2aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 >> 172.21.15.39:0/1789637570 conn(0x55864bb159b0 msgr2=0x55864bb19920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73c3fff640 0 client.16428 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 shutdown_connections 2024-09-10T21:59:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 1 -- 172.21.15.39:0/1789637570 wait complete. 2024-09-10T21:59:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.323+0000 7f73ed9fb740 20 client.16428 trim_cache size 0 max 16384 2024-09-10T21:59:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:59:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:59:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:59:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 msgr2=0x7f73cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 0x7f73cc0b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009620 tx=0x7f73e0005f90 comp rx=0 tx=0).stop 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 msgr2=0x7f73e419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 0x7f73e419b570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73d400d6d0 tx=0x7f73d400db90 comp rx=0 tx=0).stop 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 shutdown_connections 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f73cc0b52e0 0x7f73cc0b77a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73e4103370 0x7f73e419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e41029b0 0x7f73e419b570 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 --2- 172.21.15.39:0/158650303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e4101860 0x7f73e419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.324+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 >> 172.21.15.39:0/158650303 conn(0x7f73e40fd140 msgr2=0x7f73e406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.325+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 shutdown_connections 2024-09-10T21:59:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:24.325+0000 7f73eac2a640 1 -- 172.21.15.39:0/158650303 wait complete. 2024-09-10T21:59:24.504 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:24.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:24 smithi039 ceph-mon[30872]: pgmap v473: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 318 op/s 2024-09-10T21:59:24.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:24 smithi173 ceph-mon[35294]: pgmap v473: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 318 op/s 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.951+0000 7fc887171640 1 -- 172.21.15.39:0/1205834427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880104520 msgr2=0x7fc88010cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.951+0000 7fc887171640 1 --2- 172.21.15.39:0/1205834427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880104520 0x7fc88010cb00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009900 tx=0x7fc86c02a410 comp rx=0 tx=0).stop 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 -- 172.21.15.39:0/1205834427 shutdown_connections 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 --2- 172.21.15.39:0/1205834427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc88010d0d0 0x7fc88010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 --2- 172.21.15.39:0/1205834427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880104520 0x7fc88010cb00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 --2- 172.21.15.39:0/1205834427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc880103b20 0x7fc880103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 -- 172.21.15.39:0/1205834427 >> 172.21.15.39:0/1205834427 conn(0x7fc8800fd6d0 msgr2=0x7fc8800ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 -- 172.21.15.39:0/1205834427 shutdown_connections 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 -- 172.21.15.39:0/1205834427 wait complete. 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.952+0000 7fc887171640 1 Processor -- start 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 -- start start 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880104520 0x7fc880199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88010d0d0 0x7fc88019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc880112d50 con 0x7fc880103b20 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc880112bd0 con 0x7fc880104520 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc887171640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc880112ed0 con 0x7fc88010d0d0 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35306/0 (socket says 172.21.15.39:35306) 2024-09-10T21:59:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 -- 172.21.15.39:0/2515014854 learned_addr learned my addr 172.21.15.39:0/2515014854 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc87ffff640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880104520 0x7fc880199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc88570e640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88010d0d0 0x7fc88019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 -- 172.21.15.39:0/2515014854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88010d0d0 msgr2=0x7fc88019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88010d0d0 0x7fc88019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 -- 172.21.15.39:0/2515014854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880104520 msgr2=0x7fc880199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880104520 0x7fc880199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.953+0000 7fc884f0d640 1 -- 172.21.15.39:0/2515014854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88019f2f0 con 0x7fc880103b20 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.954+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc87400d950 tx=0x7fc87400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.954+0000 7fc87dffb640 1 -- 172.21.15.39:0/2515014854 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874017030 con 0x7fc880103b20 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.954+0000 7fc87dffb640 1 -- 172.21.15.39:0/2515014854 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc874004020 con 0x7fc880103b20 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.954+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88019f5e0 con 0x7fc880103b20 2024-09-10T21:59:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.954+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8801a5ca0 con 0x7fc880103b20 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.956+0000 7fc87dffb640 1 -- 172.21.15.39:0/2515014854 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740047a0 con 0x7fc880103b20 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.957+0000 7fc87dffb640 1 -- 172.21.15.39:0/2515014854 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc874004a00 con 0x7fc880103b20 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.957+0000 7fc889546740 1 Processor -- start 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.957+0000 7fc889546740 1 -- start start 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb8b140 0x55ecdeb8d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ecdeaf0e50 con 0x55ecdeb7ada0 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ecdeae0280 con 0x55ecdeb7a480 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc889546740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecdeae4090 con 0x55ecdeb8b140 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51342/0 (socket says 172.21.15.39:51342) 2024-09-10T21:59:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 -- 172.21.15.39:0/2588926374 learned_addr learned my addr 172.21.15.39:0/2588926374 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc87ffff640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb8b140 0x55ecdeb8d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 -- 172.21.15.39:0/2588926374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb8b140 msgr2=0x55ecdeb8d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb8b140 0x55ecdeb8d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 -- 172.21.15.39:0/2588926374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 msgr2=0x55ecdeb8ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb8ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc88570e640 1 -- 172.21.15.39:0/2588926374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecde83e650 con 0x55ecdeb7a480 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.958+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb8ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc88570e640 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc878009e30 tx=0x7fc87800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0ecc0d38b8090 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc87dffb640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 0x7fc8700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc86affd640 1 -- 172.21.15.39:0/2588926374 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878011640 con 0x55ecdeb7a480 2024-09-10T21:59:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc86affd640 1 -- 172.21.15.39:0/2588926374 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc878011c90 con 0x55ecdeb7a480 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 0x7fc8700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc86affd640 1 -- 172.21.15.39:0/2588926374 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87801bc20 con 0x55ecdeb7a480 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.959+0000 7fc87dffb640 1 -- 172.21.15.39:0/2515014854 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8740e6500 con 0x7fc880103b20 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- 172.21.15.39:0/2588926374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 msgr2=0x55ecdeb7a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc884f0d640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 0x7fc8700b7820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ecdeb79f60 tx=0x7fc874010000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc878009e30 tx=0x7fc87800f730 comp rx=0 tx=0).stop 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- 172.21.15.39:0/2588926374 shutdown_connections 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb8b140 0x55ecdeb8d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb8ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 --2- 172.21.15.39:0/2588926374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb7a860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- 172.21.15.39:0/2588926374 >> 172.21.15.39:0/2588926374 conn(0x55ecdeb782b0 msgr2=0x55ecdeb79450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- 172.21.15.39:0/2588926374 shutdown_connections 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- 172.21.15.39:0/2588926374 wait complete. 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 -- start start 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.960+0000 7fc889546740 1 Processor -- start 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7a480 0x55ecdeb8a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ecde941700 con 0x55ecdeb7ada0 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ecdea7b110 con 0x55ecdeb8b140 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecdeb8de40 con 0x55ecdeb7a480 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc889546740 10 client.0 _ll_register_callbacks cb 0x55ecdea94990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35332/0 (socket says 172.21.15.39:35332) 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc87ffff640 1 -- 172.21.15.39:0/3599723414 learned_addr learned my addr 172.21.15.39:0/3599723414 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51352/0 (socket says 172.21.15.39:51352) 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7a480 0x55ecdeb8a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 -- 172.21.15.39:0/3599723414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7a480 msgr2=0x55ecdeb8a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7a480 0x55ecdeb8a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 -- 172.21.15.39:0/3599723414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 msgr2=0x55ecdeb87e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 -- 172.21.15.39:0/3599723414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdeaa8c40 con 0x55ecdeb8b140 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc87ffff640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc88570e640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8780094d0 tx=0x7fc87801b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4688061a022734 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.961+0000 7fc85ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87801de60 con 0x55ecdeb8b140 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc87801bbb0 con 0x55ecdeb8b140 2024-09-10T21:59:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc878011c90 con 0x55ecdeb8b140 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc878004a40 con 0x55ecdeb8b140 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 10 client.26057 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ecdeb99790 con 0x55ecdeb8b140 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc878011c90 con 0x55ecdeb8b140 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc87802a7f0 con 0x55ecdeb8b140 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 10 client.26057 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 10 client.26057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 20 client.26057 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdeb9ab30 0x55ecdeb9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 4 client.26057 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.962+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecdeaf2da0 con 0x55ecdeb9ab30 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.963+0000 7fc87ffff640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdeb9ab30 0x55ecdeb9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.963+0000 7fc87ffff640 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdeb9ab30 0x55ecdeb9cf50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba0c7186a5b3b20e server_cookie=d74b788f5a85b54f in_seq=0 out_seq=0 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.963+0000 7fc85ffff640 10 client.26057 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc85ffff640 1 -- 172.21.15.39:0/3599723414 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecdeaf2da0 con 0x55ecdeb9ab30 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc85ffff640 10 client.26057 handle_command_reply: tid=0 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 client.26057 shutdown 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 msgr2=0x55ecdeb883f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8780094d0 tx=0x7fc87801b800 comp rx=0 tx=0).stop 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 shutdown_connections 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdeb9ab30 0x55ecdeb9cf50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb883f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc85ffff640 0 client.26057 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 --2- 172.21.15.39:0/3599723414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7a480 0x55ecdeb8a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 >> 172.21.15.39:0/3599723414 conn(0x55ecdeb782b0 msgr2=0x55ecdeb773d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 shutdown_connections 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 1 -- 172.21.15.39:0/3599723414 wait complete. 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.966+0000 7fc889546740 20 client.26057 trim_cache size 0 max 16384 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 Processor -- start 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 -- start start 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeba2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400e420 con 0x55ecdeb8b140 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc864010020 con 0x55ecdeb7a480 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc889546740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400eaf0 con 0x55ecdeb7ada0 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc88570e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.985+0000 7fc88570e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35346/0 (socket says 172.21.15.39:35346) 2024-09-10T21:59:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 -- 172.21.15.39:0/1678599956 learned_addr learned my addr 172.21.15.39:0/1678599956 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc87ffff640 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeba2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 -- 172.21.15.39:0/1678599956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 msgr2=0x55ecdeba2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeba2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 -- 172.21.15.39:0/1678599956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 msgr2=0x55ecdeb970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 -- 172.21.15.39:0/1678599956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecdeb7ab90 con 0x55ecdeb8b140 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc88570e640 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc878014040 tx=0x7fc878009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be372bd3b762f796 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc86a7fc640 1 -- 172.21.15.39:0/1678599956 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878011c90 con 0x55ecdeb8b140 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc86a7fc640 1 -- 172.21.15.39:0/1678599956 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8780098e0 con 0x55ecdeb8b140 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.986+0000 7fc86a7fc640 1 -- 172.21.15.39:0/1678599956 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87802a3a0 con 0x55ecdeb8b140 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- 172.21.15.39:0/1678599956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 msgr2=0x55ecdeba2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc878014040 tx=0x7fc878009500 comp rx=0 tx=0).stop 2024-09-10T21:59:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- 172.21.15.39:0/1678599956 shutdown_connections 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb8b140 0x55ecdeba2d40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeba2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 --2- 172.21.15.39:0/1678599956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb7a480 0x55ecdeb970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- 172.21.15.39:0/1678599956 >> 172.21.15.39:0/1678599956 conn(0x55ecdeb782b0 msgr2=0x55ecdeb866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- 172.21.15.39:0/1678599956 shutdown_connections 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- 172.21.15.39:0/1678599956 wait complete. 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 -- start start 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.987+0000 7fc889546740 1 Processor -- start 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb90100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400f890 con 0x55ecdeb7a480 2024-09-10T21:59:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400f1c0 con 0x55ecdeb8b140 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400c400 con 0x55ecdeb7ada0 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc889546740 10 client.0 _ll_register_callbacks cb 0x7fc878015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35352/0 (socket says 172.21.15.39:35352) 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 -- 172.21.15.39:0/2316572123 learned_addr learned my addr 172.21.15.39:0/2316572123 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc87ffff640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 -- 172.21.15.39:0/2316572123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 msgr2=0x55ecdeb93850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb93850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 -- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 msgr2=0x55ecdeb90100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb90100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 -- 172.21.15.39:0/2316572123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdeb90770 con 0x55ecdeb7a480 2024-09-10T21:59:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc88570e640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc87802ad00 tx=0x7fc878005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184cfb476ad693bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.988+0000 7fc85ffff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780103d0 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc878009610 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8780098e0 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc878011940 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 10 client.16446 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ecdec08380 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8780098e0 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc878010950 con 0x55ecdeb7a480 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 10 client.16446 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 20 client.16446 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdec08a40 0x55ecdec0ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 4 client.16446 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ecdeaee850 con 0x55ecdec08a40 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.989+0000 7fc87ffff640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdec08a40 0x55ecdec0ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.990+0000 7fc87ffff640 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdec08a40 0x55ecdec0ae60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f867c1fc6646196d server_cookie=80a59a816df0fbca in_seq=0 out_seq=0 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.990+0000 7fc85ffff640 10 client.16446 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc85ffff640 1 -- 172.21.15.39:0/2316572123 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55ecdeaee850 con 0x55ecdec08a40 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc85ffff640 10 client.16446 handle_command_reply: tid=0 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T21:59:25.031 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T21:59:25.032 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.033 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:59:25.035 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 client.16446 shutdown 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 msgr2=0x55ecdeb93310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc87802ad00 tx=0x7fc878005d10 comp rx=0 tx=0).stop 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 shutdown_connections 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ecdec08a40 0x55ecdec0ae60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdeb8b140 0x55ecdeb90100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecdeb7ada0 0x55ecdeb93850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 --2- 172.21.15.39:0/2316572123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ecdeb7a480 0x55ecdeb93310 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc85ffff640 0 client.16446 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:25.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.992+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 >> 172.21.15.39:0/2316572123 conn(0x55ecdeb782b0 msgr2=0x55ecdeb78f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 shutdown_connections 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc889546740 1 -- 172.21.15.39:0/2316572123 wait complete. 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc889546740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 msgr2=0x7fc8700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 0x7fc8700b7820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ecdeb79f60 tx=0x7fc874010000 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 msgr2=0x7fc880199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc87400d950 tx=0x7fc87400de10 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 shutdown_connections 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc8700b5360 0x7fc8700b7820 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88010d0d0 0x7fc88019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880104520 0x7fc880199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 --2- 172.21.15.39:0/2515014854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc880103b20 0x7fc880199240 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:25.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.993+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 >> 172.21.15.39:0/2515014854 conn(0x7fc8800fd6d0 msgr2=0x7fc8800fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:25.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.994+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 shutdown_connections 2024-09-10T21:59:25.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:24.994+0000 7fc887171640 1 -- 172.21.15.39:0/2515014854 wait complete. 2024-09-10T21:59:25.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:24 smithi070 ceph-mon[34909]: pgmap v473: 97 pgs: 97 active+clean; 317 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 318 op/s 2024-09-10T21:59:25.865 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:59:25.866 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:59:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:26.501 INFO:tasks.workunit.client.0.smithi039.stdout: 95 56905 286 38886 95 38436 501 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 -- 172.21.15.39:0/2011045354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e81087f0 msgr2=0x7fd4e8108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/2011045354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e81087f0 0x7fd4e8108c30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009ca0 tx=0x7fd4dc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 -- 172.21.15.39:0/2011045354 shutdown_connections 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/2011045354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 0x7fd4e810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/2011045354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e81087f0 0x7fd4e8108c30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/2011045354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e8102de0 0x7fd4e81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 -- 172.21.15.39:0/2011045354 >> 172.21.15.39:0/2011045354 conn(0x7fd4e80fe830 msgr2=0x7fd4e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 -- 172.21.15.39:0/2011045354 shutdown_connections 2024-09-10T21:59:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 -- 172.21.15.39:0/2011045354 wait complete. 2024-09-10T21:59:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.617+0000 7fd4f05f5640 1 Processor -- start 2024-09-10T21:59:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 -- start start 2024-09-10T21:59:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 0x7fd4e80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 0x7fd4e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8112e30 con 0x7fd4e8102de0 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8112cb0 con 0x7fd4e81087f0 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4f05f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8112fb0 con 0x7fd4e8109170 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35378/0 (socket says 172.21.15.39:35378) 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 -- 172.21.15.39:0/782874771 learned_addr learned my addr 172.21.15.39:0/782874771 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4edb90640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 0x7fd4e80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4eeb92640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 0x7fd4e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 -- 172.21.15.39:0/782874771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 msgr2=0x7fd4e8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 0x7fd4e8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 -- 172.21.15.39:0/782874771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 msgr2=0x7fd4e80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 0x7fd4e80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4ee391640 1 -- 172.21.15.39:0/782874771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e81a7710 con 0x7fd4e8102de0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.618+0000 7fd4edb90640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 0x7fd4e80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4ee391640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000e9f0 tx=0x7fd4e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000cd80 con 0x7fd4e8102de0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e00108e0 con 0x7fd4e8102de0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e81a7a00 con 0x7fd4e8102de0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0018980 con 0x7fd4e8102de0 2024-09-10T21:59:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.619+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e81a7f90 con 0x7fd4e8102de0 2024-09-10T21:59:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.620+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e81031c0 con 0x7fd4e8102de0 2024-09-10T21:59:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.621+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd4e0010430 con 0x7fd4e8102de0 2024-09-10T21:59:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.623+0000 7fd4e77fe640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 0x7fd4d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.623+0000 7fd4edb90640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 0x7fd4d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.623+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd4e00e6310 con 0x7fd4e8102de0 2024-09-10T21:59:26.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.623+0000 7fd4edb90640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 0x7fd4d00b7820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8076f90 tx=0x7fd4dc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:26.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.626+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4e00acb90 con 0x7fd4e8102de0 2024-09-10T21:59:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.861+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4e802e5c0 con 0x7fd4e8102de0 2024-09-10T21:59:26.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:26 smithi039 ceph-mon[30872]: pgmap v474: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1002 KiB/s wr, 127 op/s 2024-09-10T21:59:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.862+0000 7fd4e77fe640 1 -- 172.21.15.39:0/782874771 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11980 (secure 0 0 0) 0x7fd4e00b15c0 con 0x7fd4e8102de0 2024-09-10T21:59:26.864 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T21:59:26.864 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":30,"btime":"2024-09-10T21:56:56:565338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T21:56:55.941400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T21:59:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 30 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 msgr2=0x7fd4d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 0x7fd4d00b7820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8076f90 tx=0x7fd4dc009360 comp rx=0 tx=0).stop 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 msgr2=0x7fd4e80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000e9f0 tx=0x7fd4e000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 shutdown_connections 2024-09-10T21:59:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd4d00b5360 0x7fd4d00b7820 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4e8109170 0x7fd4e8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4e81087f0 0x7fd4e80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 --2- 172.21.15.39:0/782874771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4e8102de0 0x7fd4e80754a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 >> 172.21.15.39:0/782874771 conn(0x7fd4e80fe830 msgr2=0x7fd4e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 shutdown_connections 2024-09-10T21:59:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:26.865+0000 7fd4f05f5640 1 -- 172.21.15.39:0/782874771 wait complete. 2024-09-10T21:59:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:26 smithi173 ceph-mon[35294]: pgmap v474: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1002 KiB/s wr, 127 op/s 2024-09-10T21:59:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:26 smithi070 ceph-mon[34909]: pgmap v474: 97 pgs: 97 active+clean; 313 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1002 KiB/s wr, 127 op/s 2024-09-10T21:59:27.592 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:59:27.901 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:27.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:27 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/782874771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:59:28.056 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:27 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/782874771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:59:28.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:27 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/782874771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:59:28.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 -- 172.21.15.39:0/4047832485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3570103ca0 msgr2=0x7f3570104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 --2- 172.21.15.39:0/4047832485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3570103ca0 0x7f3570104080 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3560009ca0 tx=0x7f356002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 -- 172.21.15.39:0/4047832485 shutdown_connections 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 --2- 172.21.15.39:0/4047832485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f357010d100 0x7f357010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 --2- 172.21.15.39:0/4047832485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35701045c0 0x7f357010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 --2- 172.21.15.39:0/4047832485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3570103ca0 0x7f3570104080 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 -- 172.21.15.39:0/4047832485 >> 172.21.15.39:0/4047832485 conn(0x7f35700fd700 msgr2=0x7f35700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 -- 172.21.15.39:0/4047832485 shutdown_connections 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 -- 172.21.15.39:0/4047832485 wait complete. 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.389+0000 7f3575cfd640 1 Processor -- start 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 -- start start 2024-09-10T21:59:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 0x7f357010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f357010d100 0x7f357019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3570112d70 con 0x7f357010d100 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3570112bf0 con 0x7f35701045c0 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f3575cfd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3570112ef0 con 0x7f3570103ca0 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f357010d100 0x7f357019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:38958/0 (socket says 172.21.15.39:38958) 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 -- 172.21.15.39:0/2561559895 learned_addr learned my addr 172.21.15.39:0/2561559895 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356effd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 0x7f357010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 -- 172.21.15.39:0/2561559895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 msgr2=0x7f357010c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 0x7f357010c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.390+0000 7f356f7fe640 1 -- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f357010d100 msgr2=0x7f357019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f357010d100 0x7f357019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356f7fe640 1 -- 172.21.15.39:0/2561559895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35701a0320 con 0x7f3570103ca0 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356effd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 0x7f357010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f356002ade0 tx=0x7f3560031770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356cff9640 1 -- 172.21.15.39:0/2561559895 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560003b70 con 0x7f3570103ca0 2024-09-10T21:59:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35701a05b0 con 0x7f3570103ca0 2024-09-10T21:59:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356cff9640 1 -- 172.21.15.39:0/2561559895 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3560003d10 con 0x7f3570103ca0 2024-09-10T21:59:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f356cff9640 1 -- 172.21.15.39:0/2561559895 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356002fa80 con 0x7f3570103ca0 2024-09-10T21:59:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.391+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357019cbf0 con 0x7f3570103ca0 2024-09-10T21:59:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.394+0000 7f356cff9640 1 -- 172.21.15.39:0/2561559895 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f356002fc20 con 0x7f3570103ca0 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.394+0000 7f35780d2740 1 Processor -- start 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.394+0000 7f35780d2740 1 -- start start 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356cff9640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 0x7f355c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fced8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356ffff640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 0x7f355c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356cff9640 1 -- 172.21.15.39:0/2561559895 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3560106e00 con 0x7f3570103ca0 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b6fc63ea0 con 0x564b6fcf9d80 2024-09-10T21:59:28.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b6fc532d0 con 0x564b6fceddf0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f35780d2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564b6fc570e0 con 0x564b6fced4d0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51392/0 (socket says 172.21.15.39:51392) 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 -- 172.21.15.39:0/2025554599 learned_addr learned my addr 172.21.15.39:0/2025554599 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356ffff640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fced8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 -- 172.21.15.39:0/2025554599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 msgr2=0x564b6fced8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fced8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 -- 172.21.15.39:0/2025554599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 msgr2=0x564b6fcfc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356effd640 1 -- 172.21.15.39:0/2025554599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6f9b1650 con 0x564b6fceddf0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.395+0000 7f356ffff640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.396+0000 7f356ffff640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 0x7f355c0b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35680095f0 tx=0x7f3568011810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.396+0000 7f356effd640 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3558010480 tx=0x7f3558010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d16e888c19ec919 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.396+0000 7f3565ffb640 1 -- 172.21.15.39:0/2025554599 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558005220 con 0x564b6fceddf0 2024-09-10T21:59:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.396+0000 7f3565ffb640 1 -- 172.21.15.39:0/2025554599 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3558015070 con 0x564b6fceddf0 2024-09-10T21:59:28.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.396+0000 7f3565ffb640 1 -- 172.21.15.39:0/2025554599 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580118d0 con 0x564b6fceddf0 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- 172.21.15.39:0/2025554599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 msgr2=0x564b6fcf9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3558010480 tx=0x7f3558010940 comp rx=0 tx=0).stop 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- 172.21.15.39:0/2025554599 shutdown_connections 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fceddf0 0x564b6fcf9840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 --2- 172.21.15.39:0/2025554599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fced8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- 172.21.15.39:0/2025554599 >> 172.21.15.39:0/2025554599 conn(0x564b6fceb300 msgr2=0x564b6fcec4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- 172.21.15.39:0/2025554599 shutdown_connections 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- 172.21.15.39:0/2025554599 wait complete. 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 -- start start 2024-09-10T21:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.397+0000 7f35780d2740 1 Processor -- start 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fcf9d80 0x564b6fcf70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b6fab4700 con 0x564b6fceddf0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b6fbee160 con 0x564b6fced4d0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564b6fcfca00 con 0x564b6fcf9d80 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f35780d2740 10 client.0 _ll_register_callbacks cb 0x564b6fc079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51398/0 (socket says 172.21.15.39:51398) 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 -- 172.21.15.39:0/2435698214 learned_addr learned my addr 172.21.15.39:0/2435698214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356ffff640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fcf9d80 0x564b6fcf70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 -- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fcf9d80 msgr2=0x564b6fcf70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fcf9d80 0x564b6fcf70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 -- 172.21.15.39:0/2435698214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 msgr2=0x564b6fcf6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 -- 172.21.15.39:0/2435698214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6fc1bc90 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35600ca820 tx=0x7f35600c9510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21cf0914b7bc90b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.398+0000 7f354effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600cda10 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f35600d66b0 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3558015070 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35600cd0c0 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 10 client.26081 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b6fd08320 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3558015070 con 0x564b6fced4d0 2024-09-10T21:59:28.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f35600cc810 con 0x564b6fced4d0 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 10 client.26081 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 10 client.26081 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 20 client.26081 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd09820 0x564b6fd0bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 4 client.26081 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.399+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b6fc65df0 con 0x564b6fd09820 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.400+0000 7f356effd640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd09820 0x564b6fd0bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.400+0000 7f354effd640 10 client.26081 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.400+0000 7f356effd640 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd09820 0x564b6fd0bcc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb10e4f73810a9b6 server_cookie=6ac669bbe5777a1d in_seq=0 out_seq=0 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f354effd640 1 -- 172.21.15.39:0/2435698214 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b6fc65df0 con 0x564b6fd09820 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f354effd640 10 client.26081 handle_command_reply: tid=0 2024-09-10T21:59:28.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 client.26081 shutdown 2024-09-10T21:59:28.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 msgr2=0x564b6fcf9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35600ca820 tx=0x7f35600c9510 comp rx=0 tx=0).stop 2024-09-10T21:59:28.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 shutdown_connections 2024-09-10T21:59:28.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd09820 0x564b6fd0bcc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fcf9d80 0x564b6fcf70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f354effd640 0 client.26081 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 --2- 172.21.15.39:0/2435698214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fcf9660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 >> 172.21.15.39:0/2435698214 conn(0x564b6fceb300 msgr2=0x564b6fcf0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 shutdown_connections 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 1 -- 172.21.15.39:0/2435698214 wait complete. 2024-09-10T21:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.401+0000 7f35780d2740 20 client.26081 trim_cache size 0 max 16384 2024-09-10T21:59:28.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 Processor -- start 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 -- start start 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fd05c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 0x564b6fcf5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35701bd170 con 0x564b6fceddf0 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35701bed70 con 0x564b6fcf9d80 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f35780d2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35701bd840 con 0x564b6fced4d0 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35422/0 (socket says 172.21.15.39:35422) 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 0x564b6fcf5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 -- 172.21.15.39:0/2584032228 learned_addr learned my addr 172.21.15.39:0/2584032228 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356f7fe640 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fd05c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 -- 172.21.15.39:0/2584032228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 msgr2=0x564b6fd05c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fd05c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 -- 172.21.15.39:0/2584032228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 msgr2=0x564b6fcf5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 0x564b6fcf5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356effd640 1 -- 172.21.15.39:0/2584032228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6fd0c340 con 0x564b6fceddf0 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.415+0000 7f356ffff640 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 0x564b6fcf5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.416+0000 7f356effd640 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3558010480 tx=0x7f3558013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89197ba72ba68b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.416+0000 7f35657fa640 1 -- 172.21.15.39:0/2584032228 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580052c0 con 0x564b6fceddf0 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.416+0000 7f35657fa640 1 -- 172.21.15.39:0/2584032228 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3558015040 con 0x564b6fceddf0 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.416+0000 7f35657fa640 1 -- 172.21.15.39:0/2584032228 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580117c0 con 0x564b6fceddf0 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 -- 172.21.15.39:0/2584032228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 msgr2=0x564b6fcf5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3558010480 tx=0x7f3558013040 comp rx=0 tx=0).stop 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 -- 172.21.15.39:0/2584032228 shutdown_connections 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fcf9d80 0x564b6fcf5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fceddf0 0x564b6fcf5fa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 --2- 172.21.15.39:0/2584032228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fced4d0 0x564b6fd05c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 -- 172.21.15.39:0/2584032228 >> 172.21.15.39:0/2584032228 conn(0x564b6fceb300 msgr2=0x564b6fcf1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 -- 172.21.15.39:0/2584032228 shutdown_connections 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.417+0000 7f35780d2740 1 -- 172.21.15.39:0/2584032228 wait complete. 2024-09-10T21:59:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 -- start start 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 Processor -- start 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fceddf0 0x564b6fd021e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35701be5e0 con 0x564b6fcf9d80 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35701bdf10 con 0x564b6fced4d0 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35701bb150 con 0x564b6fceddf0 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f35780d2740 10 client.0 _ll_register_callbacks cb 0x7f3560031960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.418+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:51412/0 (socket says 172.21.15.39:51412) 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 -- 172.21.15.39:0/4055804226 learned_addr learned my addr 172.21.15.39:0/4055804226 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356effd640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fceddf0 0x564b6fd021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356ffff640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 -- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fceddf0 msgr2=0x564b6fd021e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fceddf0 0x564b6fd021e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 -- 172.21.15.39:0/4055804226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 msgr2=0x564b6fcfcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 -- 172.21.15.39:0/4055804226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6fd02880 con 0x564b6fced4d0 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f356f7fe640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3560004af0 tx=0x7f35600095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b8b1e7ec6d3429f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f354effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600ccf00 con 0x564b6fced4d0 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f35600d66b0 con 0x564b6fced4d0 2024-09-10T21:59:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3558015040 con 0x564b6fced4d0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f35600cdcb0 con 0x564b6fced4d0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f35780d2740 10 client.26087 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.419+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b6fd76c30 con 0x564b6fced4d0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3558015040 con 0x564b6fced4d0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f35600c8f00 con 0x564b6fced4d0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 10 client.26087 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 10 client.26087 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 20 client.26087 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd77220 0x564b6fd79640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 4 client.26087 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b6fc618a0 con 0x564b6fd77220 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.420+0000 7f356effd640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd77220 0x564b6fd79640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f356effd640 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd77220 0x564b6fd79640 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=793bb8c59ad23e30 server_cookie=691727a1b9facd39 in_seq=0 out_seq=0 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f354effd640 10 client.26087 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f354effd640 1 -- 172.21.15.39:0/4055804226 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b6fc618a0 con 0x564b6fd77220 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f354effd640 10 client.26087 handle_command_reply: tid=0 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 client.26087 shutdown 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 msgr2=0x564b6fd01ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3560004af0 tx=0x7f35600095c0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 shutdown_connections 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x564b6fd77220 0x564b6fd79640 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6fcf9d80 0x564b6fcfcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f354effd640 0 client.26087 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b6fceddf0 0x564b6fd021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 --2- 172.21.15.39:0/4055804226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b6fced4d0 0x564b6fd01ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 >> 172.21.15.39:0/4055804226 conn(0x564b6fceb300 msgr2=0x564b6fcf5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 shutdown_connections 2024-09-10T21:59:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 1 -- 172.21.15.39:0/4055804226 wait complete. 2024-09-10T21:59:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.421+0000 7f35780d2740 20 client.26087 trim_cache size 0 max 16384 2024-09-10T21:59:28.427 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 msgr2=0x7f355c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 0x7f355c0b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35680095f0 tx=0x7f3568011810 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 msgr2=0x7f357010bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f356002ade0 tx=0x7f3560031770 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 shutdown_connections 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f355c0b52e0 0x7f355c0b77a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f357010d100 0x7f357019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35701045c0 0x7f357010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 --2- 172.21.15.39:0/2561559895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3570103ca0 0x7f357010bf80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 >> 172.21.15.39:0/2561559895 conn(0x7f35700fd700 msgr2=0x7f357010f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 shutdown_connections 2024-09-10T21:59:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:28.422+0000 7f3575cfd640 1 -- 172.21.15.39:0/2561559895 wait complete. 2024-09-10T21:59:29.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:28 smithi039 ceph-mon[30872]: pgmap v475: 97 pgs: 97 active+clean; 311 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.0 MiB/s wr, 227 op/s 2024-09-10T21:59:29.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:28 smithi173 ceph-mon[35294]: pgmap v475: 97 pgs: 97 active+clean; 311 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.0 MiB/s wr, 227 op/s 2024-09-10T21:59:29.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:28 smithi070 ceph-mon[34909]: pgmap v475: 97 pgs: 97 active+clean; 311 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.0 MiB/s wr, 227 op/s 2024-09-10T21:59:29.359 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:59:29.641 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/601761059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 msgr2=0x7f1a7810ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/601761059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7810ae00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009900 tx=0x7f1a6802a410 comp rx=0 tx=0).stop 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/601761059 shutdown_connections 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/601761059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a7810b340 0x7f1a78111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/601761059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7810ae00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/601761059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a78104fb0 0x7f1a78105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/601761059 >> 172.21.15.39:0/601761059 conn(0x7f1a781009c0 msgr2=0x7f1a78102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.123+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/601761059 shutdown_connections 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.124+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/601761059 wait complete. 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.124+0000 7f1a7d7a0640 1 Processor -- start 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.124+0000 7f1a7d7a0640 1 -- start start 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.124+0000 7f1a7d7a0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a78104fb0 0x7f1a7819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a7810b340 0x7f1a781a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78114f70 con 0x7f1a7810a9c0 2024-09-10T21:59:30.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78114df0 con 0x7f1a7810b340 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781150f0 con 0x7f1a78104fb0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50432/0 (socket says 172.21.15.39:50432) 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/2821935642 learned_addr learned my addr 172.21.15.39:0/2821935642 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a777fe640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a7810b340 0x7f1a781a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a78104fb0 0x7f1a7819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/2821935642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a78104fb0 msgr2=0x7f1a7819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a78104fb0 0x7f1a7819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/2821935642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a7810b340 msgr2=0x7f1a781a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a7810b340 0x7f1a781a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/2821935642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a781a1510 con 0x7f1a7810a9c0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1a68005940 tx=0x7f1a68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a74ff9640 1 -- 172.21.15.39:0/2821935642 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6803f030 con 0x7f1a7810a9c0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781a17a0 con 0x7f1a7810a9c0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a74ff9640 1 -- 172.21.15.39:0/2821935642 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a68003aa0 con 0x7f1a7810a9c0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.125+0000 7f1a74ff9640 1 -- 172.21.15.39:0/2821935642 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68035070 con 0x7f1a7810a9c0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.126+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781a7ec0 con 0x7f1a7810a9c0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.128+0000 7f1a7fb75740 1 Processor -- start 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.128+0000 7f1a7fb75740 1 -- start start 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109fed80 0x558c10a01170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c10968ea0 con 0x558c109f24d0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c109582d0 con 0x558c109f2df0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c1095c0e0 con 0x558c109fed80 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57076/0 (socket says 172.21.15.39:57076) 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50448/0 (socket says 172.21.15.39:50448) 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 -- 172.21.15.39:0/4142172221 learned_addr learned my addr 172.21.15.39:0/4142172221 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a74ff9640 1 -- 172.21.15.39:0/2821935642 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1a6803bce0 con 0x7f1a7810a9c0 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 -- 172.21.15.39:0/4142172221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109fed80 msgr2=0x558c10a01170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109fed80 0x558c10a01170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 -- 172.21.15.39:0/4142172221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 msgr2=0x558c109f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 -- 172.21.15.39:0/4142172221 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c106b6650 con 0x558c109f2df0 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a777fe640 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.129+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009cf0 tx=0x7f1a60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a023f58e310f5680 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a6d7fa640 1 -- 172.21.15.39:0/4142172221 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60004230 con 0x558c109f2df0 2024-09-10T21:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a6d7fa640 1 -- 172.21.15.39:0/4142172221 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a600043d0 con 0x558c109f2df0 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a6d7fa640 1 -- 172.21.15.39:0/4142172221 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60019880 con 0x558c109f2df0 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a74ff9640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 0x7f1a580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a777fe640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 0x7f1a580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.130+0000 7f1a74ff9640 1 -- 172.21.15.39:0/2821935642 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a68106530 con 0x7f1a7810a9c0 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- 172.21.15.39:0/4142172221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 msgr2=0x558c109fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009cf0 tx=0x7f1a60011810 comp rx=0 tx=0).stop 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a777fe640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 0x7f1a580b77a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- 172.21.15.39:0/4142172221 shutdown_connections 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109fed80 0x558c10a01170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c109fe840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/4142172221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f24d0 0x558c109f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- 172.21.15.39:0/4142172221 >> 172.21.15.39:0/4142172221 conn(0x558c109f0300 msgr2=0x558c109f14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- 172.21.15.39:0/4142172221 shutdown_connections 2024-09-10T21:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- 172.21.15.39:0/4142172221 wait complete. 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 -- start start 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.131+0000 7f1a7fb75740 1 Processor -- start 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c109fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c109fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c107b9700 con 0x558c109f2df0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c108f3160 con 0x558c109fed80 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c10a01a00 con 0x558c109f24d0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a7fb75740 10 client.0 _ll_register_callbacks cb 0x558c1090c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c109fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c109fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c109fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57088/0 (socket says 172.21.15.39:57088) 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50460/0 (socket says 172.21.15.39:50460) 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a777fe640 1 -- 172.21.15.39:0/3465179815 learned_addr learned my addr 172.21.15.39:0/3465179815 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c109fe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:50002/0 (socket says 172.21.15.39:50002) 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 msgr2=0x558c109fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c109fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3465179815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 msgr2=0x558c109fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c109fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3465179815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c10920c90 con 0x558c109f2df0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1a680ccd40 tx=0x7f1a680c8c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a4ca3ec1216b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.132+0000 7f1a667fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68049070 con 0x558c109f2df0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a600043d0 con 0x558c109f2df0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a680cd010 con 0x558c109f2df0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a680cc520 con 0x558c109f2df0 2024-09-10T21:59:30.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 10 client.16482 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558c10a0d3b0 con 0x558c109f2df0 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a600043d0 con 0x558c109f2df0 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1a680b2bd0 con 0x558c109f2df0 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 10 client.16482 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 10 client.16482 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 20 client.16482 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a0e810 0x558c10a10c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 4 client.16482 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c1096adf0 con 0x558c10a0e810 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.133+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a0e810 0x558c10a10c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.134+0000 7f1a667fc640 10 client.16482 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.134+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a0e810 0x558c10a10c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=97b29f2a411728ef server_cookie=af7b61cc5cb8abce in_seq=0 out_seq=0 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a667fc640 1 -- 172.21.15.39:0/3465179815 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c1096adf0 con 0x558c10a0e810 2024-09-10T21:59:30.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a667fc640 10 client.16482 handle_command_reply: tid=0 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 client.16482 shutdown 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 msgr2=0x558c109fbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1a680ccd40 tx=0x7f1a680c8c50 comp rx=0 tx=0).stop 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 shutdown_connections 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a0e810 0x558c10a10c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c109fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109fbb40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a667fc640 0 client.16482 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3465179815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c109fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 >> 172.21.15.39:0/3465179815 conn(0x558c109f0300 msgr2=0x558c109f5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 shutdown_connections 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3465179815 wait complete. 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.135+0000 7f1a7fb75740 20 client.16482 trim_cache size 0 max 16384 2024-09-10T21:59:30.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.148+0000 7f1a7fb75740 1 Processor -- start 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.148+0000 7f1a7fb75740 1 -- start start 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109efc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c10a00170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b04d0 con 0x558c109f2df0 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b20d0 con 0x558c109fed80 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b0ba0 con 0x558c109f24d0 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:50018/0 (socket says 172.21.15.39:50018) 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 -- 172.21.15.39:0/569388312 learned_addr learned my addr 172.21.15.39:0/569388312 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a777fe640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c10a00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 -- 172.21.15.39:0/569388312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 msgr2=0x558c10a00170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c10a00170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 -- 172.21.15.39:0/569388312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 msgr2=0x558c109efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a76ffd640 1 -- 172.21.15.39:0/569388312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c109f0d80 con 0x558c109f24d0 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.149+0000 7f1a777fe640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c10a00170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.150+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009230 tx=0x7f1a60005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f401ffbd8e9e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.150+0000 7f1a6cff9640 1 -- 172.21.15.39:0/569388312 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600037f0 con 0x558c109f24d0 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.150+0000 7f1a6cff9640 1 -- 172.21.15.39:0/569388312 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a60030070 con 0x558c109f24d0 2024-09-10T21:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.150+0000 7f1a6cff9640 1 -- 172.21.15.39:0/569388312 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60019680 con 0x558c109f24d0 2024-09-10T21:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- 172.21.15.39:0/569388312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 msgr2=0x558c10a0ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009230 tx=0x7f1a60005850 comp rx=0 tx=0).stop 2024-09-10T21:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- 172.21.15.39:0/569388312 shutdown_connections 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109fed80 0x558c10a00170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109f2df0 0x558c109efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/569388312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a0ac30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- 172.21.15.39:0/569388312 >> 172.21.15.39:0/569388312 conn(0x558c109f0300 msgr2=0x558c109f6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- 172.21.15.39:0/569388312 shutdown_connections 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- 172.21.15.39:0/569388312 wait complete. 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.151+0000 7f1a7fb75740 1 -- start start 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 Processor -- start 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 0x558c10a16990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b1940 con 0x558c109fed80 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b1270 con 0x558c109f2df0 2024-09-10T21:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781ae4b0 con 0x558c109f24d0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a7fb75740 10 client.0 _ll_register_callbacks cb 0x7f1a68005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57110/0 (socket says 172.21.15.39:57110) 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a777fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 0x558c10a16990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3307719589 learned_addr learned my addr 172.21.15.39:0/3307719589 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 msgr2=0x558c10a075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3307719589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 msgr2=0x558c10a16990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 0x558c10a16990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a6e7fc640 1 -- 172.21.15.39:0/3307719589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c10a03050 con 0x558c109f2df0 2024-09-10T21:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.152+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a777fe640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 0x558c10a16990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a6e7fc640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c8dc0 tx=0x7f1a680cd240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63178489ada05a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a667fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68049070 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f1a680d6000 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a60030070 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a680b80c0 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a7fb75740 10 client.26105 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558c10a7b910 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.153+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a60030070 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1a681060d0 con 0x558c109f2df0 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 10 client.26105 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 10 client.26105 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:59:30.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 20 client.26105 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a7bea0 0x558c10a7e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 4 client.26105 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c109668a0 con 0x558c10a7bea0 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a7bea0 0x558c10a7e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a667fc640 10 client.26105 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.154+0000 7f1a76ffd640 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a7bea0 0x558c10a7e2c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e8378de18dd39f5 server_cookie=5f1d87679ad7d81 in_seq=0 out_seq=0 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a667fc640 1 -- 172.21.15.39:0/3307719589 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c109668a0 con 0x558c10a7bea0 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a667fc640 10 client.26105 handle_command_reply: tid=0 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 client.26105 shutdown 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 msgr2=0x558c10a162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c8dc0 tx=0x7f1a680cd240 comp rx=0 tx=0).stop 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 shutdown_connections 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c109fed80 0x558c10a16990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x558c10a7bea0 0x558c10a7e2c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c109f2df0 0x558c10a162a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 --2- 172.21.15.39:0/3307719589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c109f24d0 0x558c10a075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a667fc640 0 client.26105 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 >> 172.21.15.39:0/3307719589 conn(0x558c109f0300 msgr2=0x558c109fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 shutdown_connections 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 1 -- 172.21.15.39:0/3307719589 wait complete. 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.155+0000 7f1a7fb75740 20 client.26105 trim_cache size 0 max 16384 2024-09-10T21:59:30.170 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 msgr2=0x7f1a580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 0x7f1a580b77a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70009600 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 msgr2=0x7f1a7819b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1a68005940 tx=0x7f1a68004270 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 shutdown_connections 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1a580b52e0 0x7f1a580b77a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a7810b340 0x7f1a781a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a7810a9c0 0x7f1a7819b9a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 --2- 172.21.15.39:0/2821935642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a78104fb0 0x7f1a7819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 >> 172.21.15.39:0/2821935642 conn(0x7f1a781009c0 msgr2=0x7f1a78102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 shutdown_connections 2024-09-10T21:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:30.156+0000 7f1a7d7a0640 1 -- 172.21.15.39:0/2821935642 wait complete. 2024-09-10T21:59:30.921 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:30 smithi039 ceph-mon[30872]: pgmap v476: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1019 KiB/s wr, 348 op/s 2024-09-10T21:59:31.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:30 smithi070 ceph-mon[34909]: pgmap v476: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1019 KiB/s wr, 348 op/s 2024-09-10T21:59:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:30 smithi173 ceph-mon[35294]: pgmap v476: 97 pgs: 97 active+clean; 312 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1019 KiB/s wr, 348 op/s 2024-09-10T21:59:31.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:59:32.714 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:33.115 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:32 smithi039 ceph-mon[30872]: pgmap v477: 97 pgs: 97 active+clean; 311 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1015 KiB/s wr, 346 op/s 2024-09-10T21:59:33.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:32 smithi070 ceph-mon[34909]: pgmap v477: 97 pgs: 97 active+clean; 311 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1015 KiB/s wr, 346 op/s 2024-09-10T21:59:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:32 smithi173 ceph-mon[35294]: pgmap v477: 97 pgs: 97 active+clean; 311 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1015 KiB/s wr, 346 op/s 2024-09-10T21:59:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 -- 172.21.15.39:0/3602253798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28081045f0 msgr2=0x7f280810cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 --2- 172.21.15.39:0/3602253798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28081045f0 0x7f280810cae0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009900 tx=0x7f27fc02a410 comp rx=0 tx=0).stop 2024-09-10T21:59:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 -- 172.21.15.39:0/3602253798 shutdown_connections 2024-09-10T21:59:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 --2- 172.21.15.39:0/3602253798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f280810d130 0x7f280810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 --2- 172.21.15.39:0/3602253798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28081045f0 0x7f280810cae0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 --2- 172.21.15.39:0/3602253798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2808103cd0 0x7f28081040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 -- 172.21.15.39:0/3602253798 >> 172.21.15.39:0/3602253798 conn(0x7f28080fd770 msgr2=0x7f28080ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 -- 172.21.15.39:0/3602253798 shutdown_connections 2024-09-10T21:59:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 -- 172.21.15.39:0/3602253798 wait complete. 2024-09-10T21:59:33.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.339+0000 7f280f4bc640 1 Processor -- start 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 -- start start 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 0x7f280819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280810d130 0x7f28081a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2808112da0 con 0x7f280810d130 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2808112c20 con 0x7f2808103cd0 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280f4bc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2808112f20 con 0x7f28081045f0 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280ca57640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 0x7f280819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57128/0 (socket says 172.21.15.39:57128) 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 -- 172.21.15.39:0/334613106 learned_addr learned my addr 172.21.15.39:0/334613106 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280da59640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280810d130 0x7f28081a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 -- 172.21.15.39:0/334613106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 msgr2=0x7f280819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 0x7f280819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 -- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280810d130 msgr2=0x7f28081a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280810d130 0x7f28081a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280d258640 1 -- 172.21.15.39:0/334613106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28081a1760 con 0x7f2808103cd0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.340+0000 7f280ca57640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 0x7f280819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f280d258640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27f800eb90 tx=0x7f27f800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f28067fc640 1 -- 172.21.15.39:0/334613106 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8004d20 con 0x7f2808103cd0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f28067fc640 1 -- 172.21.15.39:0/334613106 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f800ee90 con 0x7f2808103cd0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28081a1a50 con 0x7f2808103cd0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f28067fc640 1 -- 172.21.15.39:0/334613106 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8010670 con 0x7f2808103cd0 2024-09-10T21:59:33.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.341+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28081a8110 con 0x7f2808103cd0 2024-09-10T21:59:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.343+0000 7f28067fc640 1 -- 172.21.15.39:0/334613106 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f27f8005020 con 0x7f2808103cd0 2024-09-10T21:59:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.344+0000 7f28067fc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 0x7f27f00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.344+0000 7f280ca57640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 0x7f27f00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.344+0000 7f28067fc640 1 -- 172.21.15.39:0/334613106 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f27f80e61c0 con 0x7f2808103cd0 2024-09-10T21:59:33.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.345+0000 7f280ca57640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 0x7f27f00b7820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.345+0000 7f2811891740 1 Processor -- start 2024-09-10T21:59:33.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.345+0000 7f2811891740 1 -- start start 2024-09-10T21:59:33.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc1609a10 0x55bdc1615460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1617d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bdc157fea0 con 0x55bdc16159a0 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdc156f2d0 con 0x55bdc16090f0 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f2811891740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bdc15730e0 con 0x55bdc1609a10 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280da59640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1617d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57138/0 (socket says 172.21.15.39:57138) 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 -- 172.21.15.39:0/503770910 learned_addr learned my addr 172.21.15.39:0/503770910 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280da59640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1617d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50508/0 (socket says 172.21.15.39:50508) 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280ca57640 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc1609a10 0x55bdc1615460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 -- 172.21.15.39:0/503770910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc1609a10 msgr2=0x55bdc1615460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc1609a10 0x55bdc1615460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 -- 172.21.15.39:0/503770910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 msgr2=0x55bdc1617d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1617d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 -- 172.21.15.39:0/503770910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc12cd650 con 0x55bdc16090f0 2024-09-10T21:59:33.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.346+0000 7f280d258640 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cba0 tx=0x7f27f8005870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47aa1f28451fc9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.347+0000 7f27ef7fe640 1 -- 172.21.15.39:0/503770910 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80ac440 con 0x55bdc16090f0 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.347+0000 7f27ef7fe640 1 -- 172.21.15.39:0/503770910 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80ad030 con 0x55bdc16090f0 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.347+0000 7f27ef7fe640 1 -- 172.21.15.39:0/503770910 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80b5a30 con 0x55bdc16090f0 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- 172.21.15.39:0/503770910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 msgr2=0x55bdc16094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cba0 tx=0x7f27f8005870 comp rx=0 tx=0).stop 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- 172.21.15.39:0/503770910 shutdown_connections 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1617d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc1609a10 0x55bdc1615460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 --2- 172.21.15.39:0/503770910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16094d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- 172.21.15.39:0/503770910 >> 172.21.15.39:0/503770910 conn(0x55bdc1606f20 msgr2=0x55bdc16080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- 172.21.15.39:0/503770910 shutdown_connections 2024-09-10T21:59:33.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- 172.21.15.39:0/503770910 wait complete. 2024-09-10T21:59:33.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.348+0000 7f2811891740 1 -- start start 2024-09-10T21:59:33.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 Processor -- start 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1615290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc16126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 0x55bdc1612d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bdc13d0700 con 0x55bdc1609a10 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdc150a160 con 0x55bdc16159a0 2024-09-10T21:59:33.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bdc1618620 con 0x55bdc16090f0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f2811891740 10 client.0 _ll_register_callbacks cb 0x55bdc15239e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f280da59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 0x55bdc1612d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f280ca57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc16126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f280d258640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1615290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f280da59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 0x55bdc1612d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57148/0 (socket says 172.21.15.39:57148) 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.349+0000 7f280da59640 1 -- 172.21.15.39:0/444490175 learned_addr learned my addr 172.21.15.39:0/444490175 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 -- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 msgr2=0x55bdc1612d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 0x55bdc1612d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 -- 172.21.15.39:0/444490175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 msgr2=0x55bdc16126e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc16126e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 -- 172.21.15.39:0/444490175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc1537c90 con 0x55bdc16090f0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f280d258640 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1615290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cba0 tx=0x7f27f80ac440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31bee8a3126ea83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f27ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80cd060 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f27f80abb90 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f80ad030 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27f80ac930 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f2811891740 10 client.26062 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.350+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bdc1623f80 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80b1410 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f27f80ab690 con 0x55bdc16090f0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 10 client.26062 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 10 client.26062 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 20 client.26062 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc16252d0 0x55bdc16276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 4 client.26062 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f27f80ad030 con 0x55bdc16252d0 2024-09-10T21:59:33.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.351+0000 7f280ca57640 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc16252d0 0x55bdc16276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.352+0000 7f27ecff9640 10 client.26062 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:59:33.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.352+0000 7f280ca57640 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc16252d0 0x55bdc16276c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48f765f030ae98d1 server_cookie=468f74a6ce2a3a9a in_seq=0 out_seq=0 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.352+0000 7f27ecff9640 1 -- 172.21.15.39:0/444490175 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f27f80ad030 con 0x55bdc16252d0 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.352+0000 7f27ecff9640 10 client.26062 handle_command_reply: tid=0 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 client.26062 shutdown 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 msgr2=0x55bdc1615290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1615290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cba0 tx=0x7f27f80ac440 comp rx=0 tx=0).stop 2024-09-10T21:59:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 shutdown_connections 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc16252d0 0x55bdc16276c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16159a0 0x55bdc1612d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc16126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f27ecff9640 0 client.26062 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 --2- 172.21.15.39:0/444490175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1615290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 >> 172.21.15.39:0/444490175 conn(0x55bdc1606f20 msgr2=0x55bdc160ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 shutdown_connections 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 1 -- 172.21.15.39:0/444490175 wait complete. 2024-09-10T21:59:33.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.353+0000 7f2811891740 20 client.26062 trim_cache size 0 max 16384 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 Processor -- start 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 -- start start 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1607fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc1609a10 0x55bdc1608520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f28081b0650 con 0x55bdc16159a0 2024-09-10T21:59:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28081b2250 con 0x55bdc1609a10 2024-09-10T21:59:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f2811891740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f28081b0d20 con 0x55bdc16090f0 2024-09-10T21:59:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f280da59640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f280da59640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50530/0 (socket says 172.21.15.39:50530) 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f280da59640 1 -- 172.21.15.39:0/2920083359 learned_addr learned my addr 172.21.15.39:0/2920083359 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f280d258640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1607fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.367+0000 7f280ca57640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc1609a10 0x55bdc1608520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 -- 172.21.15.39:0/2920083359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc1609a10 msgr2=0x55bdc1608520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc1609a10 0x55bdc1608520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 -- 172.21.15.39:0/2920083359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 msgr2=0x55bdc1616d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 -- 172.21.15.39:0/2920083359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc16079a0 con 0x55bdc16090f0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280da59640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f280d258640 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1607fe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27f80a8eb0 tx=0x7f27f8005870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21af71e284382bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f27eeffd640 1 -- 172.21.15.39:0/2920083359 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80cd070 con 0x55bdc16090f0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f27eeffd640 1 -- 172.21.15.39:0/2920083359 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80ad030 con 0x55bdc16090f0 2024-09-10T21:59:33.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.368+0000 7f27eeffd640 1 -- 172.21.15.39:0/2920083359 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80b1410 con 0x55bdc16090f0 2024-09-10T21:59:33.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- 172.21.15.39:0/2920083359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 msgr2=0x55bdc1607fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1607fe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27f80a8eb0 tx=0x7f27f8005870 comp rx=0 tx=0).stop 2024-09-10T21:59:33.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- 172.21.15.39:0/2920083359 shutdown_connections 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc16159a0 0x55bdc1616d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc1609a10 0x55bdc1608520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 --2- 172.21.15.39:0/2920083359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16090f0 0x55bdc1607fe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- 172.21.15.39:0/2920083359 >> 172.21.15.39:0/2920083359 conn(0x55bdc1606f20 msgr2=0x55bdc160d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- 172.21.15.39:0/2920083359 shutdown_connections 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- 172.21.15.39:0/2920083359 wait complete. 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 -- start start 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.369+0000 7f2811891740 1 Processor -- start 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc1627770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16159a0 0x55bdc168af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f28081b1ac0 con 0x55bdc1609a10 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28081b13f0 con 0x55bdc16090f0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f28081ae630 con 0x55bdc16159a0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f2811891740 10 client.0 _ll_register_callbacks cb 0x7f27f80b1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280ca57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc1627770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57164/0 (socket says 172.21.15.39:57164) 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 -- 172.21.15.39:0/3726045996 learned_addr learned my addr 172.21.15.39:0/3726045996 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280ca57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc1627770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50542/0 (socket says 172.21.15.39:50542) 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280da59640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16159a0 0x55bdc168af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 -- 172.21.15.39:0/3726045996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16159a0 msgr2=0x55bdc168af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16159a0 0x55bdc168af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 -- 172.21.15.39:0/3726045996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 msgr2=0x55bdc1627770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:33.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc1627770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.370+0000 7f280d258640 1 -- 172.21.15.39:0/3726045996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc168b660 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f280d258640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f27f80abdc0 tx=0x7f27f80abdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39dc508576e455bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f80cd070 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f80ad030 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f27f8092360 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27f80ac440 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f2811891740 10 client.26123 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bdc168b660 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f80ad030 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.371+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f27f80c7950 con 0x55bdc16090f0 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 10 client.26123 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:33.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 10 client.26123 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 20 client.26123 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc1692dd0 0x55bdc16951f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 4 client.26123 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bdc1581df0 con 0x55bdc1692dd0 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f280ca57640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc1692dd0 0x55bdc16951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f280ca57640 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc1692dd0 0x55bdc16951f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bdf57127820e3b server_cookie=3bbf70b2bc02ed54 in_seq=0 out_seq=0 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f27ecff9640 10 client.26123 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f27ecff9640 1 -- 172.21.15.39:0/3726045996 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bdc1581df0 con 0x55bdc1692dd0 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f27ecff9640 10 client.26123 handle_command_reply: tid=0 2024-09-10T21:59:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 1 client.26123 shutdown 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 msgr2=0x55bdc16271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.372+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f27f80abdc0 tx=0x7f27f80abdf0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 shutdown_connections 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55bdc1692dd0 0x55bdc16951f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bdc16159a0 0x55bdc168af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bdc1609a10 0x55bdc1627770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f27ecff9640 0 client.26123 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 --2- 172.21.15.39:0/3726045996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdc16090f0 0x55bdc16271f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 >> 172.21.15.39:0/3726045996 conn(0x55bdc1606f20 msgr2=0x55bdc1610b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 shutdown_connections 2024-09-10T21:59:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 1 -- 172.21.15.39:0/3726045996 wait complete. 2024-09-10T21:59:33.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f2811891740 20 client.26123 trim_cache size 0 max 16384 2024-09-10T21:59:33.379 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:59:33.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 msgr2=0x7f27f00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 0x7f27f00b7820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc031400 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 msgr2=0x7f280819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.373+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27f800eb90 tx=0x7f27f800c6a0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 shutdown_connections 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f27f00b5360 0x7f27f00b7820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280810d130 0x7f28081a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28081045f0 0x7f280819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 --2- 172.21.15.39:0/334613106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2808103cd0 0x7f280819b6b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 >> 172.21.15.39:0/334613106 conn(0x7f28080fd770 msgr2=0x7f28080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 shutdown_connections 2024-09-10T21:59:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:33.374+0000 7f280f4bc640 1 -- 172.21.15.39:0/334613106 wait complete. 2024-09-10T21:59:34.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:59:35.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:34 smithi039 ceph-mon[30872]: pgmap v478: 97 pgs: 97 active+clean; 328 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 2.3 MiB/s wr, 452 op/s 2024-09-10T21:59:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:34 smithi070 ceph-mon[34909]: pgmap v478: 97 pgs: 97 active+clean; 328 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 2.3 MiB/s wr, 452 op/s 2024-09-10T21:59:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:34 smithi173 ceph-mon[35294]: pgmap v478: 97 pgs: 97 active+clean; 328 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 2.3 MiB/s wr, 452 op/s 2024-09-10T21:59:36.501 INFO:tasks.workunit.client.0.smithi039.stdout: 100 1216580 380 831908 350 753041 1078 2024-09-10T21:59:36.853 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:37.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:36 smithi039 ceph-mon[30872]: pgmap v479: 97 pgs: 97 active+clean; 338 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 2.9 MiB/s wr, 453 op/s 2024-09-10T21:59:37.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:36 smithi070 ceph-mon[34909]: pgmap v479: 97 pgs: 97 active+clean; 338 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 2.9 MiB/s wr, 453 op/s 2024-09-10T21:59:37.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:36 smithi173 ceph-mon[35294]: pgmap v479: 97 pgs: 97 active+clean; 338 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 2.9 MiB/s wr, 453 op/s 2024-09-10T21:59:37.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 -- 172.21.15.39:0/2733410898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc1076d0 msgr2=0x7fc2fc107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 --2- 172.21.15.39:0/2733410898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc107b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009900 tx=0x7fc2f002a410 comp rx=0 tx=0).stop 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 -- 172.21.15.39:0/2733410898 shutdown_connections 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 --2- 172.21.15.39:0/2733410898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 --2- 172.21.15.39:0/2733410898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc107b10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 --2- 172.21.15.39:0/2733410898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 -- 172.21.15.39:0/2733410898 >> 172.21.15.39:0/2733410898 conn(0x7fc2fc0fd770 msgr2=0x7fc2fc0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 -- 172.21.15.39:0/2733410898 shutdown_connections 2024-09-10T21:59:37.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.501+0000 7fc301156640 1 -- 172.21.15.39:0/2733410898 wait complete. 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 Processor -- start 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 -- start start 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc111cf0 con 0x7fc2fc1076d0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc111b70 con 0x7fc2fc101cc0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc301156640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc111e70 con 0x7fc2fc108050 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57188/0 (socket says 172.21.15.39:57188) 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.502+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2068126750 learned_addr learned my addr 172.21.15.39:0/2068126750 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2068126750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 msgr2=0x7fc2fc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc1076d0 msgr2=0x7fc2fc1a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc1a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2068126750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc1a2700 con 0x7fc2fc101cc0 2024-09-10T21:59:37.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ea60 tx=0x7fc2ec00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.503+0000 7fc2e3fff640 1 -- 172.21.15.39:0/2068126750 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00cde0 con 0x7fc2fc101cc0 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.504+0000 7fc2e3fff640 1 -- 172.21.15.39:0/2068126750 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec0035f0 con 0x7fc2fc101cc0 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.504+0000 7fc2e3fff640 1 -- 172.21.15.39:0/2068126750 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec010690 con 0x7fc2fc101cc0 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.504+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc1a29f0 con 0x7fc2fc101cc0 2024-09-10T21:59:37.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.504+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1ac2f0 con 0x7fc2fc101cc0 2024-09-10T21:59:37.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.508+0000 7fc30352b740 1 Processor -- start 2024-09-10T21:59:37.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.508+0000 7fc30352b740 1 -- start start 2024-09-10T21:59:37.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.508+0000 7fc2e3fff640 1 -- 172.21.15.39:0/2068126750 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc2ec004020 con 0x7fc2fc101cc0 2024-09-10T21:59:37.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.508+0000 7fc30352b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.508+0000 7fc30352b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 0x556f187fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc30352b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187fad80 0x556f187fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc30352b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556f18764ea0 con 0x556f187ee4d0 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc30352b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f187542d0 con 0x556f187eedf0 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc30352b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556f187580e0 con 0x556f187fad80 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50570/0 (socket says 172.21.15.39:50570) 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fb59e640 1 -- 172.21.15.39:0/2676794230 learned_addr learned my addr 172.21.15.39:0/2676794230 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 0x556f187fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2676794230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187fad80 msgr2=0x556f187fd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187fad80 0x556f187fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2676794230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 msgr2=0x556f187ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.509+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/4099204031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 msgr2=0x7f2fcc10a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.509+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/4099204031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc10a580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009900 tx=0x7f2fbc02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2676794230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f184b2650 con 0x556f187eedf0 2024-09-10T21:59:37.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.509+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/4099204031 shutdown_connections 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/4099204031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 0x7f2fcc111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/4099204031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc10a580 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/4099204031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 0x7f2fcc109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/4099204031 >> 172.21.15.39:0/4099204031 conn(0x7f2fcc0783d0 msgr2=0x7f2fcc07a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/4099204031 shutdown_connections 2024-09-10T21:59:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/4099204031 wait complete. 2024-09-10T21:59:37.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.510+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 0x556f187fa840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0e39f0 tx=0x7fc2ec0ee4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70621622adafc8fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.510+0000 7f2fd2b7d640 1 Processor -- start 2024-09-10T21:59:37.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.510+0000 7fc2e17fa640 1 -- 172.21.15.39:0/2676794230 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0f9070 con 0x556f187eedf0 2024-09-10T21:59:37.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.510+0000 7fc2e3fff640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 0x7fc2e40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.510+0000 7fc2e17fa640 1 -- 172.21.15.39:0/2676794230 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec0f4ab0 con 0x556f187eedf0 2024-09-10T21:59:37.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.510+0000 7fc2e17fa640 1 -- 172.21.15.39:0/2676794230 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0e6980 con 0x556f187eedf0 2024-09-10T21:59:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 -- start start 2024-09-10T21:59:37.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.511+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 0x7fc2e40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 0x7f2fcc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 0x7f2fcc1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.511+0000 7fc2e3fff640 1 -- 172.21.15.39:0/2068126750 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc2ec0e5f10 con 0x7fc2fc101cc0 2024-09-10T21:59:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc114c40 con 0x7f2fcc109230 2024-09-10T21:59:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc114ac0 con 0x7f2fcc10a100 2024-09-10T21:59:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd2b7d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc114dc0 con 0x7f2fcc10aac0 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57218/0 (socket says 172.21.15.39:57218) 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fcbfff640 1 -- 172.21.15.39:0/2786782495 learned_addr learned my addr 172.21.15.39:0/2786782495 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd0919640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 0x7f2fcc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.511+0000 7f2fd111a640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 0x7f2fcc1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 -- 172.21.15.39:0/2786782495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 msgr2=0x7f2fcc1a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 0x7f2fcc1a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 -- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 msgr2=0x7f2fcc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 0x7f2fcc19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 -- 172.21.15.39:0/2786782495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1a0f00 con 0x7f2fcc10a100 2024-09-10T21:59:37.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- 172.21.15.39:0/2676794230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 msgr2=0x556f187fa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc02a9e0 tx=0x7f2fbc003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 0x556f187fa840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0e39f0 tx=0x7fc2ec0ee4b0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 0x7fc2e40b78f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4005c40 tx=0x7fc2f4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- 172.21.15.39:0/2676794230 shutdown_connections 2024-09-10T21:59:37.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187fad80 0x556f187fd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187eedf0 0x556f187fa840 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0e39f0 tx=0x7fc2ec0ee4b0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 --2- 172.21.15.39:0/2676794230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fc9ffb640 1 -- 172.21.15.39:0/2786782495 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc03f070 con 0x7f2fcc10a100 2024-09-10T21:59:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fc9ffb640 1 -- 172.21.15.39:0/2786782495 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc003e40 con 0x7f2fcc10a100 2024-09-10T21:59:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fc9ffb640 1 -- 172.21.15.39:0/2786782495 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc035030 con 0x7f2fcc10a100 2024-09-10T21:59:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.512+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc1a1190 con 0x7f2fcc10a100 2024-09-10T21:59:37.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- 172.21.15.39:0/2676794230 >> 172.21.15.39:0/2676794230 conn(0x556f187ec300 msgr2=0x556f187ed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- 172.21.15.39:0/2676794230 shutdown_connections 2024-09-10T21:59:37.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- 172.21.15.39:0/2676794230 wait complete. 2024-09-10T21:59:37.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 -- start start 2024-09-10T21:59:37.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.512+0000 7fc30352b740 1 Processor -- start 2024-09-10T21:59:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.513+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1a76e0 con 0x7f2fcc10a100 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f18806d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57224/0 (socket says 172.21.15.39:57224) 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50586/0 (socket says 172.21.15.39:50586) 2024-09-10T21:59:37.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fa59c640 1 -- 172.21.15.39:0/2882223517 learned_addr learned my addr 172.21.15.39:0/2882223517 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556f185b5700 con 0x556f187ee4d0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f186ef160 con 0x556f187fad80 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556f187fda00 con 0x556f187f87f0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f18806d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 msgr2=0x556f18806d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f18806d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2882223517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 msgr2=0x556f187f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.513+0000 7fc30352b740 10 client.0 _ll_register_callbacks cb 0x556f187089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2fad9d640 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f1871cc90 con 0x556f187ee4d0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec0f4ab0 con 0x556f187ee4d0 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:37.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2fb59e640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f18806d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x556f187edc50 tx=0x7fc2ec00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7d44d56070ef2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2deff5640 10 client.16524 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2deff5640 1 -- 172.21.15.39:0/2882223517 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0a8d30 con 0x556f187ee4d0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2deff5640 1 -- 172.21.15.39:0/2882223517 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc2ec0037a0 con 0x556f187ee4d0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc2deff5640 1 -- 172.21.15.39:0/2882223517 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec0abe50 con 0x556f187ee4d0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc30352b740 10 client.16524 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.514+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556f188097c0 con 0x556f187ee4d0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc2deff5640 1 -- 172.21.15.39:0/2882223517 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc2ec0a8950 con 0x556f187ee4d0 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 10 client.16524 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 10 client.16524 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 20 client.16524 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1880cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 4 client.16524 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:37.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f18766df0 con 0x556f1880ab10 2024-09-10T21:59:37.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.515+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1880cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc2deff5640 10 client.16524 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:59:37.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1880cf00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51be117ce3e55f94 server_cookie=63bbb4dbe1d0487e in_seq=0 out_seq=0 2024-09-10T21:59:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.516+0000 7f2fd5a23740 1 Processor -- start 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc2deff5640 1 -- 172.21.15.39:0/2882223517 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f18766df0 con 0x556f1880ab10 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc2deff5640 10 client.16524 handle_command_reply: tid=0 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 client.16524 shutdown 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 msgr2=0x556f187f7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x556f187edc50 tx=0x7fc2ec00ef90 comp rx=0 tx=0).stop 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 shutdown_connections 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1880cf00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f18806d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f187f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc2deff5640 0 client.16524 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 --2- 172.21.15.39:0/2882223517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f187f7d70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.516+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 >> 172.21.15.39:0/2882223517 conn(0x556f187ec300 msgr2=0x556f187f1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 -- start start 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fc9ffb640 1 -- 172.21.15.39:0/2786782495 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2fbc03b4f0 con 0x7f2fcc10a100 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 0x5583bfccfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd2bd0 0x5583bfcd5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.528 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5583bfc3f6f0 con 0x5583bfcd0190 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583bfc2eb20 con 0x5583bfccd860 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5583bfc32930 con 0x5583bfcd2bd0 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd0919640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd0919640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50590/0 (socket says 172.21.15.39:50590) 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd0919640 1 -- 172.21.15.39:0/33466689 learned_addr learned my addr 172.21.15.39:0/33466689 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.517+0000 7f2fd111a640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 0x5583bfccfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.529 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd111a640 1 -- 172.21.15.39:0/33466689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd2bd0 msgr2=0x5583bfcd5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.517+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 shutdown_connections 2024-09-10T21:59:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.517+0000 7fc30352b740 1 -- 172.21.15.39:0/2882223517 wait complete. 2024-09-10T21:59:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.517+0000 7fc30352b740 20 client.16524 trim_cache size 0 max 16384 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd2bd0 0x5583bfcd5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd111a640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd2bd0 0x5583bfcd5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd111a640 1 -- 172.21.15.39:0/33466689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 msgr2=0x5583bfcd2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd111a640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd111a640 1 -- 172.21.15.39:0/33466689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583bfbf4530 con 0x5583bfccd860 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.518+0000 7f2fd0919640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fc9ffb640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 0x7f2fb80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fd111a640 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 0x5583bfccfc50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400ada0 tx=0x7f2fc400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a7c05ea7f056bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fc9ffb640 1 -- 172.21.15.39:0/2786782495 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2fbc106800 con 0x7f2fcc10a100 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fd0919640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 0x7f2fb80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fc2ffd640 1 -- 172.21.15.39:0/33466689 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4003b70 con 0x5583bfccd860 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fc2ffd640 1 -- 172.21.15.39:0/33466689 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc4003d10 con 0x5583bfccd860 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.519+0000 7f2fc2ffd640 1 -- 172.21.15.39:0/33466689 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4010aa0 con 0x5583bfccd860 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.520+0000 7f2fd0919640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 0x7f2fb80b78e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400bfd0 tx=0x7f2fb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.520+0000 7f2fd5a23740 1 -- 172.21.15.39:0/33466689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 msgr2=0x5583bfccfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.520+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 0x5583bfccfc50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400ada0 tx=0x7f2fc400f790 comp rx=0 tx=0).stop 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.520+0000 7f2fd5a23740 1 -- 172.21.15.39:0/33466689 shutdown_connections 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.520+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd2bd0 0x5583bfcd5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfcd2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/33466689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfccd860 0x5583bfccfc50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 -- 172.21.15.39:0/33466689 >> 172.21.15.39:0/33466689 conn(0x5583bfcc89b0 msgr2=0x5583bfcc9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 -- 172.21.15.39:0/33466689 shutdown_connections 2024-09-10T21:59:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 -- 172.21.15.39:0/33466689 wait complete. 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 -- start start 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.521+0000 7f2fd5a23740 1 Processor -- start 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfce85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5583bfb66ab0 con 0x5583bfccd860 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583bfbd4730 con 0x5583bfcd2bd0 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5583bfce6bc0 con 0x5583bfcd0190 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd5a23740 10 client.0 _ll_register_callbacks cb 0x5583bfc286b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd111a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd111a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:57244/0 (socket says 172.21.15.39:57244) 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd111a640 1 -- 172.21.15.39:0/3894322723 learned_addr learned my addr 172.21.15.39:0/3894322723 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fd0919640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.522+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfce85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 -- 172.21.15.39:0/3894322723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 msgr2=0x5583bfce85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfce85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 -- 172.21.15.39:0/3894322723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 msgr2=0x5583bfce7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 -- 172.21.15.39:0/3894322723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583bf990790 con 0x5583bfcd2bd0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd111a640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4010a40 tx=0x7f2fc4010a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d211dfe0debe4202 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fabfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4028060 con 0x5583bfcd2bd0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2fc4004a40 con 0x5583bfcd2bd0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.523+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fc4003d10 con 0x5583bfcd2bd0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fc401d040 con 0x5583bfcd2bd0 2024-09-10T21:59:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 10 client.26147 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583bfa09620 con 0x5583bfcd2bd0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc4003d10 con 0x5583bfcd2bd0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f2fc4005030 con 0x5583bfcd2bd0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 10 client.26147 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 10 client.26147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 20 client.26147 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfcf34c0 0x5583bfcf58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 4 client.26147 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.524+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583bfc41640 con 0x5583bfcf34c0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.525+0000 7f2fd0919640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfcf34c0 0x5583bfcf58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.525+0000 7f2fd0919640 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfcf34c0 0x5583bfcf58e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17ebdb229b8b54d server_cookie=961d4eab63bce599 in_seq=0 out_seq=0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.525+0000 7f2fabfff640 10 client.26147 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fabfff640 1 -- 172.21.15.39:0/3894322723 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583bfc41640 con 0x5583bfcf34c0 2024-09-10T21:59:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fabfff640 10 client.26147 handle_command_reply: tid=0 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 client.26147 shutdown 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 msgr2=0x5583bfce9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4010a40 tx=0x7f2fc4010a70 comp rx=0 tx=0).stop 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 shutdown_connections 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfcf34c0 0x5583bfcf58e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfce9180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfce85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/3894322723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fabfff640 0 client.26147 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 >> 172.21.15.39:0/3894322723 conn(0x5583bfcc89b0 msgr2=0x5583bfcc7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.528+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 shutdown_connections 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.529+0000 7f2fd5a23740 1 -- 172.21.15.39:0/3894322723 wait complete. 2024-09-10T21:59:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.529+0000 7f2fd5a23740 20 client.26147 trim_cache size 0 max 16384 2024-09-10T21:59:37.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 Processor -- start 2024-09-10T21:59:37.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 -- start start 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187ee4d0 0x556f187f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f187f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 0x556f187f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b49c0 con 0x556f187fad80 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b65c0 con 0x556f187ee4d0 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.543+0000 7fc30352b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b5090 con 0x556f187f87f0 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 0x556f187f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 0x556f187f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50604/0 (socket says 172.21.15.39:50604) 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f187f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fb59e640 1 -- 172.21.15.39:0/4105236208 learned_addr learned my addr 172.21.15.39:0/4105236208 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187ee4d0 0x556f187f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 -- 172.21.15.39:0/4105236208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187ee4d0 msgr2=0x556f187f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187ee4d0 0x556f187f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 -- 172.21.15.39:0/4105236208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 msgr2=0x556f187f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 0x556f187f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 -- 172.21.15.39:0/4105236208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f187f7b20 con 0x556f187f87f0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f187f6fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x556f187ebcc0 tx=0x7fc2f0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9643c5a79dbe3e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2e0ff9640 1 -- 172.21.15.39:0/4105236208 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0035040 con 0x556f187f87f0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.544+0000 7fc2e0ff9640 1 -- 172.21.15.39:0/4105236208 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f00055b0 con 0x556f187f87f0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc2e0ff9640 1 -- 172.21.15.39:0/4105236208 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0031700 con 0x556f187f87f0 2024-09-10T21:59:37.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 -- 172.21.15.39:0/4105236208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 msgr2=0x556f187f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f187f6fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x556f187ebcc0 tx=0x7fc2f0005fd0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 -- 172.21.15.39:0/4105236208 shutdown_connections 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187fad80 0x556f187f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f187f6fa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 --2- 172.21.15.39:0/4105236208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187ee4d0 0x556f187f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 -- 172.21.15.39:0/4105236208 >> 172.21.15.39:0/4105236208 conn(0x556f187ec300 msgr2=0x556f187ed010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 -- 172.21.15.39:0/4105236208 shutdown_connections 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.545+0000 7fc30352b740 1 -- 172.21.15.39:0/4105236208 wait complete. 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 -- start start 2024-09-10T21:59:37.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 Processor -- start 2024-09-10T21:59:37.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f1880e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f1880ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.546+0000 7fc30352b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b5e30 con 0x556f187ee4d0 2024-09-10T21:59:37.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc30352b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b5760 con 0x556f187fad80 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc30352b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1b29a0 con 0x556f187f87f0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc30352b740 10 client.0 _ll_register_callbacks cb 0x7fc2ec0f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50618/0 (socket says 172.21.15.39:50618) 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f1880ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 -- 172.21.15.39:0/3361440212 learned_addr learned my addr 172.21.15.39:0/3361440212 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f1880e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 -- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 msgr2=0x556f1880e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f1880e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 -- 172.21.15.39:0/3361440212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 msgr2=0x556f1880ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f1880ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.547+0000 7fc2fad9d640 1 -- 172.21.15.39:0/3361440212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f188767b0 con 0x556f187ee4d0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc2fad9d640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0e97e0 tx=0x7fc2ec0e99f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f07d8295be31029 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f1880e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:37.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc2deff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:37.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0ac030 con 0x556f187ee4d0 2024-09-10T21:59:37.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc2ec0e9500 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.548+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2f00055b0 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.549+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec0ac4b0 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.549+0000 7fc30352b740 10 client.16536 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.549+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f18877ab0 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.549+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f00055b0 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc2ec0b57e0 con 0x556f187ee4d0 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 10 client.16536 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 10 client.16536 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 20 client.16536 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1887a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 4 client.16536 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:59:37.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.550+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f187628a0 con 0x556f1880ab10 2024-09-10T21:59:37.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1887a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc2deff5640 10 client.16536 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc2fa59c640 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1887a000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4708e6001645cb76 server_cookie=3daf5cdd1136f31a in_seq=0 out_seq=0 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc2deff5640 1 -- 172.21.15.39:0/3361440212 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f187628a0 con 0x556f1880ab10 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc2deff5640 10 client.16536 handle_command_reply: tid=0 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc30352b740 1 client.16536 shutdown 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 msgr2=0x556f1880dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.551+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0e97e0 tx=0x7fc2ec0e99f0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 shutdown_connections 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x556f1880ab10 0x556f1887a000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f187fad80 0x556f1880ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f187f87f0 0x556f1880e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 --2- 172.21.15.39:0/3361440212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556f187ee4d0 0x556f1880dfa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 >> 172.21.15.39:0/3361440212 conn(0x556f187ec300 msgr2=0x556f187eac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc2deff5640 0 client.16536 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 shutdown_connections 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 1 -- 172.21.15.39:0/3361440212 wait complete. 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.552+0000 7fc30352b740 20 client.16536 trim_cache size 0 max 16384 2024-09-10T21:59:37.555 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:59:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.553+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 msgr2=0x7fc2e40b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.553+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 0x7fc2e40b78f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4005c40 tx=0x7fc2f4009500 comp rx=0 tx=0).stop 2024-09-10T21:59:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.553+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 msgr2=0x7fc2fc19fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.553+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ea60 tx=0x7fc2ec00ef20 comp rx=0 tx=0).stop 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.553+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 shutdown_connections 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc2e40b5430 0x7fc2e40b78f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2fc108050 0x7fc2fc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2fc1076d0 0x7fc2fc1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 --2- 172.21.15.39:0/2068126750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2fc101cc0 0x7fc2fc19fb60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 >> 172.21.15.39:0/2068126750 conn(0x7fc2fc0fd770 msgr2=0x7fc2fc100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 shutdown_connections 2024-09-10T21:59:37.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:37.554+0000 7fc301156640 1 -- 172.21.15.39:0/2068126750 wait complete. 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.561+0000 7f2fd5a23740 1 Processor -- start 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.561+0000 7f2fd5a23740 1 -- start start 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfccbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfcfa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50634/0 (socket says 172.21.15.39:50634) 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 -- 172.21.15.39:0/1191030693 learned_addr learned my addr 172.21.15.39:0/1191030693 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd111a640 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfcfa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfccbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a7cd0 con 0x5583bfccd860 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a98d0 con 0x5583bfcd2bd0 2024-09-10T21:59:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a83a0 con 0x5583bfcd0190 2024-09-10T21:59:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 -- 172.21.15.39:0/1191030693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 msgr2=0x5583bfccbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfccbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 -- 172.21.15.39:0/1191030693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 msgr2=0x5583bfcfa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.562+0000 7f2fd0919640 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfcfa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.563+0000 7f2fd0919640 1 -- 172.21.15.39:0/1191030693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583bfccc440 con 0x5583bfccd860 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.563+0000 7f2fd0919640 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400b740 tx=0x7f2fb4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dd3511841aaa3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.563+0000 7f2fc27fc640 1 -- 172.21.15.39:0/1191030693 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb401ea70 con 0x5583bfccd860 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.563+0000 7f2fc27fc640 1 -- 172.21.15.39:0/1191030693 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb401ec10 con 0x5583bfccd860 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.563+0000 7f2fc27fc640 1 -- 172.21.15.39:0/1191030693 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40316b0 con 0x5583bfccd860 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 msgr2=0x5583bfce9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400b740 tx=0x7f2fb4016000 comp rx=0 tx=0).stop 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 shutdown_connections 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfcfa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfcd0190 0x5583bfccbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/1191030693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfccd860 0x5583bfce9160 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.564+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 >> 172.21.15.39:0/1191030693 conn(0x5583bfcc89b0 msgr2=0x5583bfcca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.565+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 shutdown_connections 2024-09-10T21:59:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.565+0000 7f2fd5a23740 1 -- 172.21.15.39:0/1191030693 wait complete. 2024-09-10T21:59:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.565+0000 7f2fd5a23740 1 -- start start 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.565+0000 7f2fd5a23740 1 Processor -- start 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.565+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 0x5583bfcefbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfd5c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfd5eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a9140 con 0x5583bfcd0190 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a8a70 con 0x5583bfcd2bd0 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc082460 con 0x5583bfccd860 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd5a23740 10 client.0 _ll_register_callbacks cb 0x7f2fb400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfd5c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 0x5583bfcefbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfd5c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50636/0 (socket says 172.21.15.39:50636) 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fcbfff640 1 -- 172.21.15.39:0/4276075621 learned_addr learned my addr 172.21.15.39:0/4276075621 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd111a640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfd5eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 -- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 msgr2=0x5583bfd5eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfd5eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 -- 172.21.15.39:0/4276075621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 msgr2=0x5583bfd5c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfd5c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.566+0000 7f2fd0919640 1 -- 172.21.15.39:0/4276075621 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583bfd5f2f0 con 0x5583bfccd860 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fd0919640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 0x5583bfcefbc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400baa0 tx=0x7f2fb4005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa141cf014a30007 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fabfff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4005240 con 0x5583bfccd860 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2fb40053e0 con 0x5583bfccd860 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb401ec10 con 0x5583bfccd860 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fb4041050 con 0x5583bfccd860 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fd5a23740 10 client.26095 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.567+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583bfd606a0 con 0x5583bfccd860 2024-09-10T21:59:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb401ec10 con 0x5583bfccd860 2024-09-10T21:59:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f2fb40048f0 con 0x5583bfccd860 2024-09-10T21:59:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 10 client.26095 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 10 client.26095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 20 client.26095 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfd61130 0x5583bfd63550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 4 client.26095 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583bfc3d0f0 con 0x5583bfd61130 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.568+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfd61130 0x5583bfd63550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.569+0000 7f2fabfff640 10 client.26095 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:37.569+0000 7f2fcbfff640 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfd61130 0x5583bfd63550 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2e410d6eaa811a server_cookie=4999ee178b562b63 in_seq=0 out_seq=0 2024-09-10T21:59:38.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:59:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:38 smithi070 ceph-mon[34909]: pgmap v480: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2024-09-10T21:59:39.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:38 smithi039 ceph-mon[30872]: pgmap v480: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2024-09-10T21:59:39.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:38 smithi173 ceph-mon[35294]: pgmap v480: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 494 op/s 2024-09-10T21:59:39.744 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:40.777 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:40 smithi039 ceph-mon[30872]: pgmap v481: 97 pgs: 97 active+clean; 352 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 419 op/s 2024-09-10T21:59:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.051+0000 7fd533ef9640 1 -- 172.21.15.39:0/3335082742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c11c0a0 msgr2=0x7fd52c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.051+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3335082742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c11c0a0 0x7fd52c11e490 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd51c01a910 tx=0x7fd51c03b500 comp rx=0 tx=0).stop 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.063+0000 7fd533ef9640 1 -- 172.21.15.39:0/3335082742 shutdown_connections 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.063+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3335082742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c11c0a0 0x7fd52c11e490 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.063+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3335082742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.063+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3335082742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c10a150 0x7fd52c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.063+0000 7fd533ef9640 1 -- 172.21.15.39:0/3335082742 >> 172.21.15.39:0/3335082742 conn(0x7fd52c06dfc0 msgr2=0x7fd52c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.067+0000 7fd533ef9640 1 -- 172.21.15.39:0/3335082742 shutdown_connections 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.067+0000 7fd533ef9640 1 -- 172.21.15.39:0/3335082742 wait complete. 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 Processor -- start 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 -- start start 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c10a150 0x7fd52c117730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c11c0a0 0x7fd52c1a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1140c0 con 0x7fd52c10a150 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c113f40 con 0x7fd52c10a530 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd533ef9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c114240 con 0x7fd52c11c0a0 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd531494640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd531494640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34534/0 (socket says 172.21.15.39:34534) 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.068+0000 7fd531494640 1 -- 172.21.15.39:0/3803542070 learned_addr learned my addr 172.21.15.39:0/3803542070 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531c95640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c10a150 0x7fd52c117730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd532496640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c11c0a0 0x7fd52c1a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531494640 1 -- 172.21.15.39:0/3803542070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c11c0a0 msgr2=0x7fd52c1a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531494640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c11c0a0 0x7fd52c1a5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531494640 1 -- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c10a150 msgr2=0x7fd52c117730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531494640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c10a150 0x7fd52c117730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.072+0000 7fd531494640 1 -- 172.21.15.39:0/3803542070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c1a5810 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.073+0000 7fd531494640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd52400cce0 tx=0x7fd52400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.079+0000 7fd522ffd640 1 -- 172.21.15.39:0/3803542070 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52400f650 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.079+0000 7fd522ffd640 1 -- 172.21.15.39:0/3803542070 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd52400fca0 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.079+0000 7fd522ffd640 1 -- 172.21.15.39:0/3803542070 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524018b40 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.080+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c1a5b00 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.080+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c1ac110 con 0x7fd52c10a530 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.087+0000 7fd5362ce740 1 Processor -- start 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.088+0000 7fd5362ce740 1 -- start start 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.088+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a7468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.088+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a752840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a755170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd5362ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c61a6bcea0 con 0x55c61a7464d0 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd5362ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c61a6ac2d0 con 0x55c61a752d80 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd5362ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c61a6b00e0 con 0x55c61a746df0 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd522ffd640 1 -- 172.21.15.39:0/3803542070 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd52400f7f0 con 0x7fd52c10a530 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd532496640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a7468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd532496640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a7468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47738/0 (socket says 172.21.15.39:47738) 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.089+0000 7fd532496640 1 -- 172.21.15.39:0/1544234379 learned_addr learned my addr 172.21.15.39:0/1544234379 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a755170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 -- 172.21.15.39:0/1544234379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 msgr2=0x55c61a752840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a752840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 -- 172.21.15.39:0/1544234379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 msgr2=0x55c61a7468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a7468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.092+0000 7fd531494640 1 -- 172.21.15.39:0/1544234379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61a40a650 con 0x55c61a752d80 2024-09-10T21:59:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.094+0000 7fd522ffd640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 0x7fd5180b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.099+0000 7fd532496640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 0x7fd5180b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.100+0000 7fd522ffd640 1 -- 172.21.15.39:0/3803542070 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd5240e5f90 con 0x7fd52c10a530 2024-09-10T21:59:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.100+0000 7fd532496640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 0x7fd5180b79b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0048f0 tx=0x7fd51c03ba00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.101+0000 7fd531494640 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a755170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5240e39e0 tx=0x7fd5240ee1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a8cc5a0b5d3e705 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.108+0000 7fd517fff640 1 -- 172.21.15.39:0/1544234379 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5240a8d50 con 0x55c61a752d80 2024-09-10T21:59:41.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.108+0000 7fd517fff640 1 -- 172.21.15.39:0/1544234379 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5240ac210 con 0x55c61a752d80 2024-09-10T21:59:41.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.109+0000 7fd5362ce740 1 -- 172.21.15.39:0/1544234379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 msgr2=0x55c61a755170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.109+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a755170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5240e39e0 tx=0x7fd5240ee1a0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.113+0000 7fd5362ce740 1 -- 172.21.15.39:0/1544234379 shutdown_connections 2024-09-10T21:59:41.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.113+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a755170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.113+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a752840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.113+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1544234379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a7468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.113+0000 7fd5362ce740 1 -- 172.21.15.39:0/1544234379 >> 172.21.15.39:0/1544234379 conn(0x55c61a744300 msgr2=0x55c61a7454a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.118+0000 7fd5362ce740 1 -- 172.21.15.39:0/1544234379 shutdown_connections 2024-09-10T21:59:41.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.124+0000 7fd5362ce740 1 -- 172.21.15.39:0/1544234379 wait complete. 2024-09-10T21:59:41.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.124+0000 7fd5362ce740 1 -- start start 2024-09-10T21:59:41.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.124+0000 7fd5362ce740 1 Processor -- start 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a7464d0 0x55c61a752700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a74fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c61a50d700 con 0x55c61a752d80 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c61a647160 con 0x55c61a746df0 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.130+0000 7fd5362ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c61a755a50 con 0x55c61a7464d0 2024-09-10T21:59:41.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.131+0000 7fd5362ce740 10 client.0 _ll_register_callbacks cb 0x55c61a6609e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:41.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.135+0000 7fd531c95640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a7464d0 0x55c61a752700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.136+0000 7fd532496640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.136+0000 7fd532496640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47750/0 (socket says 172.21.15.39:47750) 2024-09-10T21:59:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.136+0000 7fd532496640 1 -- 172.21.15.39:0/3577864237 learned_addr learned my addr 172.21.15.39:0/3577864237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:41.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.136+0000 7fd531494640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a74fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 -- 172.21.15.39:0/3577864237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a7464d0 msgr2=0x55c61a752700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a7464d0 0x55c61a752700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 -- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 msgr2=0x55c61a74fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a74fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 -- 172.21.15.39:0/3577864237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61a674c90 con 0x55c61a752d80 2024-09-10T21:59:41.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.142+0000 7fd532496640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006010 tx=0x7fd51c03b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482e436f09e29bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.143+0000 7fd5157fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T21:59:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.143+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0405d0 con 0x55c61a752d80 2024-09-10T21:59:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.143+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c61a6bedf0 con 0x55c61a752d80 2024-09-10T21:59:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.143+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd51c019040 con 0x55c61a752d80 2024-09-10T21:59:41.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.147+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd51c040770 con 0x55c61a752d80 2024-09-10T21:59:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.150+0000 7fd5362ce740 10 client.16554 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.150+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c61a761590 con 0x55c61a752d80 2024-09-10T21:59:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c61a6bedf0 con 0x55c61a752d80 2024-09-10T21:59:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd51c04e9d0 con 0x55c61a752d80 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 10 client.16554 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 20 client.16554 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a762fa0 0x55c61a765400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 4 client.16554 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.153+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c61a6ba8a0 con 0x55c61a762fa0 2024-09-10T21:59:41.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:40 smithi070 ceph-mon[34909]: pgmap v481: 97 pgs: 97 active+clean; 352 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 419 op/s 2024-09-10T21:59:41.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.155+0000 7fd531c95640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a762fa0 0x55c61a765400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.168+0000 7fd5157fa640 10 client.16554 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:41.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.168+0000 7fd531c95640 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a762fa0 0x55c61a765400 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84cdeadd42b74ea6 server_cookie=6820d76667b96a2f in_seq=0 out_seq=0 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.175+0000 7fd5157fa640 1 -- 172.21.15.39:0/3577864237 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c61a6ba8a0 con 0x55c61a762fa0 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.175+0000 7fd5157fa640 10 client.16554 handle_command_reply: tid=0 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.175+0000 7fd5362ce740 1 client.16554 shutdown 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.175+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 msgr2=0x55c61a750220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.175+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006010 tx=0x7fd51c03b500 comp rx=0 tx=0).stop 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 shutdown_connections 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a762fa0 0x55c61a765400 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a752d80 0x55c61a750220 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a74fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 --2- 172.21.15.39:0/3577864237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a7464d0 0x55c61a752700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 >> 172.21.15.39:0/3577864237 conn(0x55c61a744300 msgr2=0x55c61a749e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.177+0000 7fd5157fa640 0 client.16554 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:41.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.179+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 shutdown_connections 2024-09-10T21:59:41.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.180+0000 7fd5362ce740 1 -- 172.21.15.39:0/3577864237 wait complete. 2024-09-10T21:59:41.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.183+0000 7fd5362ce740 20 client.16554 trim_cache size 0 max 16384 2024-09-10T21:59:41.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.216+0000 7fd5362ce740 1 Processor -- start 2024-09-10T21:59:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 -- start start 2024-09-10T21:59:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a74a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a752d80 0x55c61a743c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000e580 con 0x55c61a7464d0 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd510010180 con 0x55c61a746df0 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd5362ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000ec50 con 0x55c61a752d80 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd531494640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd531c95640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a74a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd531494640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34552/0 (socket says 172.21.15.39:34552) 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd531494640 1 -- 172.21.15.39:0/599651466 learned_addr learned my addr 172.21.15.39:0/599651466 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.220+0000 7fd532496640 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a752d80 0x55c61a743c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.221+0000 7fd531494640 1 -- 172.21.15.39:0/599651466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a752d80 msgr2=0x55c61a743c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.221+0000 7fd531494640 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a752d80 0x55c61a743c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.221+0000 7fd531494640 1 -- 172.21.15.39:0/599651466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 msgr2=0x55c61a74a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.221+0000 7fd531494640 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a74a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.221+0000 7fd531494640 1 -- 172.21.15.39:0/599651466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61a74e050 con 0x55c61a746df0 2024-09-10T21:59:41.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.229+0000 7fd531494640 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5240ac400 tx=0x7fd524018600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ecd9eb3dfdfef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.231+0000 7fd5177fe640 1 -- 172.21.15.39:0/599651466 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5240ac050 con 0x55c61a746df0 2024-09-10T21:59:41.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.231+0000 7fd5177fe640 1 -- 172.21.15.39:0/599651466 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5240ac210 con 0x55c61a746df0 2024-09-10T21:59:41.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.231+0000 7fd5177fe640 1 -- 172.21.15.39:0/599651466 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5240ac4d0 con 0x55c61a746df0 2024-09-10T21:59:41.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.235+0000 7fd5362ce740 1 -- 172.21.15.39:0/599651466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 msgr2=0x55c61a7652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.235+0000 7fd5362ce740 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5240ac400 tx=0x7fd524018600 comp rx=0 tx=0).stop 2024-09-10T21:59:41.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.239+0000 7fd5362ce740 1 -- 172.21.15.39:0/599651466 shutdown_connections 2024-09-10T21:59:41.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.239+0000 7fd5362ce740 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a752d80 0x55c61a743c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.239+0000 7fd5362ce740 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a746df0 0x55c61a7652e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.239+0000 7fd5362ce740 1 --2- 172.21.15.39:0/599651466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a74a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.239+0000 7fd5362ce740 1 -- 172.21.15.39:0/599651466 >> 172.21.15.39:0/599651466 conn(0x55c61a744300 msgr2=0x55c61a751180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:40 smithi173 ceph-mon[35294]: pgmap v481: 97 pgs: 97 active+clean; 352 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 419 op/s 2024-09-10T21:59:41.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.244+0000 7fd5362ce740 1 -- 172.21.15.39:0/599651466 shutdown_connections 2024-09-10T21:59:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.246+0000 7fd5362ce740 1 -- 172.21.15.39:0/599651466 wait complete. 2024-09-10T21:59:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.247+0000 7fd5362ce740 1 -- start start 2024-09-10T21:59:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.247+0000 7fd5362ce740 1 Processor -- start 2024-09-10T21:59:41.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a75b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a753f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a754680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000f9f0 con 0x55c61a7464d0 2024-09-10T21:59:41.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000f320 con 0x55c61a752d80 2024-09-10T21:59:41.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000c560 con 0x55c61a746df0 2024-09-10T21:59:41.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.252+0000 7fd5362ce740 10 client.0 _ll_register_callbacks cb 0x7fd51c01a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:41.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.253+0000 7fd532496640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a754680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.253+0000 7fd532496640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a754680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34558/0 (socket says 172.21.15.39:34558) 2024-09-10T21:59:41.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.253+0000 7fd532496640 1 -- 172.21.15.39:0/1273843286 learned_addr learned my addr 172.21.15.39:0/1273843286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.254+0000 7fd531494640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a753f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.254+0000 7fd531c95640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a75b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531494640 1 -- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 msgr2=0x55c61a754680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531494640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a754680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531494640 1 -- 172.21.15.39:0/1273843286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 msgr2=0x55c61a75b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531494640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a75b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531494640 1 -- 172.21.15.39:0/1273843286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61a75a310 con 0x55c61a746df0 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.255+0000 7fd531c95640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a75b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.256+0000 7fd531494640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a753f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c61a738de0 tx=0x7fd5240a8ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0c4c0d047cbc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:41.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.257+0000 7fd5157fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:41.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.261+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5240a85a0 con 0x55c61a746df0 2024-09-10T21:59:41.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.261+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd5240acb70 con 0x55c61a746df0 2024-09-10T21:59:41.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.263+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5240ac210 con 0x55c61a746df0 2024-09-10T21:59:41.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.270+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5240ac4d0 con 0x55c61a746df0 2024-09-10T21:59:41.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.271+0000 7fd5362ce740 10 client.26104 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:41.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.271+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c61a7d00e0 con 0x55c61a746df0 2024-09-10T21:59:41.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.273+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5240ac210 con 0x55c61a746df0 2024-09-10T21:59:41.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.273+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd5240b5800 con 0x55c61a746df0 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 10 client.26104 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 10 client.26104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 20 client.26104 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a7d0310 0x55c61a7d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 4 client.26104 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.274+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c61a6b7cd0 con 0x55c61a7d0310 2024-09-10T21:59:41.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.276+0000 7fd531c95640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a7d0310 0x55c61a7d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:41.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.282+0000 7fd531c95640 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a7d0310 0x55c61a7d2700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=739d46a2e69edb4 server_cookie=ff4e31194fbe15e3 in_seq=0 out_seq=0 2024-09-10T21:59:41.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.282+0000 7fd5157fa640 10 client.26104 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:41.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.286+0000 7fd5157fa640 1 -- 172.21.15.39:0/1273843286 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c61a6b7cd0 con 0x55c61a7d0310 2024-09-10T21:59:41.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.286+0000 7fd5157fa640 10 client.26104 handle_command_reply: tid=0 2024-09-10T21:59:41.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.287+0000 7fd5362ce740 1 client.26104 shutdown 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.290+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 msgr2=0x55c61a753f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.290+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a753f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c61a738de0 tx=0x7fd5240a8ba0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.290+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 shutdown_connections 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.290+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c61a7d0310 0x55c61a7d2700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.290+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c61a752d80 0x55c61a754680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.291+0000 7fd5157fa640 0 client.26104 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.291+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c61a746df0 0x55c61a753f90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.291+0000 7fd5362ce740 1 --2- 172.21.15.39:0/1273843286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c61a7464d0 0x55c61a75b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.291+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 >> 172.21.15.39:0/1273843286 conn(0x55c61a744300 msgr2=0x55c61a7519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.294+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 shutdown_connections 2024-09-10T21:59:41.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.294+0000 7fd5362ce740 1 -- 172.21.15.39:0/1273843286 wait complete. 2024-09-10T21:59:41.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.295+0000 7fd5362ce740 20 client.26104 trim_cache size 0 max 16384 2024-09-10T21:59:41.298 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.301+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 msgr2=0x7fd5180b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.301+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 0x7fd5180b79b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0048f0 tx=0x7fd51c03ba00 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.301+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 msgr2=0x7fd52c117c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.301+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd52400cce0 tx=0x7fd52400a620 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 shutdown_connections 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd5180b54f0 0x7fd5180b79b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c11c0a0 0x7fd52c1a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52c10a530 0x7fd52c117c70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 --2- 172.21.15.39:0/3803542070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd52c10a150 0x7fd52c117730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 >> 172.21.15.39:0/3803542070 conn(0x7fd52c06dfc0 msgr2=0x7fd52c0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 shutdown_connections 2024-09-10T21:59:41.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:41.302+0000 7fd533ef9640 1 -- 172.21.15.39:0/3803542070 wait complete. 2024-09-10T21:59:42.777 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:42 smithi039 ceph-mon[30872]: pgmap v482: 97 pgs: 97 active+clean; 356 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 311 op/s 2024-09-10T21:59:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:42 smithi070 ceph-mon[34909]: pgmap v482: 97 pgs: 97 active+clean; 356 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 311 op/s 2024-09-10T21:59:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:42 smithi173 ceph-mon[35294]: pgmap v482: 97 pgs: 97 active+clean; 356 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 311 op/s 2024-09-10T21:59:43.526 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:59:43.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:59:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.030+0000 7f2fabfff640 1 -- 172.21.15.39:0/4276075621 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583bfc3d0f0 con 0x5583bfd61130 2024-09-10T21:59:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.030+0000 7f2fabfff640 10 client.26095 handle_command_reply: tid=0 2024-09-10T21:59:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.030+0000 7f2fd5a23740 1 client.26095 shutdown 2024-09-10T21:59:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.031+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 msgr2=0x5583bfcefbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.031+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 0x5583bfcefbc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400baa0 tx=0x7f2fb4005d40 comp rx=0 tx=0).stop 2024-09-10T21:59:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 shutdown_connections 2024-09-10T21:59:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5583bfd61130 0x5583bfd63550 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583bfcd2bd0 0x5583bfd5eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5583bfcd0190 0x5583bfd5c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 --2- 172.21.15.39:0/4276075621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583bfccd860 0x5583bfcefbc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 >> 172.21.15.39:0/4276075621 conn(0x5583bfcc89b0 msgr2=0x5583bfcca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fabfff640 0 client.26095 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 shutdown_connections 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 1 -- 172.21.15.39:0/4276075621 wait complete. 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.032+0000 7f2fd5a23740 20 client.26095 trim_cache size 0 max 16384 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:59:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 msgr2=0x7f2fb80b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 0x7f2fb80b78e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400bfd0 tx=0x7f2fb400b390 comp rx=0 tx=0).stop 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 msgr2=0x7f2fcc19fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc02a9e0 tx=0x7f2fbc003cd0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 shutdown_connections 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2fb80b5420 0x7f2fb80b78e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fcc10aac0 0x7f2fcc1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fcc10a100 0x7f2fcc19fa10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 --2- 172.21.15.39:0/2786782495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fcc109230 0x7f2fcc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.046+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 >> 172.21.15.39:0/2786782495 conn(0x7f2fcc0783d0 msgr2=0x7f2fcc10d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.047+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 shutdown_connections 2024-09-10T21:59:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:44.047+0000 7f2fd2b7d640 1 -- 172.21.15.39:0/2786782495 wait complete. 2024-09-10T21:59:44.964 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:45.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:44 smithi070 ceph-mon[34909]: pgmap v483: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-10T21:59:45.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:44 smithi039 ceph-mon[30872]: pgmap v483: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-10T21:59:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:44 smithi173 ceph-mon[35294]: pgmap v483: 97 pgs: 97 active+clean; 350 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 -- 172.21.15.39:0/3678095446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374075e60 msgr2=0x7f03741135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3678095446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374075e60 0x7f03741135d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).stop 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 -- 172.21.15.39:0/3678095446 shutdown_connections 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3678095446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0374113b10 0x7f0374115f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3678095446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374075e60 0x7f03741135d0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).stop 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3678095446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f0374075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.069+0000 7f037b4d6640 1 -- 172.21.15.39:0/3678095446 >> 172.21.15.39:0/3678095446 conn(0x7f03740fe860 msgr2=0x7f0374100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.073+0000 7f037b4d6640 1 -- 172.21.15.39:0/3678095446 shutdown_connections 2024-09-10T21:59:46.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.073+0000 7f037b4d6640 1 -- 172.21.15.39:0/3678095446 wait complete. 2024-09-10T21:59:46.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 Processor -- start 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 -- start start 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f037419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374113b10 0x7f03741a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0374119460 con 0x7f0374075540 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03741192e0 con 0x7f03741a5430 2024-09-10T21:59:46.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.074+0000 7f037b4d6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03741195e0 con 0x7f0374113b10 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34578/0 (socket says 172.21.15.39:34578) 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 -- 172.21.15.39:0/3208494889 learned_addr learned my addr 172.21.15.39:0/3208494889 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 -- 172.21.15.39:0/3208494889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374113b10 msgr2=0x7f03741a0090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374113b10 0x7f03741a0090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 -- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 msgr2=0x7f037419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379272640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f037419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f037419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.077+0000 7f0379a73640 1 -- 172.21.15.39:0/3208494889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03741a5fe0 con 0x7f03741a5430 2024-09-10T21:59:46.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.078+0000 7f0379272640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f037419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:59:46.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.082+0000 7f0379a73640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f036c00eb40 tx=0x7f036c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.086+0000 7f036a7fc640 1 -- 172.21.15.39:0/3208494889 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c004b20 con 0x7f03741a5430 2024-09-10T21:59:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.086+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0374106da0 con 0x7f03741a5430 2024-09-10T21:59:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.086+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0374107360 con 0x7f03741a5430 2024-09-10T21:59:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.086+0000 7f036a7fc640 1 -- 172.21.15.39:0/3208494889 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036c004cc0 con 0x7f03741a5430 2024-09-10T21:59:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.086+0000 7f036a7fc640 1 -- 172.21.15.39:0/3208494889 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c010720 con 0x7f03741a5430 2024-09-10T21:59:46.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.091+0000 7f037d8ab740 1 Processor -- start 2024-09-10T21:59:46.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.091+0000 7f037d8ab740 1 -- start start 2024-09-10T21:59:46.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e27ee0 0x55c440e282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 0x55c440e36b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c440d9ee60 con 0x55c440e28800 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c440d8e290 con 0x55c440e34790 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.095+0000 7f037d8ab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c440d920a0 con 0x55c440e27ee0 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.096+0000 7f0379272640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.096+0000 7f0379272640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47790/0 (socket says 172.21.15.39:47790) 2024-09-10T21:59:46.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.096+0000 7f0379272640 1 -- 172.21.15.39:0/999991459 learned_addr learned my addr 172.21.15.39:0/999991459 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:46.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.096+0000 7f0378a71640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e27ee0 0x55c440e282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.097+0000 7f0378a71640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 0x55c440e36b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.098+0000 7f036a7fc640 1 -- 172.21.15.39:0/3208494889 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f036c005020 con 0x7f03741a5430 2024-09-10T21:59:46.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.098+0000 7f0379272640 1 -- 172.21.15.39:0/999991459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e27ee0 msgr2=0x55c440e282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.098+0000 7f0379272640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e27ee0 0x55c440e282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.099+0000 7f0379272640 1 -- 172.21.15.39:0/999991459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 msgr2=0x55c440e36b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.099+0000 7f0379272640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 0x55c440e36b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.099+0000 7f0379272640 1 -- 172.21.15.39:0/999991459 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c440aec930 con 0x55c440e28800 2024-09-10T21:59:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.099+0000 7f0378a71640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 0x55c440e36b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:59:46.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.099+0000 7f0379272640 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f037000a9f0 tx=0x7f037000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbddfaafa575f8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.102+0000 7f036a7fc640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 0x7f03600b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.103+0000 7f036a7fc640 1 -- 172.21.15.39:0/3208494889 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f036c0e6290 con 0x7f03741a5430 2024-09-10T21:59:46.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.103+0000 7f0378a71640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 0x7f03600b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.105+0000 7f0378a71640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 0x7f03600b7970 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0364005fd0 tx=0x7f0364000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.106+0000 7f035f7fe640 1 -- 172.21.15.39:0/999991459 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370015070 con 0x55c440e28800 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.106+0000 7f035f7fe640 1 -- 172.21.15.39:0/999991459 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037000cc60 con 0x55c440e28800 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.106+0000 7f035f7fe640 1 -- 172.21.15.39:0/999991459 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700185c0 con 0x55c440e28800 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.108+0000 7f037d8ab740 1 -- 172.21.15.39:0/999991459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 msgr2=0x55c440e34250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.108+0000 7f037d8ab740 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f037000a9f0 tx=0x7f037000aeb0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.113+0000 7f037d8ab740 1 -- 172.21.15.39:0/999991459 shutdown_connections 2024-09-10T21:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.113+0000 7f037d8ab740 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e34790 0x55c440e36b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.113+0000 7f037d8ab740 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e34250 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.113+0000 7f037d8ab740 1 --2- 172.21.15.39:0/999991459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e27ee0 0x55c440e282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.113+0000 7f037d8ab740 1 -- 172.21.15.39:0/999991459 >> 172.21.15.39:0/999991459 conn(0x55c440e25d10 msgr2=0x55c440e26eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.116+0000 7f037d8ab740 1 -- 172.21.15.39:0/999991459 shutdown_connections 2024-09-10T21:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.120+0000 7f037d8ab740 1 -- 172.21.15.39:0/999991459 wait complete. 2024-09-10T21:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.120+0000 7f037d8ab740 1 -- start start 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.120+0000 7f037d8ab740 1 Processor -- start 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.123+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.123+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.123+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 0x55c440e32170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.124+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.124+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34600/0 (socket says 172.21.15.39:34600) 2024-09-10T21:59:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f0379a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 0x55c440e32170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f0379a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 0x55c440e32170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47804/0 (socket says 172.21.15.39:47804) 2024-09-10T21:59:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f037d8ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c440bef890 con 0x55c440e34790 2024-09-10T21:59:46.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f037d8ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c440d28d40 con 0x55c440e27ee0 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f037d8ab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c440e37440 con 0x55c440e28800 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.128+0000 7f037d8ab740 10 client.0 _ll_register_callbacks cb 0x55c440d8cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.129+0000 7f0378a71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.129+0000 7f0378a71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47074/0 (socket says 172.21.15.39:47074) 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.129+0000 7f0378a71640 1 -- 172.21.15.39:0/963989899 learned_addr learned my addr 172.21.15.39:0/963989899 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:46.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0378a71640 1 -- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 msgr2=0x55c440e316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0378a71640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0378a71640 1 -- 172.21.15.39:0/963989899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 msgr2=0x55c440e32170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0378a71640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 0x55c440e32170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0378a71640 1 -- 172.21.15.39:0/963989899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c440e40820 con 0x55c440e28800 2024-09-10T21:59:46.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.130+0000 7f0379272640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:46.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.138+0000 7f0378a71640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d0db8506b5ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.138+0000 7f035cff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:46.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.138+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036404d070 con 0x55c440e28800 2024-09-10T21:59:46.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.138+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f03640048c0 con 0x55c440e28800 2024-09-10T21:59:46.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.141+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f037000cc60 con 0x55c440e28800 2024-09-10T21:59:46.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.145+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0364057050 con 0x55c440e28800 2024-09-10T21:59:46.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.147+0000 7f037d8ab740 10 client.26113 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:46.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.147+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c440e43200 con 0x55c440e28800 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.150+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037000cc60 con 0x55c440e28800 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0364045070 con 0x55c440e28800 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 10 client.26113 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 10 client.26113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 20 client.26113 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440e44b40 0x55c440e47000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 4 client.26113 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.152+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c440da0db0 con 0x55c440e44b40 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.153+0000 7f0379272640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440e44b40 0x55c440e47000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.158+0000 7f0379272640 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440e44b40 0x55c440e47000 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94c546fff487339 server_cookie=4b4b85a4693922e2 in_seq=0 out_seq=0 2024-09-10T21:59:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.160+0000 7f035cff9640 10 client.26113 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.165+0000 7f035cff9640 1 -- 172.21.15.39:0/963989899 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c440da0db0 con 0x55c440e44b40 2024-09-10T21:59:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.165+0000 7f035cff9640 10 client.26113 handle_command_reply: tid=0 2024-09-10T21:59:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.165+0000 7f037d8ab740 1 client.26113 shutdown 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 msgr2=0x55c440e31c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a410 comp rx=0 tx=0).stop 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 shutdown_connections 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440e44b40 0x55c440e47000 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e34790 0x55c440e32170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e28800 0x55c440e31c30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 --2- 172.21.15.39:0/963989899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 >> 172.21.15.39:0/963989899 conn(0x55c440e25d10 msgr2=0x55c440e24f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f035cff9640 0 client.26113 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 shutdown_connections 2024-09-10T21:59:46.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 1 -- 172.21.15.39:0/963989899 wait complete. 2024-09-10T21:59:46.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.169+0000 7f037d8ab740 20 client.26113 trim_cache size 0 max 16384 2024-09-10T21:59:46.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.210+0000 7f037d8ab740 1 Processor -- start 2024-09-10T21:59:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.210+0000 7f037d8ab740 1 -- start start 2024-09-10T21:59:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.210+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.210+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e2e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34604/0 (socket says 172.21.15.39:34604) 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f0378a71640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f0378a71640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47812/0 (socket says 172.21.15.39:47812) 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f0379272640 1 -- 172.21.15.39:0/3539435371 learned_addr learned my addr 172.21.15.39:0/3539435371 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f037d8ab740 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e4c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f035800e320 con 0x55c440e28800 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.211+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f035800ff20 con 0x55c440e27ee0 2024-09-10T21:59:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.212+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f035800e9f0 con 0x55c440e34790 2024-09-10T21:59:46.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.212+0000 7f0379a73640 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e4c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.213+0000 7f0378a71640 1 -- 172.21.15.39:0/3539435371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 msgr2=0x55c440e4c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.213+0000 7f0378a71640 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e4c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.213+0000 7f0378a71640 1 -- 172.21.15.39:0/3539435371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 msgr2=0x55c440e2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.213+0000 7f0378a71640 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.213+0000 7f0378a71640 1 -- 172.21.15.39:0/3539435371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c440e26790 con 0x55c440e28800 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.214+0000 7f0378a71640 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f036402aa00 tx=0x7f0364005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8130891b2e32c2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.215+0000 7f035effd640 1 -- 172.21.15.39:0/3539435371 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036404d070 con 0x55c440e28800 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.215+0000 7f035effd640 1 -- 172.21.15.39:0/3539435371 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03640046c0 con 0x55c440e28800 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.215+0000 7f035effd640 1 -- 172.21.15.39:0/3539435371 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364041070 con 0x55c440e28800 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.216+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 msgr2=0x55c440e2ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.216+0000 7f037d8ab740 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f036402aa00 tx=0x7f0364005d50 comp rx=0 tx=0).stop 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.217+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 shutdown_connections 2024-09-10T21:59:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.217+0000 7f037d8ab740 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e4c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.217+0000 7f037d8ab740 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e28800 0x55c440e2ee40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.217+0000 7f037d8ab740 1 --2- 172.21.15.39:0/3539435371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.217+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 >> 172.21.15.39:0/3539435371 conn(0x55c440e25d10 msgr2=0x55c440e2ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.221+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 shutdown_connections 2024-09-10T21:59:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.221+0000 7f037d8ab740 1 -- 172.21.15.39:0/3539435371 wait complete. 2024-09-10T21:59:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.221+0000 7f037d8ab740 1 -- start start 2024-09-10T21:59:46.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.221+0000 7f037d8ab740 1 Processor -- start 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e38c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e391c0 0x55c440eb0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f035800f790 con 0x55c440e391c0 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f035800f0c0 con 0x55c440e27ee0 2024-09-10T21:59:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f035800c3b0 con 0x55c440e34790 2024-09-10T21:59:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f037d8ab740 10 client.0 _ll_register_callbacks cb 0x7f0364009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f0379272640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34612/0 (socket says 172.21.15.39:34612) 2024-09-10T21:59:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f0379272640 1 -- 172.21.15.39:0/1821301046 learned_addr learned my addr 172.21.15.39:0/1821301046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.222+0000 7f0378a71640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e38c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379a73640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e391c0 0x55c440eb0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379272640 1 -- 172.21.15.39:0/1821301046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 msgr2=0x55c440e38c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379272640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e38c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379272640 1 -- 172.21.15.39:0/1821301046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e391c0 msgr2=0x55c440eb0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379272640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e391c0 0x55c440eb0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.229+0000 7f0379272640 1 -- 172.21.15.39:0/1821301046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c440e26c00 con 0x55c440e27ee0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.231+0000 7f0379272640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0370011df0 tx=0x7f037000cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935686075d9af758 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.231+0000 7f035cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.232+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370015040 con 0x55c440e27ee0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.232+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03640046c0 con 0x55c440e27ee0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.232+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f037000cde0 con 0x55c440e27ee0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.232+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f037000a210 con 0x55c440e27ee0 2024-09-10T21:59:46.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.233+0000 7f037d8ab740 10 client.26192 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:46.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.233+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c440eb2110 con 0x55c440e27ee0 2024-09-10T21:59:46.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.233+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03640046c0 con 0x55c440e27ee0 2024-09-10T21:59:46.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.238+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0370024040 con 0x55c440e27ee0 2024-09-10T21:59:46.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 10 client.26192 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:46.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 10 client.26192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:46.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 20 client.26192 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:46.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440eb2950 0x55c440eb4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:46.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 4 client.26192 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:59:46.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.239+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c440d9c860 con 0x55c440eb2950 2024-09-10T21:59:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.243+0000 7f0378a71640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440eb2950 0x55c440eb4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:46.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.248+0000 7f0378a71640 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440eb2950 0x55c440eb4d70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f665cc67527db2 server_cookie=c3ba57ffeee8879c in_seq=0 out_seq=0 2024-09-10T21:59:46.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.252+0000 7f035cff9640 10 client.26192 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:46.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f035cff9640 1 -- 172.21.15.39:0/1821301046 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c440d9c860 con 0x55c440eb2950 2024-09-10T21:59:46.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f035cff9640 10 client.26192 handle_command_reply: tid=0 2024-09-10T21:59:46.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f037d8ab740 1 client.26192 shutdown 2024-09-10T21:59:46.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 msgr2=0x55c440e38740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0370011df0 tx=0x7f037000cae0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.499+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 shutdown_connections 2024-09-10T21:59:46.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c440eb2950 0x55c440eb4d70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c440e391c0 0x55c440eb0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c440e34790 0x55c440e38c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 --2- 172.21.15.39:0/1821301046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c440e27ee0 0x55c440e38740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 >> 172.21.15.39:0/1821301046 conn(0x55c440e25d10 msgr2=0x55c440e2b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f035cff9640 0 client.26192 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 shutdown_connections 2024-09-10T21:59:46.502 INFO:tasks.workunit.client.0.smithi039.stdout: 109 1805693 425 1215306 531 1082310 1623 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 1 -- 172.21.15.39:0/1821301046 wait complete. 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.500+0000 7f037d8ab740 20 client.26192 trim_cache size 0 max 16384 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1", 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T21:59:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:59:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.503+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 msgr2=0x7f03600b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.503+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 0x7f03600b7970 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0364005fd0 tx=0x7f0364000bc0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.503+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 msgr2=0x7f03741a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.503+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f036c00eb40 tx=0x7f036c00c2d0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 shutdown_connections 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f03600b54b0 0x7f03600b7970 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03741a5430 0x7f03741a58e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0374113b10 0x7f03741a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 --2- 172.21.15.39:0/3208494889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0374075540 0x7f037419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 >> 172.21.15.39:0/3208494889 conn(0x7f03740fe860 msgr2=0x7f03740ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.505+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 shutdown_connections 2024-09-10T21:59:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:46.506+0000 7f037b4d6640 1 -- 172.21.15.39:0/3208494889 wait complete. 2024-09-10T21:59:46.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:46 smithi039 ceph-mon[30872]: pgmap v484: 97 pgs: 97 active+clean; 346 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 721 op/s 2024-09-10T21:59:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:46 smithi070 ceph-mon[34909]: pgmap v484: 97 pgs: 97 active+clean; 346 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 721 op/s 2024-09-10T21:59:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:46 smithi173 ceph-mon[35294]: pgmap v484: 97 pgs: 97 active+clean; 346 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 721 op/s 2024-09-10T21:59:47.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:59:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:59:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T21:59:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:47 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.166 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.167 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:47 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T21:59:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:47 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:48.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1048809861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 msgr2=0x7fd7a0101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1048809861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a0101c70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd790009900 tx=0x7fd79002a480 comp rx=0 tx=0).stop 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1048809861 shutdown_connections 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1048809861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a010f440 0x7fd7a0111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1048809861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a01021b0 0x7fd7a010ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1048809861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a0101c70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1048809861 >> 172.21.15.39:0/1048809861 conn(0x7fd7a00fd700 msgr2=0x7fd7a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1048809861 shutdown_connections 2024-09-10T21:59:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.280+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1048809861 wait complete. 2024-09-10T21:59:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.281+0000 7fd7a68e9640 1 Processor -- start 2024-09-10T21:59:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.281+0000 7fd7a68e9640 1 -- start start 2024-09-10T21:59:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 0x7fd7a01a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd79f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd79f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47100/0 (socket says 172.21.15.39:47100) 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1450447065 learned_addr learned my addr 172.21.15.39:0/1450447065 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 0x7fd7a01a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a0114f50 con 0x7fd7a0101890 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a0114dd0 con 0x7fd7a010f440 2024-09-10T21:59:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.282+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01150d0 con 0x7fd7a01021b0 2024-09-10T21:59:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1450447065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 msgr2=0x7fd7a01a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 0x7fd7a01a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 msgr2=0x7fd7a019b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a019b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a01a15f0 con 0x7fd7a01021b0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 0x7fd7a01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79d7fa640 1 -- 172.21.15.39:0/1450447065 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cd80 con 0x7fd7a01021b0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79d7fa640 1 -- 172.21.15.39:0/1450447065 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7940108e0 con 0x7fd7a01021b0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a01a18e0 con 0x7fd7a01021b0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.283+0000 7fd79d7fa640 1 -- 172.21.15.39:0/1450447065 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794018980 con 0x7fd7a01021b0 2024-09-10T21:59:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.284+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01a7fa0 con 0x7fd7a01021b0 2024-09-10T21:59:48.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.286+0000 7fd79d7fa640 1 -- 172.21.15.39:0/1450447065 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd794010430 con 0x7fd7a01021b0 2024-09-10T21:59:48.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.286+0000 7fd7a8cbe740 1 Processor -- start 2024-09-10T21:59:48.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.286+0000 7fd7a8cbe740 1 -- start start 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x5604488537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448856120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5604487bde50 con 0x560448853d30 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604487ad280 con 0x560448847da0 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5604487b1090 con 0x560448847480 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd79f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448856120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:47104/0 (socket says 172.21.15.39:47104) 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 -- 172.21.15.39:0/3760775222 learned_addr learned my addr 172.21.15.39:0/3760775222 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd79ffff640 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x5604488537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 -- 172.21.15.39:0/3760775222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 msgr2=0x5604488537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x5604488537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 -- 172.21.15.39:0/3760775222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 msgr2=0x560448856120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448856120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd7a4e86640 1 -- 172.21.15.39:0/3760775222 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56044850b650 con 0x560448847480 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.287+0000 7fd79d7fa640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 0x7fd7880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7980106c0 tx=0x7fd798010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7627b7487a49667 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 0x7fd7880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd7867fc640 1 -- 172.21.15.39:0/3760775222 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800e8d0 con 0x560448847480 2024-09-10T21:59:48.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd79d7fa640 1 -- 172.21.15.39:0/1450447065 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd7940e5f10 con 0x7fd7a01021b0 2024-09-10T21:59:48.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd7867fc640 1 -- 172.21.15.39:0/3760775222 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd798012450 con 0x560448847480 2024-09-10T21:59:48.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.288+0000 7fd7867fc640 1 -- 172.21.15.39:0/3760775222 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79801c670 con 0x560448847480 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/3760775222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 msgr2=0x560448847860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7980106c0 tx=0x7fd798010b80 comp rx=0 tx=0).stop 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/3760775222 shutdown_connections 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448856120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x5604488537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/3760775222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x560448847860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/3760775222 >> 172.21.15.39:0/3760775222 conn(0x5604488452b0 msgr2=0x560448846450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 0x7fd7880b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd790031440 tx=0x7fd790005890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/3760775222 shutdown_connections 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.289+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/3760775222 wait complete. 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 -- start start 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 Processor -- start 2024-09-10T21:59:48.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x560448853630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x560448850a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448851090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56044860e700 con 0x560448853d30 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560448748110 con 0x560448847480 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5604488569b0 con 0x560448847da0 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a8cbe740 10 client.0 _ll_register_callbacks cb 0x560448761990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448851090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448851090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47876/0 (socket says 172.21.15.39:47876) 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd7a4e86640 1 -- 172.21.15.39:0/1046990483 learned_addr learned my addr 172.21.15.39:0/1046990483 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.290+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x560448850a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x560448853630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 msgr2=0x560448853630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x560448853630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1046990483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 msgr2=0x560448851090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448851090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 -- 172.21.15.39:0/1046990483 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560448775c40 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x560448850a80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7940e39c0 tx=0x7fd7940e9480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4909a35f8b64699f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd77f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7940ac500 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd7940abb90 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.291+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd798012450 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7940abea0 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 10 client.26131 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560448862360 con 0x560448847da0 2024-09-10T21:59:48.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd798012450 con 0x560448847da0 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd7940a8080 con 0x560448847da0 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 10 client.26131 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 10 client.26131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 20 client.26131 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x560448866220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 4 client.26131 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604487bfda0 con 0x560448863de0 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.292+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x560448866220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.293+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x560448866220 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f332461f09241c server_cookie=cb33c086b87ddb4d in_seq=0 out_seq=0 2024-09-10T21:59:48.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.293+0000 7fd77f7fe640 10 client.26131 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.295+0000 7fd77f7fe640 1 -- 172.21.15.39:0/1046990483 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604487bfda0 con 0x560448863de0 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.295+0000 7fd77f7fe640 10 client.26131 handle_command_reply: tid=0 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 client.26131 shutdown 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 msgr2=0x560448850a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x560448850a80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7940e39c0 tx=0x7fd7940e9480 comp rx=0 tx=0).stop 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 shutdown_connections 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x560448866220 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448851090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x560448850a80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1046990483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x560448853630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd77f7fe640 0 client.26131 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 >> 172.21.15.39:0/1046990483 conn(0x5604488452b0 msgr2=0x56044884ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 shutdown_connections 2024-09-10T21:59:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1046990483 wait complete. 2024-09-10T21:59:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.296+0000 7fd7a8cbe740 20 client.26131 trim_cache size 0 max 16384 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 Processor -- start 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 -- start start 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x56044885fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x56044884ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448855fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01b0670 con 0x560448853d30 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01b2270 con 0x560448847480 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.315+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01b0d40 con 0x560448847da0 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448855fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd7a4e86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448855fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47878/0 (socket says 172.21.15.39:47878) 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd7a4e86640 1 -- 172.21.15.39:0/1998641386 learned_addr learned my addr 172.21.15.39:0/1998641386 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:48.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x56044885fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x56044884ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 -- 172.21.15.39:0/1998641386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 msgr2=0x56044884ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x56044884ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 -- 172.21.15.39:0/1998641386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 msgr2=0x560448855fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448855fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 -- 172.21.15.39:0/1998641386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560448847bd0 con 0x560448847480 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd79ffff640 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x56044885fbe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd790009230 tx=0x7fd79003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd55a98c30c50b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.316+0000 7fd785ffb640 1 -- 172.21.15.39:0/1998641386 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790055070 con 0x560448847480 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd785ffb640 1 -- 172.21.15.39:0/1998641386 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd790003aa0 con 0x560448847480 2024-09-10T21:59:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd785ffb640 1 -- 172.21.15.39:0/1998641386 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790035040 con 0x560448847480 2024-09-10T21:59:48.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1998641386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 msgr2=0x56044885fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x56044885fbe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd790009230 tx=0x7fd79003e000 comp rx=0 tx=0).stop 2024-09-10T21:59:48.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1998641386 shutdown_connections 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x560448855fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847da0 0x56044884ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/1998641386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847480 0x56044885fbe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.317+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1998641386 >> 172.21.15.39:0/1998641386 conn(0x5604488452b0 msgr2=0x560448846370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.318+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1998641386 shutdown_connections 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.318+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/1998641386 wait complete. 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.318+0000 7fd7a8cbe740 1 -- start start 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.318+0000 7fd7a8cbe740 1 Processor -- start 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x56044885c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x5604488558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01b1ae0 con 0x560448853d30 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01b1410 con 0x560448847da0 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01ae650 con 0x560448847480 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a8cbe740 10 client.0 _ll_register_callbacks cb 0x7fd7940e9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34664/0 (socket says 172.21.15.39:34664) 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 -- 172.21.15.39:0/2873564237 learned_addr learned my addr 172.21.15.39:0/2873564237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79ffff640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x56044885c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x5604488558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 -- 172.21.15.39:0/2873564237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 msgr2=0x56044885c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x56044885c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 -- 172.21.15.39:0/2873564237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 msgr2=0x5604488558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x5604488558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.319+0000 7fd79f7fe640 1 -- 172.21.15.39:0/2873564237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604488560f0 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd7a4e86640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x5604488558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd79f7fe640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd7940e96f0 tx=0x7fd7940abc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaae660714a2d5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd77f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7940ac080 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd7940ab600 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd790003aa0 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7940ac500 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd7a8cbe740 10 client.26210 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.320+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5604488d0df0 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd790003aa0 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd7940d31a0 con 0x560448847da0 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 10 client.26210 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 10 client.26210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 20 client.26210 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x5604488d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 4 client.26210 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:59:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5604487bb850 con 0x560448863de0 2024-09-10T21:59:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd79ffff640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x5604488d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.321+0000 7fd77f7fe640 10 client.26210 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.322+0000 7fd79ffff640 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x5604488d34a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ecfac8dcd7cbc4 server_cookie=117ed70bf6b5a111 in_seq=0 out_seq=0 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd77f7fe640 1 -- 172.21.15.39:0/2873564237 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2284 (crc 0 0 0) 0x5604487bb850 con 0x560448863de0 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd77f7fe640 10 client.26210 handle_command_reply: tid=0 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 client.26210 shutdown 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 msgr2=0x560448855360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd7940e96f0 tx=0x7fd7940abc40 comp rx=0 tx=0).stop 2024-09-10T21:59:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 shutdown_connections 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560448863de0 0x5604488d34a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560448853d30 0x5604488558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd77f7fe640 0 client.26210 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560448847da0 0x560448855360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 --2- 172.21.15.39:0/2873564237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560448847480 0x56044885c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.324+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 >> 172.21.15.39:0/2873564237 conn(0x5604488452b0 msgr2=0x56044884f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 shutdown_connections 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a8cbe740 1 -- 172.21.15.39:0/2873564237 wait complete. 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a8cbe740 20 client.26210 trim_cache size 0 max 16384 2024-09-10T21:59:48.328 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (16168 inodes in the stack)", 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1", 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.329 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.330 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.331 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T21:59:48.333 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T21:59:48.334 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T21:59:48.334 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T21:59:48.334 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:59:48.334 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T21:59:48.334 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 msgr2=0x7fd7880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 0x7fd7880b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd790031440 tx=0x7fd790005890 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 msgr2=0x7fd7a019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.325+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 shutdown_connections 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd7880b52e0 0x7fd7880b77a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7a010f440 0x7fd7a01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a01021b0 0x7fd7a019ba80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 --2- 172.21.15.39:0/1450447065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7a0101890 0x7fd7a019b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 >> 172.21.15.39:0/1450447065 conn(0x7fd7a00fd700 msgr2=0x7fd7a00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 shutdown_connections 2024-09-10T21:59:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T21:59:48.326+0000 7fd7a68e9640 1 -- 172.21.15.39:0/1450447065 wait complete. 2024-09-10T21:59:49.124 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:48 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:49.124 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:48 smithi039 ceph-mon[30872]: pgmap v485: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 721 op/s 2024-09-10T21:59:49.124 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:48 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:49.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:48 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:49.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:48 smithi070 ceph-mon[34909]: pgmap v485: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 721 op/s 2024-09-10T21:59:49.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:48 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:49.159 INFO:tasks.cephfs.filesystem:scrub status for tag:09a36bc9-4bdd-4e7e-a30c-266a8ca018c1 - {'path': '/', 'tag': '09a36bc9-4bdd-4e7e-a30c-266a8ca018c1', 'options': 'recursive,force'} 2024-09-10T21:59:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:48 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:48 smithi173 ceph-mon[35294]: pgmap v485: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 721 op/s 2024-09-10T21:59:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:48 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T21:59:51.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:50 smithi070 ceph-mon[34909]: pgmap v486: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 767 op/s 2024-09-10T21:59:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:50 smithi039 ceph-mon[30872]: pgmap v486: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 767 op/s 2024-09-10T21:59:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:50 smithi173 ceph-mon[35294]: pgmap v486: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 767 op/s 2024-09-10T21:59:53.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:52 smithi070 ceph-mon[34909]: pgmap v487: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 750 op/s 2024-09-10T21:59:53.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:52 smithi039 ceph-mon[30872]: pgmap v487: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 750 op/s 2024-09-10T21:59:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:52 smithi173 ceph-mon[35294]: pgmap v487: 97 pgs: 97 active+clean; 345 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 750 op/s 2024-09-10T21:59:55.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:54 smithi070 ceph-mon[34909]: pgmap v488: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.19k op/s 2024-09-10T21:59:55.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:54 smithi039 ceph-mon[30872]: pgmap v488: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.19k op/s 2024-09-10T21:59:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:54 smithi173 ceph-mon[35294]: pgmap v488: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.19k op/s 2024-09-10T21:59:56.502 INFO:tasks.workunit.client.0.smithi039.stdout: 109 183887 27 121860 23 105535 67 2024-09-10T21:59:57.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:56 smithi070 ceph-mon[34909]: pgmap v489: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 839 op/s 2024-09-10T21:59:57.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:56 smithi039 ceph-mon[30872]: pgmap v489: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 839 op/s 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 -- 172.21.15.39:0/3504280717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 msgr2=0x7f741c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 --2- 172.21.15.39:0/3504280717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c103f50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7410009930 tx=0x7f741002a420 comp rx=0 tx=0).stop 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 -- 172.21.15.39:0/3504280717 shutdown_connections 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 --2- 172.21.15.39:0/3504280717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 --2- 172.21.15.39:0/3504280717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c103f50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 --2- 172.21.15.39:0/3504280717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 -- 172.21.15.39:0/3504280717 >> 172.21.15.39:0/3504280717 conn(0x7f741c0fe240 msgr2=0x7f741c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 -- 172.21.15.39:0/3504280717 shutdown_connections 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.205+0000 7f7420b94640 1 -- 172.21.15.39:0/3504280717 wait complete. 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 Processor -- start 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 -- start start 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10e5f0 con 0x7f741c103ad0 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10e470 con 0x7f741c102980 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7420b94640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10e770 con 0x7f741c104490 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7419d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7419d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52048/0 (socket says 172.21.15.39:52048) 2024-09-10T21:59:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:49474/0 (socket says 172.21.15.39:49474) 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f7419d9b640 1 -- 172.21.15.39:0/3547970575 learned_addr learned my addr 172.21.15.39:0/3547970575 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741ad9d640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 -- 172.21.15.39:0/3547970575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 msgr2=0x7f741c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 -- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 msgr2=0x7f741c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741a59c640 1 -- 172.21.15.39:0/3547970575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c19a8f0 con 0x7f741c102980 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.206+0000 7f741ad9d640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f741a59c640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f740c00e9f0 tx=0x7f740c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f740b7fe640 1 -- 172.21.15.39:0/3547970575 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c00ccc0 con 0x7f741c102980 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c19abe0 con 0x7f741c102980 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c1a12b0 con 0x7f741c102980 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f740b7fe640 1 -- 172.21.15.39:0/3547970575 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f740c0108e0 con 0x7f741c102980 2024-09-10T21:59:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.207+0000 7f740b7fe640 1 -- 172.21.15.39:0/3547970575 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c018880 con 0x7f741c102980 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.209+0000 7f7423a3e740 1 Processor -- start 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.209+0000 7f7423a3e740 1 -- start start 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db90abd0 0x5622db90d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5622db8776f0 con 0x5622db908190 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622db866b20 con 0x5622db905860 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7423a3e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5622db86a930 con 0x5622db90abd0 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:49478/0 (socket says 172.21.15.39:49478) 2024-09-10T21:59:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 -- 172.21.15.39:0/3383415790 learned_addr learned my addr 172.21.15.39:0/3383415790 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f7419d9b640 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db90abd0 0x5622db90d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f740b7fe640 1 -- 172.21.15.39:0/3547970575 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f740c010430 con 0x7f741c102980 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 -- 172.21.15.39:0/3383415790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db90abd0 msgr2=0x5622db90d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db90abd0 0x5622db90d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 -- 172.21.15.39:0/3383415790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 msgr2=0x5622db90a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 -- 172.21.15.39:0/3383415790 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622db82c530 con 0x5622db905860 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.210+0000 7f741ad9d640 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74140117a0 tx=0x7f7414011c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3f78daa5315eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7408ff9640 1 -- 172.21.15.39:0/3383415790 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414011220 con 0x5622db905860 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7408ff9640 1 -- 172.21.15.39:0/3383415790 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741400f9a0 con 0x5622db905860 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7408ff9640 1 -- 172.21.15.39:0/3383415790 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140045d0 con 0x5622db905860 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f740b7fe640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 0x7f74040bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f740b7fe640 1 -- 172.21.15.39:0/3547970575 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f740c0e5ee0 con 0x7f741c102980 2024-09-10T21:59:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f741a59c640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 0x7f74040bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 -- 172.21.15.39:0/3383415790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 msgr2=0x5622db907c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74140117a0 tx=0x7f7414011c60 comp rx=0 tx=0).stop 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 -- 172.21.15.39:0/3383415790 shutdown_connections 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db90abd0 0x5622db90d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 --2- 172.21.15.39:0/3383415790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db907c50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.211+0000 7f7423a3e740 1 -- 172.21.15.39:0/3383415790 >> 172.21.15.39:0/3383415790 conn(0x5622db9009b0 msgr2=0x5622db901740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- 172.21.15.39:0/3383415790 shutdown_connections 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f741a59c640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 0x7f74040bbbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f740c000c00 tx=0x7f740c009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- 172.21.15.39:0/3383415790 wait complete. 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- start start 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 Processor -- start 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db90f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db910160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5622db79eab0 con 0x5622db905860 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622db80c730 con 0x5622db90abd0 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5622db90dbb0 con 0x5622db908190 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7423a3e740 10 client.0 _ll_register_callbacks cb 0x5622db8606b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52060/0 (socket says 172.21.15.39:52060) 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f741ad9d640 1 -- 172.21.15.39:0/1838024628 learned_addr learned my addr 172.21.15.39:0/1838024628 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f7419d9b640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db90f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.212+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db910160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 -- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 msgr2=0x5622db910160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db910160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 -- 172.21.15.39:0/1838024628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 msgr2=0x5622db90ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 -- 172.21.15.39:0/1838024628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622db5c8790 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7419d9b640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db90f600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f7410031db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a288fca814e5b479 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410035040 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7410004040 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f741400f9a0 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7410004240 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7423a3e740 10 client.26149 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5622db641620 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.213+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741400f9a0 con 0x5622db908190 2024-09-10T21:59:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f741003c440 con 0x5622db908190 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 10 client.26149 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 10 client.26149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 20 client.26149 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db91a980 0x5622db91cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 4 client.26149 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622db879640 con 0x5622db91a980 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db91a980 0x5622db91cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db91a980 0x5622db91cdc0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec0523bedae3331 server_cookie=4286bd962df7da4 in_seq=0 out_seq=0 2024-09-10T21:59:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.214+0000 7f7401ffb640 10 client.26149 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7401ffb640 1 -- 172.21.15.39:0/1838024628 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622db879640 con 0x5622db91a980 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7401ffb640 10 client.26149 handle_command_reply: tid=0 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 client.26149 shutdown 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 msgr2=0x5622db90f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db90f600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f7410031db0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 shutdown_connections 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db91a980 0x5622db91cdc0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db910160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db90f600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1838024628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db905860 0x5622db90ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7401ffb640 0 client.26149 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 >> 172.21.15.39:0/1838024628 conn(0x5622db9009b0 msgr2=0x5622db8ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 shutdown_connections 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 1 -- 172.21.15.39:0/1838024628 wait complete. 2024-09-10T21:59:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.216+0000 7f7423a3e740 20 client.26149 trim_cache size 0 max 16384 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.235+0000 7f7423a3e740 1 Processor -- start 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.235+0000 7f7423a3e740 1 -- start start 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db90b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc00e430 con 0x5622db908190 2024-09-10T21:59:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc010030 con 0x5622db90abd0 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7423a3e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc00eb00 con 0x5622db905860 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f7419d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:56306/0 (socket says 172.21.15.39:56306) 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 -- 172.21.15.39:0/1570101421 learned_addr learned my addr 172.21.15.39:0/1570101421 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db90b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 -- 172.21.15.39:0/1570101421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 msgr2=0x5622db90b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db90b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 -- 172.21.15.39:0/1570101421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 msgr2=0x5622db90afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.236+0000 7f741ad9d640 1 -- 172.21.15.39:0/1570101421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622db907fc0 con 0x5622db905860 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.237+0000 7f741ad9d640 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7414005c40 tx=0x7f7414009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26fe211dd0685652 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.237+0000 7f7403fff640 1 -- 172.21.15.39:0/1570101421 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741401e040 con 0x5622db905860 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.237+0000 7f7403fff640 1 -- 172.21.15.39:0/1570101421 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7414003ce0 con 0x5622db905860 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.237+0000 7f7403fff640 1 -- 172.21.15.39:0/1570101421 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414028790 con 0x5622db905860 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- 172.21.15.39:0/1570101421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 msgr2=0x5622db900410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7414005c40 tx=0x7f7414009500 comp rx=0 tx=0).stop 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- 172.21.15.39:0/1570101421 shutdown_connections 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db90abd0 0x5622db90b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db908190 0x5622db90afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- 172.21.15.39:0/1570101421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db905860 0x5622db900410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- 172.21.15.39:0/1570101421 >> 172.21.15.39:0/1570101421 conn(0x5622db9009b0 msgr2=0x5622db904d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- 172.21.15.39:0/1570101421 shutdown_connections 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- 172.21.15.39:0/1570101421 wait complete. 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- start start 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 Processor -- start 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db916850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db90abd0 0x5622db9858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc00f8a0 con 0x5622db90abd0 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc00f1d0 con 0x5622db905860 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc00c410 con 0x5622db908190 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f7423a3e740 10 client.0 _ll_register_callbacks cb 0x7f7410009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:59:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db90abd0 0x5622db9858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f741ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:49518/0 (socket says 172.21.15.39:49518) 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.238+0000 7f741ad9d640 1 -- 172.21.15.39:0/2848610936 learned_addr learned my addr 172.21.15.39:0/2848610936 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7419d9b640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db916850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 -- 172.21.15.39:0/2848610936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 msgr2=0x5622db916850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db916850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 -- 172.21.15.39:0/2848610936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db90abd0 msgr2=0x5622db9858c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db90abd0 0x5622db9858c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 -- 172.21.15.39:0/2848610936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622db985e00 con 0x5622db905860 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7419d9b640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db916850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f741ad9d640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7414003fd0 tx=0x7f7414011c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19387fb133e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414038020 con 0x5622db905860 2024-09-10T21:59:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f7414005460 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7414003ce0 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f741403b040 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7423a3e740 10 client.26228 fetch_fsmap learned FSMap version 30 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.239+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5622db9870e0 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7414003ce0 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7414041070 con 0x5622db905860 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 10 client.26228 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 10 client.26228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 20 client.26228 populate_metadata read hostname 'smithi039' 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db9877e0 0x5622db989c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 4 client.26228 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622db8750f0 con 0x5622db9877e0 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7419d9b640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db9877e0 0x5622db989c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:59:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7419d9b640 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db9877e0 0x5622db989c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dea8ad7eada73d7 server_cookie=5a5855a5515dd59c in_seq=0 out_seq=0 2024-09-10T21:59:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:57.240+0000 7f7401ffb640 10 client.26228 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:57.248 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:56 smithi173 ceph-mon[35294]: pgmap v489: 97 pgs: 97 active+clean; 354 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 839 op/s 2024-09-10T21:59:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.020+0000 7f7401ffb640 1 -- 172.21.15.39:0/2848610936 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622db8750f0 con 0x5622db9877e0 2024-09-10T21:59:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.020+0000 7f7401ffb640 10 client.26228 handle_command_reply: tid=0 2024-09-10T21:59:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.020+0000 7f7423a3e740 1 client.26228 shutdown 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.020+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 msgr2=0x5622db916220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7414003fd0 tx=0x7f7414011c60 comp rx=0 tx=0).stop 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 shutdown_connections 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5622db9877e0 0x5622db989c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622db90abd0 0x5622db9858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5622db908190 0x5622db916850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7401ffb640 0 client.26228 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 --2- 172.21.15.39:0/2848610936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622db905860 0x5622db916220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 >> 172.21.15.39:0/2848610936 conn(0x5622db9009b0 msgr2=0x5622db90ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 shutdown_connections 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 1 -- 172.21.15.39:0/2848610936 wait complete. 2024-09-10T21:59:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7423a3e740 20 client.26228 trim_cache size 0 max 16384 2024-09-10T21:59:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T21:59:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T21:59:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T21:59:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 msgr2=0x7f74040bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 0x7f74040bbbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f740c000c00 tx=0x7f740c009700 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 msgr2=0x7f741c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f740c00e9f0 tx=0x7f740c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 shutdown_connections 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f74040b96f0 0x7f74040bbbb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f741c104490 0x7f741c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c103ad0 0x7f741c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.021+0000 7f7420b94640 1 --2- 172.21.15.39:0/3547970575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c102980 0x7f741c198db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.022+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 >> 172.21.15.39:0/3547970575 conn(0x7f741c0fe240 msgr2=0x7f741c106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:59:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.022+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 shutdown_connections 2024-09-10T21:59:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T21:59:58.022+0000 7f7420b94640 1 -- 172.21.15.39:0/3547970575 wait complete. 2024-09-10T21:59:59.068 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 21:59:58 smithi039 ceph-mon[30872]: pgmap v490: 97 pgs: 97 active+clean; 357 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 923 op/s 2024-09-10T21:59:59.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 21:59:58 smithi070 ceph-mon[34909]: pgmap v490: 97 pgs: 97 active+clean; 357 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 923 op/s 2024-09-10T21:59:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 21:59:58 smithi173 ceph-mon[35294]: pgmap v490: 97 pgs: 97 active+clean; 357 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 923 op/s 2024-09-10T22:00:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:00 smithi070 ceph-mon[34909]: pgmap v491: 97 pgs: 97 active+clean; 355 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 1.46k op/s 2024-09-10T22:00:01.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:00 smithi070 ceph-mon[34909]: overall HEALTH_OK 2024-09-10T22:00:01.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:00 smithi039 ceph-mon[30872]: pgmap v491: 97 pgs: 97 active+clean; 355 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 1.46k op/s 2024-09-10T22:00:01.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:00 smithi039 ceph-mon[30872]: overall HEALTH_OK 2024-09-10T22:00:01.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:00 smithi173 ceph-mon[35294]: pgmap v491: 97 pgs: 97 active+clean; 355 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 1.46k op/s 2024-09-10T22:00:01.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:00 smithi173 ceph-mon[35294]: overall HEALTH_OK 2024-09-10T22:00:03.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:02 smithi070 ceph-mon[34909]: pgmap v492: 97 pgs: 97 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 1.44k op/s 2024-09-10T22:00:03.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:02 smithi039 ceph-mon[30872]: pgmap v492: 97 pgs: 97 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 1.44k op/s 2024-09-10T22:00:03.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:02 smithi173 ceph-mon[35294]: pgmap v492: 97 pgs: 97 active+clean; 351 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 1.44k op/s 2024-09-10T22:00:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:04 smithi070 ceph-mon[34909]: pgmap v493: 97 pgs: 97 active+clean; 345 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 2.03k op/s 2024-09-10T22:00:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:04 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:05.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:04 smithi039 ceph-mon[30872]: pgmap v493: 97 pgs: 97 active+clean; 345 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 2.03k op/s 2024-09-10T22:00:05.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:04 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:05.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:04 smithi173 ceph-mon[35294]: pgmap v493: 97 pgs: 97 active+clean; 345 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 2.03k op/s 2024-09-10T22:00:05.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:04 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:06.502 INFO:tasks.workunit.client.0.smithi039.stdout: 109 698 0 493 2 860 4 2024-09-10T22:00:07.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:06 smithi070 ceph-mon[34909]: pgmap v494: 97 pgs: 97 active+clean; 346 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 1.64k op/s 2024-09-10T22:00:07.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:06 smithi039 ceph-mon[30872]: pgmap v494: 97 pgs: 97 active+clean; 346 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 1.64k op/s 2024-09-10T22:00:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:06 smithi173 ceph-mon[35294]: pgmap v494: 97 pgs: 97 active+clean; 346 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 1.64k op/s 2024-09-10T22:00:09.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:08 smithi070 ceph-mon[34909]: pgmap v495: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.69k op/s 2024-09-10T22:00:09.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:08 smithi039 ceph-mon[30872]: pgmap v495: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.69k op/s 2024-09-10T22:00:09.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:08 smithi173 ceph-mon[35294]: pgmap v495: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.69k op/s 2024-09-10T22:00:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:00:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:00:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:00:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:00:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:00:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:00:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:00:10.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:00:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:00:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:00:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:00:10.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:00:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- 172.21.15.39:0/1356564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d4103370 msgr2=0x7fa8d4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 --2- 172.21.15.39:0/1356564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d4103370 0x7fa8d4109cf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009cd0 tx=0x7fa8cc02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- 172.21.15.39:0/1356564673 shutdown_connections 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 --2- 172.21.15.39:0/1356564673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d4103370 0x7fa8d4109cf0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 --2- 172.21.15.39:0/1356564673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d41029b0 0x7fa8d4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 --2- 172.21.15.39:0/1356564673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- 172.21.15.39:0/1356564673 >> 172.21.15.39:0/1356564673 conn(0x7fa8d40fd140 msgr2=0x7fa8d40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- 172.21.15.39:0/1356564673 shutdown_connections 2024-09-10T22:00:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- 172.21.15.39:0/1356564673 wait complete. 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 Processor -- start 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.115+0000 7fa8da382640 1 -- start start 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d4103370 0x7fa8d4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410d4d0 con 0x7fa8d41029b0 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410d350 con 0x7fa8d4101860 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410d650 con 0x7fa8d4103370 2024-09-10T22:00:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46898/0 (socket says 172.21.15.39:46898) 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 -- 172.21.15.39:0/139499623 learned_addr learned my addr 172.21.15.39:0/139499623 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d891f640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d4103370 0x7fa8d4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 -- 172.21.15.39:0/139499623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d4103370 msgr2=0x7fa8d4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d4103370 0x7fa8d4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 -- 172.21.15.39:0/139499623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 msgr2=0x7fa8d4198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 -- 172.21.15.39:0/139499623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d419a870 con 0x7fa8d41029b0 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e9f0 tx=0x7fa8c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d17fa640 1 -- 172.21.15.39:0/139499623 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800cd80 con 0x7fa8d41029b0 2024-09-10T22:00:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d17fa640 1 -- 172.21.15.39:0/139499623 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c80054d0 con 0x7fa8d41029b0 2024-09-10T22:00:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d419ab60 con 0x7fa8d41029b0 2024-09-10T22:00:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.116+0000 7fa8d17fa640 1 -- 172.21.15.39:0/139499623 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8010690 con 0x7fa8d41029b0 2024-09-10T22:00:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.117+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d41a1230 con 0x7fa8d41029b0 2024-09-10T22:00:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8d17fa640 1 -- 172.21.15.39:0/139499623 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa8c8004e90 con 0x7fa8d41029b0 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 Processor -- start 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 -- start start 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e2fe0 0x55c4221e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c42214b6f0 con 0x55c4221e05a0 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c42213ab20 con 0x55c4221ddc70 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c42213e930 con 0x55c4221e2fe0 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.119+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46900/0 (socket says 172.21.15.39:46900) 2024-09-10T22:00:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:40362/0 (socket says 172.21.15.39:40362) 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 -- 172.21.15.39:0/3573351769 learned_addr learned my addr 172.21.15.39:0/3573351769 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e2fe0 0x55c4221e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d17fa640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 0x7fa8bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 -- 172.21.15.39:0/3573351769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e2fe0 msgr2=0x55c4221e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e2fe0 0x55c4221e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 -- 172.21.15.39:0/3573351769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 msgr2=0x55c4221e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 -- 172.21.15.39:0/3573351769 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c422100530 con 0x55c4221e05a0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d891f640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 0x7fa8bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d17fa640 1 -- 172.21.15.39:0/139499623 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa8c80e5ff0 con 0x7fa8d41029b0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40115f0 tx=0x7fa8c4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28114f7370a9be49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8ba7fc640 1 -- 172.21.15.39:0/3573351769 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c401e070 con 0x55c4221e05a0 2024-09-10T22:00:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8ba7fc640 1 -- 172.21.15.39:0/3573351769 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c400faf0 con 0x55c4221e05a0 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.120+0000 7fa8ba7fc640 1 -- 172.21.15.39:0/3573351769 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019b10 con 0x55c4221e05a0 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573351769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 msgr2=0x55c4221e2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8d891f640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 0x7fa8bc0b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4199ab0 tx=0x7fa8cc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40115f0 tx=0x7fa8c4011ab0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573351769 shutdown_connections 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e2fe0 0x55c4221e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e05a0 0x55c4221e2990 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573351769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573351769 >> 172.21.15.39:0/3573351769 conn(0x55c4221d49b0 msgr2=0x55c4221d5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573351769 shutdown_connections 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573351769 wait complete. 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.121+0000 7fa8dd22a740 1 -- start start 2024-09-10T22:00:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 Processor -- start 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c422072ab0 con 0x55c4221e2fe0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c4220e0730 con 0x55c4221ddc70 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c4221e5fc0 con 0x55c4221e05a0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8dd22a740 10 client.0 _ll_register_callbacks cb 0x55c4221346b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46916/0 (socket says 172.21.15.39:46916) 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 -- 172.21.15.39:0/3573784489 learned_addr learned my addr 172.21.15.39:0/3573784489 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 -- 172.21.15.39:0/3573784489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 msgr2=0x55c4221e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 -- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 msgr2=0x55c4221e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d891f640 1 -- 172.21.15.39:0/3573784489 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c421e9c790 con 0x55c4221e2fe0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.122+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8d891f640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009cd0 tx=0x7fa8cc02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a22f0a8af43dea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc056060 con 0x55c4221e2fe0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa8cc004620 con 0x55c4221e2fe0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c400faf0 con 0x55c4221e2fe0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa8cc004820 con 0x55c4221e2fe0 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 10 client.16614 fetch_fsmap learned FSMap version 30 2024-09-10T22:00:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c421f15620 con 0x55c4221e2fe0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c400faf0 con 0x55c4221e2fe0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa8cc045070 con 0x55c4221e2fe0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 10 client.16614 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 20 client.16614 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4221f2ca0 0x55c4221f5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 4 client.16614 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.123+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c42214d640 con 0x55c4221f2ca0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.124+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4221f2ca0 0x55c4221f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.124+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4221f2ca0 0x55c4221f5130 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee61c18aee4fd9d6 server_cookie=fd6d897c4f084994 in_seq=0 out_seq=0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.124+0000 7fa8b37fe640 10 client.16614 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8b37fe640 1 -- 172.21.15.39:0/3573784489 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c42214d640 con 0x55c4221f2ca0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8b37fe640 10 client.16614 handle_command_reply: tid=0 2024-09-10T22:00:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 client.16614 shutdown 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 msgr2=0x55c4221e8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009cd0 tx=0x7fa8cc02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 shutdown_connections 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4221f2ca0 0x55c4221f5130 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221e8550 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/3573784489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221ddc70 0x55c4221e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 >> 172.21.15.39:0/3573784489 conn(0x55c4221d49b0 msgr2=0x55c4221d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8b37fe640 0 client.16614 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 shutdown_connections 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 1 -- 172.21.15.39:0/3573784489 wait complete. 2024-09-10T22:00:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.126+0000 7fa8dd22a740 20 client.16614 trim_cache size 0 max 16384 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 Processor -- start 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 -- start start 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e2fe0 0x55c4221e3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a7d10 con 0x55c4221ddc70 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a9910 con 0x55c4221e2fe0 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a83e0 con 0x55c4221e05a0 2024-09-10T22:00:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46930/0 (socket says 172.21.15.39:46930) 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8d3fff640 1 -- 172.21.15.39:0/2527098692 learned_addr learned my addr 172.21.15.39:0/2527098692 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.141+0000 7fa8d891f640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e2fe0 0x55c4221e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 -- 172.21.15.39:0/2527098692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 msgr2=0x55c4221e33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 -- 172.21.15.39:0/2527098692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e2fe0 msgr2=0x55c4221e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e2fe0 0x55c4221e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 -- 172.21.15.39:0/2527098692 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4221e2d00 con 0x55c4221ddc70 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4013fd0 tx=0x7fa8c4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c96c3f88a01ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8b9ffb640 1 -- 172.21.15.39:0/2527098692 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4031070 con 0x55c4221ddc70 2024-09-10T22:00:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8b9ffb640 1 -- 172.21.15.39:0/2527098692 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4029070 con 0x55c4221ddc70 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.142+0000 7fa8b9ffb640 1 -- 172.21.15.39:0/2527098692 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c401e040 con 0x55c4221ddc70 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2527098692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 msgr2=0x55c4221e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4013fd0 tx=0x7fa8c4009f60 comp rx=0 tx=0).stop 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2527098692 shutdown_connections 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e2fe0 0x55c4221e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221e05a0 0x55c4221e33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2527098692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221ddc70 0x55c4221e8530 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2527098692 >> 172.21.15.39:0/2527098692 conn(0x55c4221d49b0 msgr2=0x55c4221f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2527098692 shutdown_connections 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2527098692 wait complete. 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- start start 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 Processor -- start 2024-09-10T22:00:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 0x55c4221ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e05a0 0x55c4221eef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a9180 con 0x55c4221e2fe0 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a8ab0 con 0x55c4221e05a0 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.143+0000 7fa8dd22a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a5cf0 con 0x55c4221ddc70 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8dd22a740 10 client.0 _ll_register_callbacks cb 0x7fa8cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 0x55c4221ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46932/0 (socket says 172.21.15.39:46932) 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 -- 172.21.15.39:0/2834771127 learned_addr learned my addr 172.21.15.39:0/2834771127 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d37fe640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e05a0 0x55c4221eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 -- 172.21.15.39:0/2834771127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 msgr2=0x55c4221ee8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 0x55c4221ee8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 -- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e05a0 msgr2=0x55c4221eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e05a0 0x55c4221eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 -- 172.21.15.39:0/2834771127 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4221ede10 con 0x55c4221e2fe0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 0x55c4221ee8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8d891f640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc051790 tx=0x7fa8cc0513e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c047353c04e6535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc060020 con 0x55c4221e2fe0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa8cc004620 con 0x55c4221e2fe0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c4029070 con 0x55c4221e2fe0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa8cc056040 con 0x55c4221e2fe0 2024-09-10T22:00:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8dd22a740 10 client.16620 fetch_fsmap learned FSMap version 30 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.144+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c4221eccd0 con 0x55c4221e2fe0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4029070 con 0x55c4221e2fe0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa8cc045070 con 0x55c4221e2fe0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 10 client.16620 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 10 client.16620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 20 client.16620 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4222602f0 0x55c422262710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 4 client.16620 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4221490f0 con 0x55c4222602f0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4222602f0 0x55c422262710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8d3fff640 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4222602f0 0x55c422262710 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6174912ad22f287 server_cookie=75a8b724d87ea0a1 in_seq=0 out_seq=0 2024-09-10T22:00:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:11.145+0000 7fa8b37fe640 10 client.16620 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:11.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:10 smithi070 ceph-mon[34909]: pgmap v496: 97 pgs: 97 active+clean; 362 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.70k op/s 2024-09-10T22:00:11.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:10 smithi039 ceph-mon[30872]: pgmap v496: 97 pgs: 97 active+clean; 362 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.70k op/s 2024-09-10T22:00:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:10 smithi173 ceph-mon[35294]: pgmap v496: 97 pgs: 97 active+clean; 362 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.70k op/s 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8b37fe640 1 -- 172.21.15.39:0/2834771127 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4221490f0 con 0x55c4222602f0 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8b37fe640 10 client.16620 handle_command_reply: tid=0 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 client.16620 shutdown 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 msgr2=0x55c4221ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc051790 tx=0x7fa8cc0513e0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 shutdown_connections 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55c4222602f0 0x55c422262710 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c4221e2fe0 0x55c4221ed5e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4221e05a0 0x55c4221eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 --2- 172.21.15.39:0/2834771127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c4221ddc70 0x55c4221ee8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 >> 172.21.15.39:0/2834771127 conn(0x55c4221d49b0 msgr2=0x55c4221e33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8b37fe640 0 client.16620 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 shutdown_connections 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.250+0000 7fa8dd22a740 1 -- 172.21.15.39:0/2834771127 wait complete. 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.251+0000 7fa8dd22a740 20 client.16620 trim_cache size 0 max 16384 2024-09-10T22:00:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.251+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 msgr2=0x7fa8bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.251+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 0x7fa8bc0b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4199ab0 tx=0x7fa8cc0095c0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.251+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 msgr2=0x7fa8d4199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.251+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e9f0 tx=0x7fa8c800edf0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 shutdown_connections 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa8bc0b52e0 0x7fa8bc0b77a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8d4103370 0x7fa8d4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8d41029b0 0x7fa8d4199380 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 --2- 172.21.15.39:0/139499623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8d4101860 0x7fa8d4198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 >> 172.21.15.39:0/139499623 conn(0x7fa8d40fd140 msgr2=0x7fa8d40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 shutdown_connections 2024-09-10T22:00:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:12.252+0000 7fa8da382640 1 -- 172.21.15.39:0/139499623 wait complete. 2024-09-10T22:00:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:12 smithi070 ceph-mon[34909]: pgmap v497: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 1.13k op/s 2024-09-10T22:00:13.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:12 smithi039 ceph-mon[30872]: pgmap v497: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 1.13k op/s 2024-09-10T22:00:13.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:12 smithi173 ceph-mon[35294]: pgmap v497: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 1.13k op/s 2024-09-10T22:00:15.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:14 smithi070 ceph-mon[34909]: pgmap v498: 97 pgs: 97 active+clean; 377 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 1.25k op/s 2024-09-10T22:00:15.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:14 smithi039 ceph-mon[30872]: pgmap v498: 97 pgs: 97 active+clean; 377 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 1.25k op/s 2024-09-10T22:00:15.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:14 smithi173 ceph-mon[35294]: pgmap v498: 97 pgs: 97 active+clean; 377 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 1.25k op/s 2024-09-10T22:00:16.502 INFO:tasks.workunit.client.0.smithi039.stdout: 109 5861 59 4021 81 4613 212 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: pgmap v499: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 678 op/s 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:00:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:16 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:00:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: pgmap v499: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 678 op/s 2024-09-10T22:00:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:00:17.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:00:17.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:00:17.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:00:17.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:16 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:00:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: pgmap v499: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 678 op/s 2024-09-10T22:00:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:00:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:00:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:00:17.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:00:17.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:16 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:00:19.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:18 smithi070 ceph-mon[34909]: pgmap v500: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 648 op/s 2024-09-10T22:00:19.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:00:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:18 smithi039 ceph-mon[30872]: pgmap v500: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 648 op/s 2024-09-10T22:00:19.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:18 smithi173 ceph-mon[35294]: pgmap v500: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 648 op/s 2024-09-10T22:00:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:19.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 -- 172.21.15.39:0/3708133666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec10d0e0 msgr2=0x7f60ec10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/3708133666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec10d0e0 0x7f60ec10f550 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009ca0 tx=0x7f60e402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 -- 172.21.15.39:0/3708133666 shutdown_connections 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/3708133666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec10d0e0 0x7f60ec10f550 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/3708133666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/3708133666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec103b30 0x7f60ec103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 -- 172.21.15.39:0/3708133666 >> 172.21.15.39:0/3708133666 conn(0x7f60ec0fd700 msgr2=0x7f60ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:19.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 -- 172.21.15.39:0/3708133666 shutdown_connections 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.987+0000 7f60f0ee8640 1 -- 172.21.15.39:0/3708133666 wait complete. 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 Processor -- start 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 -- start start 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec10d0e0 0x7f60ec102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112d60 con 0x7f60ec103b30 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112be0 con 0x7f60ec104530 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60f0ee8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112ee0 con 0x7f60ec10d0e0 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.988+0000 7f60ea59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:19.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42672/0 (socket says 172.21.15.39:42672) 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 -- 172.21.15.39:0/275997149 learned_addr learned my addr 172.21.15.39:0/275997149 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ead9d640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec10d0e0 0x7f60ec102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 -- 172.21.15.39:0/275997149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec10d0e0 msgr2=0x7f60ec102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec10d0e0 0x7f60ec102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 -- 172.21.15.39:0/275997149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 msgr2=0x7f60ec101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 -- 172.21.15.39:0/275997149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec1a7630 con 0x7f60ec103b30 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60ea59c640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00e9f0 tx=0x7f60dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:19.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60db7fe640 1 -- 172.21.15.39:0/275997149 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00cd80 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec1a7920 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60db7fe640 1 -- 172.21.15.39:0/275997149 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc0054d0 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60db7fe640 1 -- 172.21.15.39:0/275997149 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc010690 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.989+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a7e60 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.992+0000 7f60db7fe640 1 -- 172.21.15.39:0/275997149 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f60dc004e90 con 0x7f60ec103b30 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.993+0000 7f60f32bd740 1 Processor -- start 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.993+0000 7f60f32bd740 1 -- start start 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec9c0 0x5616de0f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0f8950 0x5616de0fad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5616de062e50 con 0x5616de0f8950 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5616de052280 con 0x5616de0ec9c0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60f32bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616de056090 con 0x5616de0ec0a0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:55962/0 (socket says 172.21.15.39:55962) 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 -- 172.21.15.39:0/3891337490 learned_addr learned my addr 172.21.15.39:0/3891337490 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0f8950 0x5616de0fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ea59c640 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec9c0 0x5616de0f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 -- 172.21.15.39:0/3891337490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec9c0 msgr2=0x5616de0f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec9c0 0x5616de0f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 -- 172.21.15.39:0/3891337490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0f8950 msgr2=0x5616de0fad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0f8950 0x5616de0fad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.994+0000 7f60ead9d640 1 -- 172.21.15.39:0/3891337490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616dddb0650 con 0x5616de0ec0a0 2024-09-10T22:00:20.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60db7fe640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 0x7f60d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60ead9d640 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f60e4005cc0 tx=0x7f60e4009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e554604c77b1ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60ea59c640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 0x7f60d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60d8ff9640 1 -- 172.21.15.39:0/3891337490 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4031cf0 con 0x5616de0ec0a0 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60db7fe640 1 -- 172.21.15.39:0/275997149 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f60dc0e5fe0 con 0x7f60ec103b30 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60d8ff9640 1 -- 172.21.15.39:0/3891337490 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e4036040 con 0x5616de0ec0a0 2024-09-10T22:00:20.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.995+0000 7f60d8ff9640 1 -- 172.21.15.39:0/3891337490 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4004040 con 0x5616de0ec0a0 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 -- 172.21.15.39:0/3891337490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 msgr2=0x5616de0ec480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60ea59c640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 0x7f60d40b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0a9ac0 tx=0x7f60dc004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f60e4005cc0 tx=0x7f60e4009360 comp rx=0 tx=0).stop 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 -- 172.21.15.39:0/3891337490 shutdown_connections 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0f8950 0x5616de0fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec9c0 0x5616de0f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 --2- 172.21.15.39:0/3891337490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0ec480 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 -- 172.21.15.39:0/3891337490 >> 172.21.15.39:0/3891337490 conn(0x5616de0e9ed0 msgr2=0x5616de0eb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 -- 172.21.15.39:0/3891337490 shutdown_connections 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.996+0000 7f60f32bd740 1 -- 172.21.15.39:0/3891337490 wait complete. 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 -- start start 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 Processor -- start 2024-09-10T22:00:20.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0f5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0f8950 0x5616de0f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5616ddeb3700 con 0x5616de0ec9c0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5616ddfed110 con 0x5616de0f8950 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616de0fb610 con 0x5616de0ec0a0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.997+0000 7f60f32bd740 10 client.0 _ll_register_callbacks cb 0x5616de006990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:55964/0 (socket says 172.21.15.39:55964) 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60ead9d640 1 -- 172.21.15.39:0/1362032753 learned_addr learned my addr 172.21.15.39:0/1362032753 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0f8950 0x5616de0f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1362032753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 msgr2=0x5616de0f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0f8950 msgr2=0x5616de0f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0f8950 0x5616de0f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1362032753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de01ac40 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0f5650 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60e0012cd0 tx=0x7f60e000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb59317c2c1e8563 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.998+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0012110 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f60e0004050 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e4036040 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f60e00122b0 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 10 client.16632 fetch_fsmap learned FSMap version 30 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616de106fc0 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e4036040 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f60e0010430 con 0x5616de0ec9c0 2024-09-10T22:00:20.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 10 client.16632 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 20 client.16632 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de10a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 4 client.16632 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:19.999+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616de064da0 con 0x5616de108570 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.000+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de10a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.000+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de10a990 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbad03cac8f6c761 server_cookie=ad35a9ec8779e2b9 in_seq=0 out_seq=0 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.000+0000 7f60d1ffb640 10 client.16632 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1362032753 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616de064da0 con 0x5616de108570 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60d1ffb640 10 client.16632 handle_command_reply: tid=0 2024-09-10T22:00:20.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 client.16632 shutdown 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 msgr2=0x5616de0f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0f5650 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60e0012cd0 tx=0x7f60e000f790 comp rx=0 tx=0).stop 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 shutdown_connections 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de10a990 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0f8950 0x5616de0f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0f5650 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60d1ffb640 0 client.16632 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1362032753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0ec0a0 0x5616de0f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.002+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 >> 172.21.15.39:0/1362032753 conn(0x5616de0e9ed0 msgr2=0x5616de0efa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.003+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 shutdown_connections 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.003+0000 7f60f32bd740 1 -- 172.21.15.39:0/1362032753 wait complete. 2024-09-10T22:00:20.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.003+0000 7f60f32bd740 20 client.16632 trim_cache size 0 max 16384 2024-09-10T22:00:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 Processor -- start 2024-09-10T22:00:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 -- start start 2024-09-10T22:00:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de0e9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b04f0 con 0x5616de0ec9c0 2024-09-10T22:00:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b20f0 con 0x5616de0ec0a0 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60f32bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b0bc0 con 0x5616de0f8950 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60e9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60e9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42720/0 (socket says 172.21.15.39:42720) 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1733304201 learned_addr learned my addr 172.21.15.39:0/1733304201 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.021+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de0e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 -- 172.21.15.39:0/1733304201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 msgr2=0x5616de0e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de0e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 -- 172.21.15.39:0/1733304201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 msgr2=0x5616de0eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 -- 172.21.15.39:0/1733304201 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de0f5f80 con 0x5616de0ec0a0 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1048a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60e4003ab0 tx=0x7f60e402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c087d5db2a2c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60d3fff640 1 -- 172.21.15.39:0/1733304201 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e404a040 con 0x5616de0ec0a0 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60d3fff640 1 -- 172.21.15.39:0/1733304201 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e4036040 con 0x5616de0ec0a0 2024-09-10T22:00:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.022+0000 7f60d3fff640 1 -- 172.21.15.39:0/1733304201 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40047c0 con 0x5616de0ec0a0 2024-09-10T22:00:20.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 -- 172.21.15.39:0/1733304201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 msgr2=0x5616de1048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1048a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60e4003ab0 tx=0x7f60e402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 -- 172.21.15.39:0/1733304201 shutdown_connections 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de0e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de0eb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1733304201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1048a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 -- 172.21.15.39:0/1733304201 >> 172.21.15.39:0/1733304201 conn(0x5616de0e9ed0 msgr2=0x5616de0eaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.023+0000 7f60f32bd740 1 -- 172.21.15.39:0/1733304201 shutdown_connections 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 -- 172.21.15.39:0/1733304201 wait complete. 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 -- start start 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 Processor -- start 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de110020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de1106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b1960 con 0x5616de0ec9c0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b1290 con 0x5616de0ec0a0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1ae4d0 con 0x5616de0f8950 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.024+0000 7f60f32bd740 10 client.0 _ll_register_callbacks cb 0x7f60e0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38580/0 (socket says 172.21.15.39:38580) 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60ead9d640 1 -- 172.21.15.39:0/1556877771 learned_addr learned my addr 172.21.15.39:0/1556877771 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de1106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1556877771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 msgr2=0x5616de1106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de1106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 msgr2=0x5616de1011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 -- 172.21.15.39:0/1556877771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de0ffe30 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60e9d9b640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de110020 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f60e0000c00 tx=0x7f60e000fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573a4ae00b2ba4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.025+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0000e60 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f60e00050b0 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e4036040 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f60e0010640 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60f32bd740 10 client.16638 fetch_fsmap learned FSMap version 30 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616de1755f0 con 0x5616de0ec9c0 2024-09-10T22:00:20.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.026+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e4036040 con 0x5616de0ec9c0 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f60e0037030 con 0x5616de0ec9c0 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 10 client.16638 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 20 client.16638 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de177d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 4 client.16638 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616de060850 con 0x5616de108570 2024-09-10T22:00:20.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.027+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de177d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:20.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.028+0000 7f60d1ffb640 10 client.16638 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:20.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.028+0000 7f60ead9d640 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de177d80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc38b6968dd72cf9 server_cookie=8e76eeec0aa631e5 in_seq=0 out_seq=0 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60d1ffb640 1 -- 172.21.15.39:0/1556877771 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5616de060850 con 0x5616de108570 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60d1ffb640 10 client.16638 handle_command_reply: tid=0 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60f32bd740 1 client.16638 shutdown 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 msgr2=0x5616de110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de110020 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f60e0000c00 tx=0x7f60e000fd20 comp rx=0 tx=0).stop 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 shutdown_connections 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.029+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5616de108570 0x5616de177d80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616de0f8950 0x5616de1106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5616de0ec9c0 0x5616de110020 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 --2- 172.21.15.39:0/1556877771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616de0ec0a0 0x5616de1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 >> 172.21.15.39:0/1556877771 conn(0x5616de0e9ed0 msgr2=0x5616de0f6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:20.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60d1ffb640 0 client.16638 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 shutdown_connections 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 1 -- 172.21.15.39:0/1556877771 wait complete. 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f32bd740 20 client.16638 trim_cache size 0 max 16384 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T22:00:20.035 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.038 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:20.039 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:20.040 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:20.040 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:20.040 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:00:20.040 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:00:20.040 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 msgr2=0x7f60d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 0x7f60d40b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0a9ac0 tx=0x7f60dc004a90 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 msgr2=0x7f60ec1019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.030+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00e9f0 tx=0x7f60dc00edf0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 shutdown_connections 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f60d40b52e0 0x7f60d40b77a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60ec10d0e0 0x7f60ec102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60ec104530 0x7f60ec101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 --2- 172.21.15.39:0/275997149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60ec103b30 0x7f60ec1019b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 >> 172.21.15.39:0/275997149 conn(0x7f60ec0fd700 msgr2=0x7f60ec0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 shutdown_connections 2024-09-10T22:00:20.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:20.031+0000 7f60f0ee8640 1 -- 172.21.15.39:0/275997149 wait complete. 2024-09-10T22:00:20.779 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:00:20.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:00:20.845 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:20 smithi039 ceph-mon[30872]: pgmap v501: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 528 op/s 2024-09-10T22:00:21.093 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:21.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:20 smithi070 ceph-mon[34909]: pgmap v501: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 528 op/s 2024-09-10T22:00:21.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:20 smithi173 ceph-mon[35294]: pgmap v501: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 528 op/s 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 -- 172.21.15.39:0/4197186925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1401045c0 msgr2=0x7fc14010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 --2- 172.21.15.39:0/4197186925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1401045c0 0x7fc14010cab0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc130009900 tx=0x7fc13002a410 comp rx=0 tx=0).stop 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 -- 172.21.15.39:0/4197186925 shutdown_connections 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 --2- 172.21.15.39:0/4197186925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc14010d100 0x7fc14010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 --2- 172.21.15.39:0/4197186925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1401045c0 0x7fc14010cab0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 --2- 172.21.15.39:0/4197186925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc140104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 -- 172.21.15.39:0/4197186925 >> 172.21.15.39:0/4197186925 conn(0x7fc1400fd700 msgr2=0x7fc1400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.668+0000 7fc147d66640 1 -- 172.21.15.39:0/4197186925 shutdown_connections 2024-09-10T22:00:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.669+0000 7fc147d66640 1 -- 172.21.15.39:0/4197186925 wait complete. 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.669+0000 7fc147d66640 1 Processor -- start 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.669+0000 7fc147d66640 1 -- start start 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.669+0000 7fc147d66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc1401992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.669+0000 7fc147d66640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 0x7fc1401997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc147d66640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc147d66640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc140112d70 con 0x7fc14010d100 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc147d66640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc140112bf0 con 0x7fc140103ca0 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc147d66640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc140112ef0 con 0x7fc1401045c0 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42752/0 (socket says 172.21.15.39:42752) 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 -- 172.21.15.39:0/3243966896 learned_addr learned my addr 172.21.15.39:0/3243966896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:21.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc145b02640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc1401992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc145301640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 0x7fc1401997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 -- 172.21.15.39:0/3243966896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 msgr2=0x7fc1401997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 0x7fc1401997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 -- 172.21.15.39:0/3243966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 msgr2=0x7fc1401992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc1401992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 -- 172.21.15.39:0/3243966896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14019f350 con 0x7fc14010d100 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc145301640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 0x7fc1401997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc145b02640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc1401992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc146303640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc13800eaa0 tx=0x7fc13800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13800cdb0 con 0x7fc14010d100 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc138005020 con 0x7fc14010d100 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.670+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14019f640 con 0x7fc14010d100 2024-09-10T22:00:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.671+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380116d0 con 0x7fc14010d100 2024-09-10T22:00:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.671+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1401a5d00 con 0x7fc14010d100 2024-09-10T22:00:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.672+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc140104080 con 0x7fc14010d100 2024-09-10T22:00:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.673+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc13800f040 con 0x7fc14010d100 2024-09-10T22:00:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.674+0000 7fc136ffd640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 0x7fc12c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.674+0000 7fc145b02640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 0x7fc12c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.674+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc1380e5d70 con 0x7fc14010d100 2024-09-10T22:00:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.675+0000 7fc145b02640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 0x7fc12c0b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0095f0 tx=0x7fc13c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.677+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc138016030 con 0x7fc14010d100 2024-09-10T22:00:21.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.912+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14019a3d0 con 0x7fc14010d100 2024-09-10T22:00:21.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.913+0000 7fc136ffd640 1 -- 172.21.15.39:0/3243966896 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11978 (secure 0 0 0) 0x7fc1380accc0 con 0x7fc14010d100 2024-09-10T22:00:21.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:00:21.914 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"btime":"2024-09-10T22:00:21:844219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T22:00:21.009423+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24550,24563,24562,24583,24590]},"id":1}]} 2024-09-10T22:00:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 msgr2=0x7fc12c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 0x7fc12c0b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0095f0 tx=0x7fc13c005f90 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 msgr2=0x7fc14019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc13800eaa0 tx=0x7fc13800ef60 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 shutdown_connections 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc12c0b5360 0x7fc12c0b7820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc14010d100 0x7fc14019eb80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1401045c0 0x7fc1401997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 --2- 172.21.15.39:0/3243966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc140103ca0 0x7fc1401992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.915+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 >> 172.21.15.39:0/3243966896 conn(0x7fc1400fd700 msgr2=0x7fc1400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.916+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 shutdown_connections 2024-09-10T22:00:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:21.916+0000 7fc147d66640 1 -- 172.21.15.39:0/3243966896 wait complete. 2024-09-10T22:00:22.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T22:00:22.895 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:22 smithi070 ceph-mon[34909]: pgmap v502: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 358 op/s 2024-09-10T22:00:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:22 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:22 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3243966896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:00:23.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:22 smithi039 ceph-mon[30872]: pgmap v502: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 358 op/s 2024-09-10T22:00:23.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:22 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:23.158 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:22 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3243966896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:00:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:22 smithi173 ceph-mon[35294]: pgmap v502: 97 pgs: 97 active+clean; 382 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 3.2 MiB/s wr, 358 op/s 2024-09-10T22:00:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:22 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:22 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3243966896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:00:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 -- 172.21.15.39:0/3730860611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8102150 msgr2=0x7f26b810eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 --2- 172.21.15.39:0/3730860611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8102150 0x7f26b810eea0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009900 tx=0x7f26a802a480 comp rx=0 tx=0).stop 2024-09-10T22:00:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 -- 172.21.15.39:0/3730860611 shutdown_connections 2024-09-10T22:00:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 --2- 172.21.15.39:0/3730860611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b810f3e0 0x7f26b81117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 --2- 172.21.15.39:0/3730860611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8102150 0x7f26b810eea0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 --2- 172.21.15.39:0/3730860611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b8101830 0x7f26b8101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 -- 172.21.15.39:0/3730860611 >> 172.21.15.39:0/3730860611 conn(0x7f26b80fd700 msgr2=0x7f26b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.385+0000 7f26bff8f640 1 -- 172.21.15.39:0/3730860611 shutdown_connections 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 -- 172.21.15.39:0/3730860611 wait complete. 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 Processor -- start 2024-09-10T22:00:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 -- start start 2024-09-10T22:00:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 0x7f26b819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b810f3e0 0x7f26b81a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.386+0000 7f26bff8f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26b8114f20 con 0x7f26b8101830 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bff8f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26b8114da0 con 0x7f26b810f3e0 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bff8f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81150a0 con 0x7f26b8102150 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42776/0 (socket says 172.21.15.39:42776) 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1562841932 learned_addr learned my addr 172.21.15.39:0/1562841932 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26be52c640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b810f3e0 0x7f26b81a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bd52a640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 0x7f26b819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1562841932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 msgr2=0x7f26b819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 0x7f26b819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1562841932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b810f3e0 msgr2=0x7f26b81a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b810f3e0 0x7f26b81a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1562841932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b81a15f0 con 0x7f26b8101830 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bd52a640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 0x7f26b819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9f0 tx=0x7f26b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26aeffd640 1 -- 172.21.15.39:0/1562841932 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b400cd80 con 0x7f26b8101830 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b81a18e0 con 0x7f26b8101830 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26aeffd640 1 -- 172.21.15.39:0/1562841932 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b40108e0 con 0x7f26b8101830 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26aeffd640 1 -- 172.21.15.39:0/1562841932 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4018980 con 0x7f26b8101830 2024-09-10T22:00:23.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.387+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b81a7fa0 con 0x7f26b8101830 2024-09-10T22:00:23.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.390+0000 7f26aeffd640 1 -- 172.21.15.39:0/1562841932 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f26b4010430 con 0x7f26b8101830 2024-09-10T22:00:23.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.390+0000 7f26c2364740 1 Processor -- start 2024-09-10T22:00:23.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.390+0000 7f26c2364740 1 -- start start 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.390+0000 7f26c2364740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c6d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26c2364740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26c2364740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c799a0 0x556645c7bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26c2364740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556645be3ea0 con 0x556645c6da10 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26c2364740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556645bd32d0 con 0x556645c6d0f0 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26c2364740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556645bd70e0 con 0x556645c799a0 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26bdd2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26be52c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c6d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26bdd2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42780/0 (socket says 172.21.15.39:42780) 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1345296286 learned_addr learned my addr 172.21.15.39:0/1345296286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26bd52a640 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c799a0 0x556645c7bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.391+0000 7f26aeffd640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 0x7f26a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1345296286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c799a0 msgr2=0x556645c7bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c799a0 0x556645c7bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1345296286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 msgr2=0x556645c6d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c6d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 -- 172.21.15.39:0/1345296286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556645931650 con 0x556645c6da10 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26aeffd640 1 -- 172.21.15.39:0/1562841932 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26b40e5fc0 con 0x7f26b8101830 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26be52c640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 0x7f26a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.392+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26b40a9a00 tx=0x7f26b4024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a68d902695cb79e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26a3fff640 1 -- 172.21.15.39:0/1345296286 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40cf070 con 0x556645c6da10 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26a3fff640 1 -- 172.21.15.39:0/1345296286 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b40ac2a0 con 0x556645c6da10 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26a3fff640 1 -- 172.21.15.39:0/1345296286 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40b5d20 con 0x556645c6da10 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26c2364740 1 -- 172.21.15.39:0/1345296286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 msgr2=0x556645c79460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26be52c640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 0x7f26a40b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f26b000aed0 tx=0x7f26b0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26c2364740 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26b40a9a00 tx=0x7f26b4024000 comp rx=0 tx=0).stop 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26c2364740 1 -- 172.21.15.39:0/1345296286 shutdown_connections 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.393+0000 7f26c2364740 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c799a0 0x556645c7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6da10 0x556645c79460 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 --2- 172.21.15.39:0/1345296286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c6d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 -- 172.21.15.39:0/1345296286 >> 172.21.15.39:0/1345296286 conn(0x556645c6af20 msgr2=0x556645c6c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 -- 172.21.15.39:0/1345296286 shutdown_connections 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 -- 172.21.15.39:0/1345296286 wait complete. 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 -- start start 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.394+0000 7f26c2364740 1 Processor -- start 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c79230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c76680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556645a34700 con 0x556645c799a0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556645b6e160 con 0x556645c6d0f0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556645c7c5c0 con 0x556645c6da10 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26c2364740 10 client.0 _ll_register_callbacks cb 0x556645b879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42782/0 (socket says 172.21.15.39:42782) 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26bd52a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c76680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 -- 172.21.15.39:0/112392981 learned_addr learned my addr 172.21.15.39:0/112392981 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c79230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 -- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 msgr2=0x556645c76680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c76680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 -- 172.21.15.39:0/112392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 msgr2=0x556645c79230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c79230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26be52c640 1 -- 172.21.15.39:0/112392981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556645b9bc90 con 0x556645c799a0 2024-09-10T22:00:23.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26bd52a640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c76680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:23.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.395+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c79230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26be52c640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f26b0012420 tx=0x7f26b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6a65ce86ddd07f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0022070 con 0x556645c799a0 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26b000fbb0 con 0x556645c799a0 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b40ac2a0 con 0x556645c799a0 2024-09-10T22:00:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26b000fdb0 con 0x556645c799a0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26c2364740 10 client.16656 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556645c87f20 con 0x556645c799a0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.396+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b40ac2a0 con 0x556645c799a0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f26b001b040 con 0x556645c799a0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 10 client.16656 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 10 client.16656 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 20 client.16656 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645c89430 0x556645c8b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 4 client.16656 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556645be5df0 con 0x556645c89430 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.397+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645c89430 0x556645c8b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.398+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645c89430 0x556645c8b870 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5b5e59a5b127404e server_cookie=88e6f4bf4202d42e in_seq=0 out_seq=0 2024-09-10T22:00:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.398+0000 7f26a17fa640 10 client.16656 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.398+0000 7f26a17fa640 1 -- 172.21.15.39:0/112392981 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556645be5df0 con 0x556645c89430 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.398+0000 7f26a17fa640 10 client.16656 handle_command_reply: tid=0 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.398+0000 7f26c2364740 1 client.16656 shutdown 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 msgr2=0x556645c76c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f26b0012420 tx=0x7f26b0004ab0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 shutdown_connections 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645c89430 0x556645c8b870 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c76c20 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26a17fa640 0 client.16656 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c76680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 --2- 172.21.15.39:0/112392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6d0f0 0x556645c79230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 >> 172.21.15.39:0/112392981 conn(0x556645c6af20 msgr2=0x556645c70ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 shutdown_connections 2024-09-10T22:00:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 1 -- 172.21.15.39:0/112392981 wait complete. 2024-09-10T22:00:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.399+0000 7f26c2364740 20 client.16656 trim_cache size 0 max 16384 2024-09-10T22:00:23.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.412+0000 7f26c2364740 1 Processor -- start 2024-09-10T22:00:23.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.412+0000 7f26c2364740 1 -- start start 2024-09-10T22:00:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 0x556645c85820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c799a0 0x556645c75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81b06c0 con 0x556645c6d0f0 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81b2290 con 0x556645c799a0 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26c2364740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81b0d90 con 0x556645c6da10 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bd52a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bd52a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:56064/0 (socket says 172.21.15.39:56064) 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bd52a640 1 -- 172.21.15.39:0/187546874 learned_addr learned my addr 172.21.15.39:0/187546874 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 0x556645c85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26be52c640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c799a0 0x556645c75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 -- 172.21.15.39:0/187546874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 msgr2=0x556645c74f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 -- 172.21.15.39:0/187546874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c799a0 msgr2=0x556645c75440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c799a0 0x556645c75440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.413+0000 7f26bdd2b640 1 -- 172.21.15.39:0/187546874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556645c795a0 con 0x556645c6d0f0 2024-09-10T22:00:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.414+0000 7f26bd52a640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.414+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 0x556645c85820 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ac490 tx=0x7f26b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4800a37223d3e568 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.414+0000 7f26a37fe640 1 -- 172.21.15.39:0/187546874 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40cf040 con 0x556645c6d0f0 2024-09-10T22:00:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.414+0000 7f26a37fe640 1 -- 172.21.15.39:0/187546874 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b40ac2a0 con 0x556645c6d0f0 2024-09-10T22:00:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.414+0000 7f26a37fe640 1 -- 172.21.15.39:0/187546874 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40a8a00 con 0x556645c6d0f0 2024-09-10T22:00:23.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 -- 172.21.15.39:0/187546874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 msgr2=0x556645c85820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 0x556645c85820 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ac490 tx=0x7f26b4000bc0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 -- 172.21.15.39:0/187546874 shutdown_connections 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c799a0 0x556645c75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6da10 0x556645c74f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 --2- 172.21.15.39:0/187546874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c6d0f0 0x556645c85820 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 -- 172.21.15.39:0/187546874 >> 172.21.15.39:0/187546874 conn(0x556645c6af20 msgr2=0x556645c6c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 -- 172.21.15.39:0/187546874 shutdown_connections 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.415+0000 7f26c2364740 1 -- 172.21.15.39:0/187546874 wait complete. 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 -- start start 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 Processor -- start 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6d0f0 0x556645c820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c7db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81b1b30 con 0x556645c799a0 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81b1460 con 0x556645c6da10 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26b81ae6a0 con 0x556645c6d0f0 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.416+0000 7f26c2364740 10 client.0 _ll_register_callbacks cb 0x7f26b000a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26bd52a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c7db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26bd52a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38642/0 (socket says 172.21.15.39:38642) 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26bd52a640 1 -- 172.21.15.39:0/2909826180 learned_addr learned my addr 172.21.15.39:0/2909826180 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 -- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6d0f0 msgr2=0x556645c820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6d0f0 0x556645c820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 -- 172.21.15.39:0/2909826180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 msgr2=0x556645c7d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 -- 172.21.15.39:0/2909826180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556645c7e370 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26bd52a640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26be52c640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c7db40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26b001e850 tx=0x7f26b000f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798a855f844c3105 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.417+0000 7f26a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0022070 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f26b001eae0 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b40ac2a0 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f26b001ece0 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26c2364740 10 client.16662 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556645cf6420 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b40ac2a0 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f26b0027460 con 0x556645c799a0 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.418+0000 7f26c2364740 10 client.16662 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26c2364740 10 client.16662 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26c2364740 20 client.16662 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:23.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645cf6b40 0x556645cf8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:23.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26c2364740 4 client.16662 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:00:23.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556645be18a0 con 0x556645cf6b40 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645cf6b40 0x556645cf8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26a17fa640 10 client.16662 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.419+0000 7f26bdd2b640 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645cf6b40 0x556645cf8f60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=84b04a0b90db9d79 server_cookie=6b35181328adad0 in_seq=0 out_seq=0 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26a17fa640 1 -- 172.21.15.39:0/2909826180 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556645be18a0 con 0x556645cf6b40 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26a17fa640 10 client.16662 handle_command_reply: tid=0 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 client.16662 shutdown 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 msgr2=0x556645c7db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c7db40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26b001e850 tx=0x7f26b000f900 comp rx=0 tx=0).stop 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 shutdown_connections 2024-09-10T22:00:23.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x556645cf6b40 0x556645cf8f60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556645c799a0 0x556645c7db40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556645c6da10 0x556645c7d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26a17fa640 0 client.16662 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 --2- 172.21.15.39:0/2909826180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556645c6d0f0 0x556645c820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 >> 172.21.15.39:0/2909826180 conn(0x556645c6af20 msgr2=0x556645c6beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 shutdown_connections 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 1 -- 172.21.15.39:0/2909826180 wait complete. 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.420+0000 7f26c2364740 20 client.16662 trim_cache size 0 max 16384 2024-09-10T22:00:23.425 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 msgr2=0x7f26a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 0x7f26a40b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f26b000aed0 tx=0x7f26b0004a40 comp rx=0 tx=0).stop 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 msgr2=0x7f26b819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9f0 tx=0x7f26b400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 shutdown_connections 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f26a40b52e0 0x7f26a40b77a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b810f3e0 0x7f26b81a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b8102150 0x7f26b819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 --2- 172.21.15.39:0/1562841932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26b8101830 0x7f26b819b540 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:23.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 >> 172.21.15.39:0/1562841932 conn(0x7f26b80fd700 msgr2=0x7f26b80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:23.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 shutdown_connections 2024-09-10T22:00:23.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:23.421+0000 7f26bff8f640 1 -- 172.21.15.39:0/1562841932 wait complete. 2024-09-10T22:00:24.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T22:00:24.365 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:24.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.857+0000 7f0488f77640 1 -- 172.21.15.39:0/818352894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 msgr2=0x7f048410cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.857+0000 7f0488f77640 1 --2- 172.21.15.39:0/818352894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f048410cb70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0478009900 tx=0x7f047802a410 comp rx=0 tx=0).stop 2024-09-10T22:00:24.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 -- 172.21.15.39:0/818352894 shutdown_connections 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 --2- 172.21.15.39:0/818352894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f048410d140 0x7f048410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 --2- 172.21.15.39:0/818352894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f048410cb70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 --2- 172.21.15.39:0/818352894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0484103b90 0x7f0484103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 -- 172.21.15.39:0/818352894 >> 172.21.15.39:0/818352894 conn(0x7f04840fd700 msgr2=0x7f04840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 -- 172.21.15.39:0/818352894 shutdown_connections 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.858+0000 7f0488f77640 1 -- 172.21.15.39:0/818352894 wait complete. 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 Processor -- start 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 -- start start 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 0x7f04841992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f0484199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048410d140 0x7f048419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0484112d60 con 0x7f0484104590 2024-09-10T22:00:24.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0484112be0 con 0x7f0484103b90 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0488f77640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0484112ee0 con 0x7f048410d140 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f0484199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f0484199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42814/0 (socket says 172.21.15.39:42814) 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0481d9b640 1 -- 172.21.15.39:0/1350546526 learned_addr learned my addr 172.21.15.39:0/1350546526 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 0x7f04841992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f0482d9d640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048410d140 0x7f048419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 -- 172.21.15.39:0/1350546526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048410d140 msgr2=0x7f048419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048410d140 0x7f048419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 -- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 msgr2=0x7f0484199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f0484199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.859+0000 7f048259c640 1 -- 172.21.15.39:0/1350546526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048419f3a0 con 0x7f0484103b90 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f048259c640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 0x7f04841992f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f047400d6d0 tx=0x7f047400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f04737fe640 1 -- 172.21.15.39:0/1350546526 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474017070 con 0x7f0484103b90 2024-09-10T22:00:24.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f04737fe640 1 -- 172.21.15.39:0/1350546526 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0474009820 con 0x7f0484103b90 2024-09-10T22:00:24.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048419f690 con 0x7f0484103b90 2024-09-10T22:00:24.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f04737fe640 1 -- 172.21.15.39:0/1350546526 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474004c40 con 0x7f0484103b90 2024-09-10T22:00:24.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.860+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04841a5d50 con 0x7f0484103b90 2024-09-10T22:00:24.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.862+0000 7f04737fe640 1 -- 172.21.15.39:0/1350546526 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0474005220 con 0x7f0484103b90 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.863+0000 7f048b34c740 1 Processor -- start 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.863+0000 7f048b34c740 1 -- start start 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.863+0000 7f04737fe640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 0x7f046c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.863+0000 7f0482d9d640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 0x7f046c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.863+0000 7f04737fe640 1 -- 172.21.15.39:0/1350546526 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f04740e5680 con 0x7f0484103b90 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564172644ea0 con 0x5641726da9a0 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641726342d0 con 0x5641726ce0f0 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048b34c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5641726380e0 con 0x5641726cea10 2024-09-10T22:00:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38652/0 (socket says 172.21.15.39:38652) 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 -- 172.21.15.39:0/2910915786 learned_addr learned my addr 172.21.15.39:0/2910915786 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f0482d9d640 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 -- 172.21.15.39:0/2910915786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 msgr2=0x5641726da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 -- 172.21.15.39:0/2910915786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 msgr2=0x5641726dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f0482d9d640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 0x7f046c0b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f048406bb90 tx=0x7f047c011810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 -- 172.21.15.39:0/2910915786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564172392650 con 0x5641726ce0f0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.864+0000 7f048259c640 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0474009610 tx=0x7f04740ab710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4448ceb87ed57779 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f0470ff9640 1 -- 172.21.15.39:0/2910915786 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474020070 con 0x5641726ce0f0 2024-09-10T22:00:24.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f0470ff9640 1 -- 172.21.15.39:0/2910915786 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04740b5380 con 0x5641726ce0f0 2024-09-10T22:00:24.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f0470ff9640 1 -- 172.21.15.39:0/2910915786 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04740e5110 con 0x5641726ce0f0 2024-09-10T22:00:24.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 -- 172.21.15.39:0/2910915786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 msgr2=0x5641726ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0474009610 tx=0x7f04740ab710 comp rx=0 tx=0).stop 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 -- 172.21.15.39:0/2910915786 shutdown_connections 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 --2- 172.21.15.39:0/2910915786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ce4d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 -- 172.21.15.39:0/2910915786 >> 172.21.15.39:0/2910915786 conn(0x5641726cbf20 msgr2=0x5641726cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 -- 172.21.15.39:0/2910915786 shutdown_connections 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.865+0000 7f048b34c740 1 -- 172.21.15.39:0/2910915786 wait complete. 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 -- start start 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 Processor -- start 2024-09-10T22:00:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 0x5641726d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564172495700 con 0x5641726ce0f0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641725cf160 con 0x5641726da9a0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5641726dd5c0 con 0x5641726cea10 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048b34c740 10 client.0 _ll_register_callbacks cb 0x5641725e89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42838/0 (socket says 172.21.15.39:42838) 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f048259c640 1 -- 172.21.15.39:0/3928835209 learned_addr learned my addr 172.21.15.39:0/3928835209 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.866+0000 7f0482d9d640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 0x5641726d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 -- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 msgr2=0x5641726d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 -- 172.21.15.39:0/3928835209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 msgr2=0x5641726d7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 0x5641726d7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 -- 172.21.15.39:0/3928835209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641725fcc90 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0482d9d640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 0x5641726d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048259c640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0474009f40 tx=0x7f0474009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b146005413e53a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474020070 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0474093120 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04740b5380 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0474093320 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048b34c740 10 client.16674 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.867+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5641726e8f70 con 0x5641726ce0f0 2024-09-10T22:00:24.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04740b5380 con 0x5641726ce0f0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f04740a79b0 con 0x5641726ce0f0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 10 client.16674 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 10 client.16674 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 20 client.16674 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5641726ea2c0 0x5641726ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 4 client.16674 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564172646df0 con 0x5641726ea2c0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.868+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5641726ea2c0 0x5641726ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5641726ea2c0 0x5641726ec6b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3846bcb07701998b server_cookie=28ff5b018562c049 in_seq=0 out_seq=0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f0469ffb640 10 client.16674 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f0469ffb640 1 -- 172.21.15.39:0/3928835209 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564172646df0 con 0x5641726ea2c0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f0469ffb640 10 client.16674 handle_command_reply: tid=0 2024-09-10T22:00:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f048b34c740 1 client.16674 shutdown 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 msgr2=0x5641726da310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.869+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0474009f40 tx=0x7f0474009c00 comp rx=0 tx=0).stop 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 shutdown_connections 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x5641726ea2c0 0x5641726ec6b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726da9a0 0x5641726d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726cea10 0x5641726d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f0469ffb640 0 client.16674 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 --2- 172.21.15.39:0/3928835209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726ce0f0 0x5641726da310 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 >> 172.21.15.39:0/3928835209 conn(0x5641726cbf20 msgr2=0x5641726d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 shutdown_connections 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 1 -- 172.21.15.39:0/3928835209 wait complete. 2024-09-10T22:00:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.870+0000 7f048b34c740 20 client.16674 trim_cache size 0 max 16384 2024-09-10T22:00:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 Processor -- start 2024-09-10T22:00:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 -- start start 2024-09-10T22:00:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726ce0f0 0x5641726cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f04841ac1f0 con 0x5641726da9a0 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04841addc0 con 0x5641726cea10 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.883+0000 7f048b34c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04841ac8c0 con 0x5641726ce0f0 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0482d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38678/0 (socket says 172.21.15.39:38678) 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 -- 172.21.15.39:0/3561383568 learned_addr learned my addr 172.21.15.39:0/3561383568 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0482d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726d4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42850/0 (socket says 172.21.15.39:42850) 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f048259c640 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726ce0f0 0x5641726cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 -- 172.21.15.39:0/3561383568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726ce0f0 msgr2=0x5641726cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726ce0f0 0x5641726cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 -- 172.21.15.39:0/3561383568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 msgr2=0x5641726d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726d4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 -- 172.21.15.39:0/3561383568 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641726d8150 con 0x5641726cea10 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f0481d9b640 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0478006010 tx=0x7f0478004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=166e0e734d35a08c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f046bfff640 1 -- 172.21.15.39:0/3561383568 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478049020 con 0x5641726cea10 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f046bfff640 1 -- 172.21.15.39:0/3561383568 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0478031950 con 0x5641726cea10 2024-09-10T22:00:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.884+0000 7f046bfff640 1 -- 172.21.15.39:0/3561383568 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478035040 con 0x5641726cea10 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- 172.21.15.39:0/3561383568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 msgr2=0x5641726d94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0478006010 tx=0x7f0478004260 comp rx=0 tx=0).stop 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- 172.21.15.39:0/3561383568 shutdown_connections 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726da9a0 0x5641726d4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726cea10 0x5641726d94a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 --2- 172.21.15.39:0/3561383568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726ce0f0 0x5641726cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- 172.21.15.39:0/3561383568 >> 172.21.15.39:0/3561383568 conn(0x5641726cbf20 msgr2=0x5641726d8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- 172.21.15.39:0/3561383568 shutdown_connections 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- 172.21.15.39:0/3561383568 wait complete. 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.885+0000 7f048b34c740 1 -- start start 2024-09-10T22:00:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 Processor -- start 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 0x56417274fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f04841ad660 con 0x5641726cea10 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04841acf90 con 0x5641726ce0f0 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04841aa1d0 con 0x5641726da9a0 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048b34c740 10 client.0 _ll_register_callbacks cb 0x7f047c009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ebfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38692/0 (socket says 172.21.15.39:38692) 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f048259c640 1 -- 172.21.15.39:0/2248583932 learned_addr learned my addr 172.21.15.39:0/2248583932 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42866/0 (socket says 172.21.15.39:42866) 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0482d9d640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 0x56417274fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 -- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 msgr2=0x56417274fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 0x56417274fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 -- 172.21.15.39:0/2248583932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 msgr2=0x5641726ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0481d9b640 1 -- 172.21.15.39:0/2248583932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564172750530 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.886+0000 7f0482d9d640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 0x56417274fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0481d9b640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5641726cefb0 tx=0x7f04780314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9eb59424cb7f2af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478035070 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0478003e70 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641726428a0 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f04780035f0 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f048b34c740 10 client.16680 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564172757900 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5641726428a0 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.887+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f047803c9f0 con 0x5641726cea10 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 10 client.16680 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 10 client.16680 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 20 client.16680 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x564172757ff0 0x56417275a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 4 client.16680 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56417263fcd0 con 0x564172757ff0 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048259c640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x564172757ff0 0x56417275a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f048259c640 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x564172757ff0 0x56417275a410 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=342a6554c61c8261 server_cookie=c70d159fbbdc3b45 in_seq=0 out_seq=0 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.888+0000 7f0469ffb640 10 client.16680 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f0469ffb640 1 -- 172.21.15.39:0/2248583932 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56417263fcd0 con 0x564172757ff0 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f0469ffb640 10 client.16680 handle_command_reply: tid=0 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 client.16680 shutdown 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 msgr2=0x5641726ec540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5641726cefb0 tx=0x7f04780314a0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 shutdown_connections 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5641726da9a0 0x56417274fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641726cea10 0x5641726ec540 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x564172757ff0 0x56417275a410 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 --2- 172.21.15.39:0/2248583932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641726ce0f0 0x5641726ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 >> 172.21.15.39:0/2248583932 conn(0x5641726cbf20 msgr2=0x5641726d95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f0469ffb640 0 client.16680 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 shutdown_connections 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 1 -- 172.21.15.39:0/2248583932 wait complete. 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.889+0000 7f048b34c740 20 client.16680 trim_cache size 0 max 16384 2024-09-10T22:00:24.896 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:00:24.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 msgr2=0x7f046c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 0x7f046c0b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f048406bb90 tx=0x7f047c011810 comp rx=0 tx=0).stop 2024-09-10T22:00:24.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 msgr2=0x7f04841992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:24.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 0x7f04841992f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f047400d6d0 tx=0x7f047400db90 comp rx=0 tx=0).stop 2024-09-10T22:00:24.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 shutdown_connections 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f046c0b52e0 0x7f046c0b77a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048410d140 0x7f048419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0484104590 0x7f0484199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 --2- 172.21.15.39:0/1350546526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0484103b90 0x7f04841992f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 >> 172.21.15.39:0/1350546526 conn(0x7f04840fd700 msgr2=0x7f04840fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 shutdown_connections 2024-09-10T22:00:24.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:24.890+0000 7f0488f77640 1 -- 172.21.15.39:0/1350546526 wait complete. 2024-09-10T22:00:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:24 smithi070 ceph-mon[34909]: pgmap v503: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2024-09-10T22:00:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:24 smithi039 ceph-mon[30872]: pgmap v503: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2024-09-10T22:00:25.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:24 smithi173 ceph-mon[35294]: pgmap v503: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2843062234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0101860 msgr2=0x7f3fb0101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2843062234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0101860 0x7f3fb0101c60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009930 tx=0x7f3fac02a420 comp rx=0 tx=0).stop 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2843062234 shutdown_connections 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2843062234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0103370 0x7f3fb0109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2843062234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 0x7f3fb0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2843062234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0101860 0x7f3fb0101c60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2843062234 >> 172.21.15.39:0/2843062234 conn(0x7f3fb00fd140 msgr2=0x7f3fb00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2843062234 shutdown_connections 2024-09-10T22:00:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2843062234 wait complete. 2024-09-10T22:00:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.369+0000 7f3fb7a52640 1 Processor -- start 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 -- start start 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 0x7f3fb019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010d4d0 con 0x7f3fb0103370 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010d350 con 0x7f3fb0101860 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb7a52640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb010d650 con 0x7f3fb01029b0 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb5fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38710/0 (socket says 172.21.15.39:38710) 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 -- 172.21.15.39:0/2212858227 learned_addr learned my addr 172.21.15.39:0/2212858227 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb5fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42880/0 (socket says 172.21.15.39:42880) 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 0x7f3fb019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 -- 172.21.15.39:0/2212858227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 msgr2=0x7f3fb019b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 0x7f3fb019b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 -- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 msgr2=0x7f3fb019c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 -- 172.21.15.39:0/2212858227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb019caf0 con 0x7f3fb0101860 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb5fef640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.370+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009a50 tx=0x7f3fac0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.371+0000 7f3fa67fc640 1 -- 172.21.15.39:0/2212858227 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac03f030 con 0x7f3fb0101860 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.371+0000 7f3fa67fc640 1 -- 172.21.15.39:0/2212858227 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fac031910 con 0x7f3fb0101860 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.371+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb019cd80 con 0x7f3fb0101860 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.371+0000 7f3fa67fc640 1 -- 172.21.15.39:0/2212858227 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac035070 con 0x7f3fb0101860 2024-09-10T22:00:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.371+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb01a34b0 con 0x7f3fb0101860 2024-09-10T22:00:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.373+0000 7f3fba821740 1 Processor -- start 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.373+0000 7f3fba821740 1 -- start start 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a6190 0x558c667a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 0x558c667ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c667156f0 con 0x558c667a3860 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c66704b20 con 0x558c667a8bd0 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fba821740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c66708930 con 0x558c667a6190 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fa67fc640 1 -- 172.21.15.39:0/2212858227 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3fac03ba60 con 0x7f3fb0101860 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb5fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 0x558c667ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb5fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42886/0 (socket says 172.21.15.39:42886) 2024-09-10T22:00:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb5fef640 1 -- 172.21.15.39:0/1506693740 learned_addr learned my addr 172.21.15.39:0/1506693740 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 -- 172.21.15.39:0/1506693740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a6190 msgr2=0x558c667a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a6190 0x558c667a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 -- 172.21.15.39:0/1506693740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 msgr2=0x558c667a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 -- 172.21.15.39:0/1506693740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c666ca530 con 0x558c667a8bd0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.374+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 0x558c667ab090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009b70 tx=0x7f3fa00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68adadd92260915 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3f9b7fe640 1 -- 172.21.15.39:0/1506693740 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0009e60 con 0x558c667a8bd0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3f9b7fe640 1 -- 172.21.15.39:0/1506693740 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fa0012900 con 0x558c667a8bd0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3f9b7fe640 1 -- 172.21.15.39:0/1506693740 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000fae0 con 0x558c667a8bd0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3fa67fc640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 0x7f3f9c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3fb5fef640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 0x7f3f9c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3fa67fc640 1 -- 172.21.15.39:0/2212858227 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3fac106450 con 0x7f3fb0101860 2024-09-10T22:00:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3fba821740 1 -- 172.21.15.39:0/1506693740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 msgr2=0x558c667ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.375+0000 7f3fb5fef640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 0x7f3f9c0b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009fd0 tx=0x7f3fa8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 0x558c667ab090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009b70 tx=0x7f3fa00117b0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 -- 172.21.15.39:0/1506693740 shutdown_connections 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a8bd0 0x558c667ab090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a6190 0x558c667a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- 172.21.15.39:0/1506693740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 -- 172.21.15.39:0/1506693740 >> 172.21.15.39:0/1506693740 conn(0x558c6679e9b0 msgr2=0x558c6679f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 -- 172.21.15.39:0/1506693740 shutdown_connections 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 -- 172.21.15.39:0/1506693740 wait complete. 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 -- start start 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 Processor -- start 2024-09-10T22:00:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a3860 0x558c667acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.376+0000 7f3fba821740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fba821740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a8bd0 0x558c667ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fba821740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558c6663cab0 con 0x558c667a8bd0 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fba821740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c666aa730 con 0x558c667a6190 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fba821740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558c667abbb0 con 0x558c667a3860 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fba821740 10 client.0 _ll_register_callbacks cb 0x558c666fe6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb5fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a8bd0 0x558c667ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38738/0 (socket says 172.21.15.39:38738) 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 -- 172.21.15.39:0/753184751 learned_addr learned my addr 172.21.15.39:0/753184751 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a3860 0x558c667acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 -- 172.21.15.39:0/753184751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a3860 msgr2=0x558c667acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a3860 0x558c667acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 -- 172.21.15.39:0/753184751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a8bd0 msgr2=0x558c667ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a8bd0 0x558c667ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 -- 172.21.15.39:0/753184751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c66466790 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0012660 tx=0x7f3fa0012690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b8d36fd1a33b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.377+0000 7f3f98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0028070 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3fa0005040 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa0012900 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3fa0034050 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 10 client.26318 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558c664df620 con 0x558c667a6190 2024-09-10T22:00:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fa0012900 con 0x558c667a6190 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f3fa00046c0 con 0x558c667a6190 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 10 client.26318 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 10 client.26318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 20 client.26318 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c667b84e0 0x558c667ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 4 client.26318 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.378+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c66717640 con 0x558c667b84e0 2024-09-10T22:00:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.379+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c667b84e0 0x558c667ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.379+0000 7f3f98ff9640 10 client.26318 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.379+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c667b84e0 0x558c667ba8d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a37ecbeca503acc2 server_cookie=7433949f7bf8540b in_seq=0 out_seq=0 2024-09-10T22:00:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3f98ff9640 1 -- 172.21.15.39:0/753184751 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c66717640 con 0x558c667b84e0 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3f98ff9640 10 client.26318 handle_command_reply: tid=0 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 client.26318 shutdown 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 msgr2=0x558c667ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0012660 tx=0x7f3fa0012690 comp rx=0 tx=0).stop 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 shutdown_connections 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c667b84e0 0x558c667ba8d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a8bd0 0x558c667ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ad5c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 --2- 172.21.15.39:0/753184751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a3860 0x558c667acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3f98ff9640 0 client.26318 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 >> 172.21.15.39:0/753184751 conn(0x558c6679e9b0 msgr2=0x558c6679dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 shutdown_connections 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 1 -- 172.21.15.39:0/753184751 wait complete. 2024-09-10T22:00:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.381+0000 7f3fba821740 20 client.26318 trim_cache size 0 max 16384 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.402+0000 7f3fba821740 1 Processor -- start 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 -- start start 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ac080 con 0x558c667a3860 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01adc50 con 0x558c667a6190 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fba821740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ac750 con 0x558c667a8bd0 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42908/0 (socket says 172.21.15.39:42908) 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38746/0 (socket says 172.21.15.39:38746) 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 -- 172.21.15.39:0/1835323579 learned_addr learned my addr 172.21.15.39:0/1835323579 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb5fef640 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 -- 172.21.15.39:0/1835323579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 msgr2=0x558c667a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 -- 172.21.15.39:0/1835323579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 msgr2=0x558c667ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb57ee640 1 -- 172.21.15.39:0/1835323579 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c667a88f0 con 0x558c667a3860 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.403+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.404+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0096c0 tx=0x7f3fac005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b67adf89a2a79c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.404+0000 7f3f9affd640 1 -- 172.21.15.39:0/1835323579 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac049040 con 0x558c667a3860 2024-09-10T22:00:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.404+0000 7f3f9affd640 1 -- 172.21.15.39:0/1835323579 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fac0cd320 con 0x558c667a3860 2024-09-10T22:00:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.404+0000 7f3f9affd640 1 -- 172.21.15.39:0/1835323579 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0c8e90 con 0x558c667a3860 2024-09-10T22:00:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- 172.21.15.39:0/1835323579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 msgr2=0x558c667ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0096c0 tx=0x7f3fac005e60 comp rx=0 tx=0).stop 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- 172.21.15.39:0/1835323579 shutdown_connections 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 --2- 172.21.15.39:0/1835323579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667ac160 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- 172.21.15.39:0/1835323579 >> 172.21.15.39:0/1835323579 conn(0x558c6679e9b0 msgr2=0x558c667a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- 172.21.15.39:0/1835323579 shutdown_connections 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- 172.21.15.39:0/1835323579 wait complete. 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 -- start start 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.405+0000 7f3fba821740 1 Processor -- start 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ad4f0 con 0x558c667a3860 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ace20 con 0x558c667a6190 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01aa060 con 0x558c667a8bd0 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 10 client.0 _ll_register_callbacks cb 0x7f3fa8009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb4fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42924/0 (socket says 172.21.15.39:42924) 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 -- 172.21.15.39:0/3573331204 learned_addr learned my addr 172.21.15.39:0/3573331204 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb5fef640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 -- 172.21.15.39:0/3573331204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 msgr2=0x558c667b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 -- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 msgr2=0x558c667b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 -- 172.21.15.39:0/3573331204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c667b2520 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fb57ee640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0cc920 tx=0x7f3fac005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dac39a055467c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3f98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac049040 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3fac1060f0 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.406+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fac0cd320 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3fac0ccc20 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 10 client.16698 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558c66825760 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fac0cd320 con 0x558c667a3860 2024-09-10T22:00:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f3fac078bf0 con 0x558c667a3860 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 10 client.16698 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 10 client.16698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 20 client.16698 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c668260e0 0x558c66828500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 4 client.16698 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558c667130f0 con 0x558c668260e0 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.407+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c668260e0 0x558c66828500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.408+0000 7f3fb4fed640 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c668260e0 0x558c66828500 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17fc681f983e91dc server_cookie=3f31437379c25e01 in_seq=0 out_seq=0 2024-09-10T22:00:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:25.408+0000 7f3f98ff9640 10 client.16698 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:25.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:00:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:26.502 INFO:tasks.workunit.client.0.smithi039.stdout: 113 108840 221 71549 160 66848 526 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 -- 172.21.15.39:0/2315176412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 msgr2=0x7fa65010cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 --2- 172.21.15.39:0/2315176412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65010cd10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa638009900 tx=0x7fa63802a410 comp rx=0 tx=0).stop 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 -- 172.21.15.39:0/2315176412 shutdown_connections 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 --2- 172.21.15.39:0/2315176412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65010d250 0x7fa65010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 --2- 172.21.15.39:0/2315176412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65010cd10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 --2- 172.21.15.39:0/2315176412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa650101810 0x7fa650101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 -- 172.21.15.39:0/2315176412 >> 172.21.15.39:0/2315176412 conn(0x7fa650076f50 msgr2=0x7fa650077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 -- 172.21.15.39:0/2315176412 shutdown_connections 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.605+0000 7fa655e05640 1 -- 172.21.15.39:0/2315176412 wait complete. 2024-09-10T22:00:26.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 Processor -- start 2024-09-10T22:00:26.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 -- start start 2024-09-10T22:00:26.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa650101810 0x7fa65019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa650112d90 con 0x7fa65010d250 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa650112c10 con 0x7fa65010a920 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa655e05640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa650112f10 con 0x7fa650101810 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38774/0 (socket says 172.21.15.39:38774) 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64effd640 1 -- 172.21.15.39:0/893229606 learned_addr learned my addr 172.21.15.39:0/893229606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42940/0 (socket says 172.21.15.39:42940) 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.606+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa650101810 0x7fa65019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 -- 172.21.15.39:0/893229606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa650101810 msgr2=0x7fa65019b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa650101810 0x7fa65019b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 -- 172.21.15.39:0/893229606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 msgr2=0x7fa65019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 -- 172.21.15.39:0/893229606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6501a1520 con 0x7fa65010d250 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64effd640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64ffff640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e970 tx=0x7fa64800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64cff9640 1 -- 172.21.15.39:0/893229606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64800ccc0 con 0x7fa65010d250 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64cff9640 1 -- 172.21.15.39:0/893229606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa648005020 con 0x7fa65010d250 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6501a1810 con 0x7fa65010d250 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa64cff9640 1 -- 172.21.15.39:0/893229606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648004a00 con 0x7fa65010d250 2024-09-10T22:00:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.607+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501a7ed0 con 0x7fa65010d250 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 Processor -- start 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa64cff9640 1 -- 172.21.15.39:0/893229606 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa648004ba0 con 0x7fa65010d250 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 -- start start 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a42170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558bc89a9ea0 con 0x558bc8a3fd80 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558bc89992d0 con 0x558bc8a33df0 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.610+0000 7fa6581da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc899d0e0 con 0x558bc8a334d0 2024-09-10T22:00:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a42170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38784/0 (socket says 172.21.15.39:38784) 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 -- 172.21.15.39:0/761653398 learned_addr learned my addr 172.21.15.39:0/761653398 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64effd640 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 -- 172.21.15.39:0/761653398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 msgr2=0x558bc8a338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 -- 172.21.15.39:0/761653398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 msgr2=0x558bc8a42170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a42170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64cff9640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 0x7fa63c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 -- 172.21.15.39:0/761653398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc86f7650 con 0x558bc8a33df0 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64effd640 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64ffff640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 0x7fa63c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6400114f0 tx=0x7fa6400119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44ab61298c78318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.611+0000 7fa64cff9640 1 -- 172.21.15.39:0/893229606 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa6480e5a90 con 0x7fa65010d250 2024-09-10T22:00:26.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa645ffb640 1 -- 172.21.15.39:0/761653398 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64001e070 con 0x558bc8a33df0 2024-09-10T22:00:26.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa645ffb640 1 -- 172.21.15.39:0/761653398 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa640003c30 con 0x558bc8a33df0 2024-09-10T22:00:26.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa645ffb640 1 -- 172.21.15.39:0/761653398 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000f9b0 con 0x558bc8a33df0 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa6581da740 1 -- 172.21.15.39:0/761653398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 msgr2=0x558bc8a3f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa64ffff640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 0x7fa63c0b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa6480a8830 tx=0x7fa648079730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.612+0000 7fa6581da740 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6400114f0 tx=0x7fa6400119b0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 -- 172.21.15.39:0/761653398 shutdown_connections 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a42170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a3f840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 --2- 172.21.15.39:0/761653398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 -- 172.21.15.39:0/761653398 >> 172.21.15.39:0/761653398 conn(0x558bc8a31300 msgr2=0x558bc8a324a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 -- 172.21.15.39:0/761653398 shutdown_connections 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 -- 172.21.15.39:0/761653398 wait complete. 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 -- start start 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.613+0000 7fa6581da740 1 Processor -- start 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 0x558bc8a3caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x558bc87fa700 con 0x558bc8a3fd80 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558bc8934160 con 0x558bc8a334d0 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc8a42a00 con 0x558bc8a33df0 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa6581da740 10 client.0 _ll_register_callbacks cb 0x558bc894d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:26.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38786/0 (socket says 172.21.15.39:38786) 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 -- 172.21.15.39:0/2263909962 learned_addr learned my addr 172.21.15.39:0/2263909962 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 0x558bc8a3caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 -- 172.21.15.39:0/2263909962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 msgr2=0x558bc8a3caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 0x558bc8a3caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 -- 172.21.15.39:0/2263909962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 msgr2=0x558bc8a3d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 -- 172.21.15.39:0/2263909962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc8961c90 con 0x558bc8a334d0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 0x558bc8a3caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa64effd640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa638006010 tx=0x7fa63802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d732795108b61fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.614+0000 7fa62effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638035040 con 0x558bc8a334d0 2024-09-10T22:00:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa638004440 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa640003c30 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa638005020 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 10 client.26336 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558bc8a4e280 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa640003c30 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa63804a020 con 0x558bc8a334d0 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 10 client.26336 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 10 client.26336 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 20 client.26336 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8a4fa30 0x558bc8a51e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 4 client.26336 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.615+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bc89abdf0 con 0x558bc8a4fa30 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.616+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8a4fa30 0x558bc8a51e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.616+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8a4fa30 0x558bc8a51e40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f4c9f35419fce51 server_cookie=82d0c978a775380f in_seq=0 out_seq=0 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.616+0000 7fa62effd640 10 client.26336 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa62effd640 1 -- 172.21.15.39:0/2263909962 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558bc89abdf0 con 0x558bc8a4fa30 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa62effd640 10 client.26336 handle_command_reply: tid=0 2024-09-10T22:00:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 client.26336 shutdown 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 msgr2=0x558bc8a3f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa638006010 tx=0x7fa63802a410 comp rx=0 tx=0).stop 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 shutdown_connections 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8a4fa30 0x558bc8a51e40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a33df0 0x558bc8a3caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa62effd640 0 client.26336 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 --2- 172.21.15.39:0/2263909962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a334d0 0x558bc8a3f650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 >> 172.21.15.39:0/2263909962 conn(0x558bc8a31300 msgr2=0x558bc8a36ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 shutdown_connections 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.617+0000 7fa6581da740 1 -- 172.21.15.39:0/2263909962 wait complete. 2024-09-10T22:00:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.618+0000 7fa6581da740 20 client.26336 trim_cache size 0 max 16384 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 Processor -- start 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 -- start start 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a3bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501b0620 con 0x558bc8a3fd80 2024-09-10T22:00:26.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501b21f0 con 0x558bc8a33df0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa6581da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501b0cf0 con 0x558bc8a334d0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42978/0 (socket says 172.21.15.39:42978) 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38790/0 (socket says 172.21.15.39:38790) 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64effd640 1 -- 172.21.15.39:0/4275080455 learned_addr learned my addr 172.21.15.39:0/4275080455 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.631+0000 7fa64effd640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a3bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 -- 172.21.15.39:0/4275080455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 msgr2=0x558bc8a3bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a3bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 -- 172.21.15.39:0/4275080455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 msgr2=0x558bc8a3b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 -- 172.21.15.39:0/4275080455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc8a3f9c0 con 0x558bc8a33df0 2024-09-10T22:00:26.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64effd640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa640000f80 tx=0x7fa640009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=559c83a8569ea69f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa6457fa640 1 -- 172.21.15.39:0/4275080455 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64001e040 con 0x558bc8a33df0 2024-09-10T22:00:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa6457fa640 1 -- 172.21.15.39:0/4275080455 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa64002a030 con 0x558bc8a33df0 2024-09-10T22:00:26.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.632+0000 7fa6457fa640 1 -- 172.21.15.39:0/4275080455 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000f560 con 0x558bc8a33df0 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- 172.21.15.39:0/4275080455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 msgr2=0x558bc8a30c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa640000f80 tx=0x7fa640009900 comp rx=0 tx=0).stop 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- 172.21.15.39:0/4275080455 shutdown_connections 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a3fd80 0x558bc8a3b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a30c10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 --2- 172.21.15.39:0/4275080455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a334d0 0x558bc8a3bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- 172.21.15.39:0/4275080455 >> 172.21.15.39:0/4275080455 conn(0x558bc8a31300 msgr2=0x558bc8a32210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- 172.21.15.39:0/4275080455 shutdown_connections 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- 172.21.15.39:0/4275080455 wait complete. 2024-09-10T22:00:26.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 -- start start 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.633+0000 7fa6581da740 1 Processor -- start 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a3fd80 0x558bc8a41730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501b1a90 con 0x558bc8a334d0 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501b13c0 con 0x558bc8a33df0 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6501ae600 con 0x558bc8a3fd80 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa6581da740 10 client.0 _ll_register_callbacks cb 0x7fa638009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42994/0 (socket says 172.21.15.39:42994) 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38800/0 (socket says 172.21.15.39:38800) 2024-09-10T22:00:26.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64effd640 1 -- 172.21.15.39:0/3312923852 learned_addr learned my addr 172.21.15.39:0/3312923852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64effd640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a3fd80 0x558bc8a41730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 -- 172.21.15.39:0/3312923852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a3fd80 msgr2=0x558bc8a41730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a3fd80 0x558bc8a41730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 -- 172.21.15.39:0/3312923852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 msgr2=0x558bc8a484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 -- 172.21.15.39:0/3312923852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc8a43f60 con 0x558bc8a33df0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64effd640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa64f7fe640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa640011eb0 tx=0x7fa640009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3923e0aa6056eeb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.634+0000 7fa62effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640035070 con 0x558bc8a33df0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa640011020 con 0x558bc8a33df0 2024-09-10T22:00:26.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa64002a030 con 0x558bc8a33df0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa640040050 con 0x558bc8a33df0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 10 client.26342 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558bc8abc800 con 0x558bc8a33df0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa64002a030 con 0x558bc8a33df0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa64000f660 con 0x558bc8a33df0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 10 client.26342 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 10 client.26342 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 20 client.26342 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8abcc50 0x558bc8abf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 4 client.26342 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558bc89a78a0 con 0x558bc8abcc50 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.635+0000 7fa64effd640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8abcc50 0x558bc8abf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:26.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa62effd640 10 client.26342 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa64effd640 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8abcc50 0x558bc8abf070 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9b4eea8a470f811 server_cookie=d4d668593d63612e in_seq=0 out_seq=0 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa62effd640 1 -- 172.21.15.39:0/3312923852 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558bc89a78a0 con 0x558bc8abcc50 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa62effd640 10 client.26342 handle_command_reply: tid=0 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 client.26342 shutdown 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 msgr2=0x558bc8a41100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa640011eb0 tx=0x7fa640009c80 comp rx=0 tx=0).stop 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 shutdown_connections 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x558bc8abcc50 0x558bc8abf070 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc8a3fd80 0x558bc8a41730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558bc8a33df0 0x558bc8a41100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa62effd640 0 client.26342 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 --2- 172.21.15.39:0/3312923852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc8a334d0 0x558bc8a484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 >> 172.21.15.39:0/3312923852 conn(0x558bc8a31300 msgr2=0x558bc8a3b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 shutdown_connections 2024-09-10T22:00:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 1 -- 172.21.15.39:0/3312923852 wait complete. 2024-09-10T22:00:26.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.636+0000 7fa6581da740 20 client.26342 trim_cache size 0 max 16384 2024-09-10T22:00:26.644 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 msgr2=0x7fa63c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 0x7fa63c0b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa6480a8830 tx=0x7fa648079730 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 msgr2=0x7fa6501a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e970 tx=0x7fa64800ee30 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 shutdown_connections 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa63c0b5360 0x7fa63c0b7820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa65010d250 0x7fa6501a0d50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa65010a920 0x7fa65019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 --2- 172.21.15.39:0/893229606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa650101810 0x7fa65019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 >> 172.21.15.39:0/893229606 conn(0x7fa650076f50 msgr2=0x7fa650108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 shutdown_connections 2024-09-10T22:00:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:26.637+0000 7fa655e05640 1 -- 172.21.15.39:0/893229606 wait complete. 2024-09-10T22:00:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3f98ff9640 1 -- 172.21.15.39:0/3573331204 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558c667130f0 con 0x558c668260e0 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3f98ff9640 10 client.16698 handle_command_reply: tid=0 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 client.16698 shutdown 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 msgr2=0x558c667b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0cc920 tx=0x7f3fac005bd0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 shutdown_connections 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x558c668260e0 0x558c66828500 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558c667a8bd0 0x558c667b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3f98ff9640 0 client.16698 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c667a6190 0x558c667b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 --2- 172.21.15.39:0/3573331204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c667a3860 0x558c667b4cd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 >> 172.21.15.39:0/3573331204 conn(0x558c6679e9b0 msgr2=0x558c667ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 shutdown_connections 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 1 -- 172.21.15.39:0/3573331204 wait complete. 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.727+0000 7f3fba821740 20 client.16698 trim_cache size 0 max 16384 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:00:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:00:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 msgr2=0x7f3f9c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 0x7f3f9c0b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009fd0 tx=0x7f3fa8009500 comp rx=0 tx=0).stop 2024-09-10T22:00:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 msgr2=0x7f3fb019afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009a50 tx=0x7f3fac0042f0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 shutdown_connections 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3f9c0b5360 0x7f3f9c0b7820 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fb0103370 0x7f3fb019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fb01029b0 0x7f3fb019b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 --2- 172.21.15.39:0/2212858227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb0101860 0x7f3fb019afb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 >> 172.21.15.39:0/2212858227 conn(0x7f3fb00fd140 msgr2=0x7f3fb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 shutdown_connections 2024-09-10T22:00:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:26.728+0000 7f3fb7a52640 1 -- 172.21.15.39:0/2212858227 wait complete. 2024-09-10T22:00:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:26 smithi070 ceph-mon[34909]: pgmap v504: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-10T22:00:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:26 smithi039 ceph-mon[30872]: pgmap v504: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-10T22:00:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:26 smithi173 ceph-mon[35294]: pgmap v504: 97 pgs: 97 active+clean; 383 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-10T22:00:27.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:00:28.245 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.742+0000 7f9e7f950640 1 -- 172.21.15.39:0/3785543510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 msgr2=0x7f9e7810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.742+0000 7f9e7f950640 1 --2- 172.21.15.39:0/3785543510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e7810e820 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000d910 tx=0x7f9e7002a160 comp rx=0 tx=0).stop 2024-09-10T22:00:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.750+0000 7f9e7f950640 1 -- 172.21.15.39:0/3785543510 shutdown_connections 2024-09-10T22:00:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.750+0000 7f9e7f950640 1 --2- 172.21.15.39:0/3785543510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e7810e820 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.750+0000 7f9e7f950640 1 --2- 172.21.15.39:0/3785543510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 0x7f9e78107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.750+0000 7f9e7f950640 1 --2- 172.21.15.39:0/3785543510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e78101c90 0x7f9e78102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.750+0000 7f9e7f950640 1 -- 172.21.15.39:0/3785543510 >> 172.21.15.39:0/3785543510 conn(0x7f9e780fd700 msgr2=0x7f9e780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.755+0000 7f9e7f950640 1 -- 172.21.15.39:0/3785543510 shutdown_connections 2024-09-10T22:00:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.756+0000 7f9e7f950640 1 -- 172.21.15.39:0/3785543510 wait complete. 2024-09-10T22:00:28.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.757+0000 7f9e7f950640 1 Processor -- start 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.763+0000 7f9e7f950640 1 -- start start 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e78101c90 0x7f9e7819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 0x7f9e7819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78110c20 con 0x7f9e78108020 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78110aa0 con 0x7f9e781076a0 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7f950640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78110da0 con 0x7f9e78101c90 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43012/0 (socket says 172.21.15.39:43012) 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.766+0000 7f9e7deed640 1 -- 172.21.15.39:0/1147713411 learned_addr learned my addr 172.21.15.39:0/1147713411 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.767+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 0x7f9e7819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 -- 172.21.15.39:0/1147713411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e78101c90 msgr2=0x7f9e7819dc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e78101c90 0x7f9e7819dc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 -- 172.21.15.39:0/1147713411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 msgr2=0x7f9e7819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 0x7f9e7819e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 -- 172.21.15.39:0/1147713411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78197860 con 0x7f9e78108020 2024-09-10T22:00:28.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.768+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9e700053b0 tx=0x7f9e700053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.771+0000 7f9e6e7fc640 1 -- 172.21.15.39:0/1147713411 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700048d0 con 0x7f9e78108020 2024-09-10T22:00:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.771+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e78197af0 con 0x7f9e78108020 2024-09-10T22:00:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.771+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7819ca90 con 0x7f9e78108020 2024-09-10T22:00:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.771+0000 7f9e6e7fc640 1 -- 172.21.15.39:0/1147713411 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e70041070 con 0x7f9e78108020 2024-09-10T22:00:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.771+0000 7f9e6e7fc640 1 -- 172.21.15.39:0/1147713411 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000cdc0 con 0x7f9e78108020 2024-09-10T22:00:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.778+0000 7f9e6e7fc640 1 -- 172.21.15.39:0/1147713411 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9e7003b070 con 0x7f9e78108020 2024-09-10T22:00:28.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.779+0000 7f9e6e7fc640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 0x7f9e640b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.780+0000 7f9e6e7fc640 1 -- 172.21.15.39:0/1147713411 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e70105260 con 0x7f9e78108020 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.784+0000 7f9e81d25740 1 Processor -- start 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.784+0000 7f9e81d25740 1 -- start start 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.784+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.784+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.784+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 0x7f9e640b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e7ceeb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e7ceeb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43020/0 (socket says 172.21.15.39:43020) 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e7ceeb640 1 -- 172.21.15.39:0/1849135721 learned_addr learned my addr 172.21.15.39:0/1849135721 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c909d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e31c871ea0 con 0x55e31c8fba10 2024-09-10T22:00:28.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e31c8612d0 con 0x55e31c8fb0f0 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e31c8650e0 con 0x55e31c9079a0 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.785+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c909d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 -- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 msgr2=0x55e31c909d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c909d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 -- 172.21.15.39:0/1849135721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 msgr2=0x55e31c8fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8fb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 -- 172.21.15.39:0/1849135721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31c5bf650 con 0x55e31c8fba10 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c909d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.786+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800df00 tx=0x7f9e68005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63947785c23c861 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.788+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 0x7f9e640b78f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e74005fd0 tx=0x7f9e740138e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.788+0000 7f9e637fe640 1 -- 172.21.15.39:0/1849135721 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68004020 con 0x55e31c8fba10 2024-09-10T22:00:28.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.788+0000 7f9e637fe640 1 -- 172.21.15.39:0/1849135721 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e680041c0 con 0x55e31c8fba10 2024-09-10T22:00:28.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.789+0000 7f9e637fe640 1 -- 172.21.15.39:0/1849135721 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e680178e0 con 0x55e31c8fba10 2024-09-10T22:00:28.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.790+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 msgr2=0x55e31c907460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.790+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800df00 tx=0x7f9e68005f90 comp rx=0 tx=0).stop 2024-09-10T22:00:28.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 shutdown_connections 2024-09-10T22:00:28.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c909d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c907460 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1849135721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 >> 172.21.15.39:0/1849135721 conn(0x55e31c8f8f20 msgr2=0x55e31c8fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 shutdown_connections 2024-09-10T22:00:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 -- 172.21.15.39:0/1849135721 wait complete. 2024-09-10T22:00:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.791+0000 7f9e81d25740 1 -- start start 2024-09-10T22:00:28.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 Processor -- start 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fb0f0 0x55e31c907260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fba10 0x55e31c9046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e31c6c2700 con 0x55e31c8fb0f0 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e31c7fc160 con 0x55e31c8fba10 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e31c92c630 con 0x55e31c9079a0 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.792+0000 7f9e81d25740 10 client.0 _ll_register_callbacks cb 0x55e31c8159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7ceeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fba10 0x55e31c9046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:56252/0 (socket says 172.21.15.39:56252) 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 -- 172.21.15.39:0/1963809892 learned_addr learned my addr 172.21.15.39:0/1963809892 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:28.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fb0f0 0x55e31c907260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 -- 172.21.15.39:0/1963809892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fba10 msgr2=0x55e31c9046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fba10 0x55e31c9046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 -- 172.21.15.39:0/1963809892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fb0f0 msgr2=0x55e31c907260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fb0f0 0x55e31c907260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.793+0000 7f9e7deed640 1 -- 172.21.15.39:0/1963809892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31c829c90 con 0x55e31c9079a0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.794+0000 7f9e60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.794+0000 7f9e7deed640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e700c9e10 tx=0x7f9e700cc620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0d42f26519dd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.794+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700d1410 con 0x55e31c9079a0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.794+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e680041c0 con 0x55e31c9079a0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.794+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e700cbe00 con 0x55e31c9079a0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9e700e7050 con 0x55e31c9079a0 2024-09-10T22:00:28.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e81d25740 10 client.26263 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e31c937fc0 con 0x55e31c9079a0 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e680041c0 con 0x55e31c9079a0 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f9e700e7bc0 con 0x55e31c9079a0 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e81d25740 10 client.26263 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.795+0000 7f9e81d25740 10 client.26263 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:00:28.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.796+0000 7f9e81d25740 20 client.26263 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.796+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c939690 0x55e31c93bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.796+0000 7f9e81d25740 4 client.26263 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.796+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e31c873df0 con 0x55e31c939690 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.796+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c939690 0x55e31c93bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.797+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c939690 0x55e31c93bab0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd11ed60d3aa102b server_cookie=9db4c03f94a2bfd0 in_seq=0 out_seq=0 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.797+0000 7f9e60ff9640 10 client.26263 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e60ff9640 1 -- 172.21.15.39:0/1963809892 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e31c873df0 con 0x55e31c939690 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e60ff9640 10 client.26263 handle_command_reply: tid=0 2024-09-10T22:00:28.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e81d25740 1 client.26263 shutdown 2024-09-10T22:00:28.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 msgr2=0x55e31c904c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e700c9e10 tx=0x7f9e700cc620 comp rx=0 tx=0).stop 2024-09-10T22:00:28.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 shutdown_connections 2024-09-10T22:00:28.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.798+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c939690 0x55e31c93bab0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c9079a0 0x55e31c904c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fba10 0x55e31c9046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 --2- 172.21.15.39:0/1963809892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fb0f0 0x55e31c907260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 >> 172.21.15.39:0/1963809892 conn(0x55e31c8f8f20 msgr2=0x55e31c8fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e60ff9640 0 client.26263 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 shutdown_connections 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 1 -- 172.21.15.39:0/1963809892 wait complete. 2024-09-10T22:00:28.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.799+0000 7f9e81d25740 20 client.26263 trim_cache size 0 max 16384 2024-09-10T22:00:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 Processor -- start 2024-09-10T22:00:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 -- start start 2024-09-10T22:00:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 0x55e31c908d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00e3c0 con 0x55e31c9079a0 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00ff90 con 0x55e31c8fb0f0 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.817+0000 7f9e81d25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00ea90 con 0x55e31c8fba10 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43028/0 (socket says 172.21.15.39:43028) 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 -- 172.21.15.39:0/3427338588 learned_addr learned my addr 172.21.15.39:0/3427338588 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7d6ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 0x55e31c908d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 -- 172.21.15.39:0/3427338588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 msgr2=0x55e31c908d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 0x55e31c908d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 -- 172.21.15.39:0/3427338588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 msgr2=0x55e31c8f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 -- 172.21.15.39:0/3427338588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31c93be20 con 0x55e31c9079a0 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7ceeb640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 0x55e31c908d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e7deed640 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9e700d1680 tx=0x7f9e70009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80813af646893c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e62ffd640 1 -- 172.21.15.39:0/3427338588 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700ec070 con 0x55e31c9079a0 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e62ffd640 1 -- 172.21.15.39:0/3427338588 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7002e020 con 0x55e31c9079a0 2024-09-10T22:00:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.818+0000 7f9e62ffd640 1 -- 172.21.15.39:0/3427338588 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700e7dc0 con 0x55e31c9079a0 2024-09-10T22:00:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 -- 172.21.15.39:0/3427338588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 msgr2=0x55e31c9092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9e700d1680 tx=0x7f9e70009260 comp rx=0 tx=0).stop 2024-09-10T22:00:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 -- 172.21.15.39:0/3427338588 shutdown_connections 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c9079a0 0x55e31c9092d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fba10 0x55e31c908d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 --2- 172.21.15.39:0/3427338588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c8fb0f0 0x55e31c8f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 -- 172.21.15.39:0/3427338588 >> 172.21.15.39:0/3427338588 conn(0x55e31c8f8f20 msgr2=0x55e31c902f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 -- 172.21.15.39:0/3427338588 shutdown_connections 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.819+0000 7f9e81d25740 1 -- 172.21.15.39:0/3427338588 wait complete. 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 -- start start 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 Processor -- start 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fb0f0 0x55e31c931bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c932140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00f830 con 0x55e31c8fba10 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00f160 con 0x55e31c9079a0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c00c3a0 con 0x55e31c8fb0f0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e81d25740 10 client.0 _ll_register_callbacks cb 0x7f9e70005640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e7ceeb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c932140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e7deed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:38826/0 (socket says 172.21.15.39:38826) 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.820+0000 7f9e7deed640 1 -- 172.21.15.39:0/2125893658 learned_addr learned my addr 172.21.15.39:0/2125893658 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fb0f0 0x55e31c931bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 -- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fb0f0 msgr2=0x55e31c931bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fb0f0 0x55e31c931bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 -- 172.21.15.39:0/2125893658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 msgr2=0x55e31c932140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c932140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 -- 172.21.15.39:0/2125893658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31c901100 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e7deed640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e70005ec0 tx=0x7f9e700cc030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b78de3aaad34d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700ec070 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e7002e020 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.821+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9e700c84f0 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9e700cc6b0 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 10 client.26357 fetch_fsmap learned FSMap version 31 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e31c901100 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7002e020 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f9e700d2810 con 0x55e31c9079a0 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 10 client.26357 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 10 client.26357 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:00:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 20 client.26357 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c9a7590 0x55e31c9a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 4 client.26357 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:00:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.822+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e31c86f8a0 con 0x55e31c9a7590 2024-09-10T22:00:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.823+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c9a7590 0x55e31c9a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.826+0000 7f9e60ff9640 10 client.26357 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.826+0000 7f9e7d6ec640 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c9a7590 0x55e31c9a9980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d5738b8bd40d62 server_cookie=d6ceb0c55c37966b in_seq=0 out_seq=0 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.826+0000 7f9e60ff9640 1 -- 172.21.15.39:0/2125893658 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e31c86f8a0 con 0x55e31c9a7590 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.826+0000 7f9e60ff9640 10 client.26357 handle_command_reply: tid=0 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.826+0000 7f9e81d25740 1 client.26357 shutdown 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 msgr2=0x55e31c9008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e70005ec0 tx=0x7f9e700cc030 comp rx=0 tx=0).stop 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 shutdown_connections 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x55e31c9a7590 0x55e31c9a9980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e60ff9640 0 client.26357 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e31c9079a0 0x55e31c9008d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e31c8fba10 0x55e31c932140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 --2- 172.21.15.39:0/2125893658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e31c8fb0f0 0x55e31c931bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 >> 172.21.15.39:0/2125893658 conn(0x55e31c8f8f20 msgr2=0x55e31c905ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 shutdown_connections 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 1 -- 172.21.15.39:0/2125893658 wait complete. 2024-09-10T22:00:28.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.827+0000 7f9e81d25740 20 client.26357 trim_cache size 0 max 16384 2024-09-10T22:00:28.830 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:00:28.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 msgr2=0x7f9e640b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 0x7f9e640b78f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e74005fd0 tx=0x7f9e740138e0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 msgr2=0x7f9e78196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:28.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9e700053b0 tx=0x7f9e700053e0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 shutdown_connections 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9e640b5430 0x7f9e640b78f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e78108020 0x7f9e78196fa0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e781076a0 0x7f9e7819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 --2- 172.21.15.39:0/1147713411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e78101c90 0x7f9e7819dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 >> 172.21.15.39:0/1147713411 conn(0x7f9e780fd700 msgr2=0x7f9e780fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 shutdown_connections 2024-09-10T22:00:28.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:28.828+0000 7f9e7f950640 1 -- 172.21.15.39:0/1147713411 wait complete. 2024-09-10T22:00:28.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:28 smithi039 ceph-mon[30872]: pgmap v505: 97 pgs: 97 active+clean; 375 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-10T22:00:29.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:28 smithi070 ceph-mon[34909]: pgmap v505: 97 pgs: 97 active+clean; 375 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-10T22:00:29.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:28 smithi173 ceph-mon[35294]: pgmap v505: 97 pgs: 97 active+clean; 375 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-10T22:00:29.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:00:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:30 smithi070 ceph-mon[34909]: pgmap v506: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.1 MiB/s wr, 406 op/s 2024-09-10T22:00:31.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:30 smithi039 ceph-mon[30872]: pgmap v506: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.1 MiB/s wr, 406 op/s 2024-09-10T22:00:31.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:30 smithi173 ceph-mon[35294]: pgmap v506: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.1 MiB/s wr, 406 op/s 2024-09-10T22:00:31.713 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 -- 172.21.15.39:0/4051046642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda941076b0 msgr2=0x7fda94107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/4051046642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda941076b0 0x7fda94107af0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fda88009ca0 tx=0x7fda8802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 -- 172.21.15.39:0/4051046642 shutdown_connections 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/4051046642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda94108030 0x7fda9410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/4051046642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda941076b0 0x7fda94107af0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/4051046642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 -- 172.21.15.39:0/4051046642 >> 172.21.15.39:0/4051046642 conn(0x7fda940fd6f0 msgr2=0x7fda940ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 -- 172.21.15.39:0/4051046642 shutdown_connections 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.207+0000 7fda9c3d5640 1 -- 172.21.15.39:0/4051046642 wait complete. 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 Processor -- start 2024-09-10T22:00:32.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 -- start start 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda941076b0 0x7fda94197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda94110bf0 con 0x7fda94108030 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda94110a70 con 0x7fda94101ca0 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9c3d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda94110d70 con 0x7fda941076b0 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.208+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46822/0 (socket says 172.21.15.39:46822) 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 -- 172.21.15.39:0/1628893241 learned_addr learned my addr 172.21.15.39:0/1628893241 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47754/0 (socket says 172.21.15.39:47754) 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda99970640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda941076b0 0x7fda94197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 -- 172.21.15.39:0/1628893241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda941076b0 msgr2=0x7fda94197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda941076b0 0x7fda94197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 -- 172.21.15.39:0/1628893241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 msgr2=0x7fda94197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 -- 172.21.15.39:0/1628893241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9419d0f0 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a171640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9a972640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fda8400d750 tx=0x7fda8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda937fe640 1 -- 172.21.15.39:0/1628893241 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84017070 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda937fe640 1 -- 172.21.15.39:0/1628893241 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda840054d0 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9419d3e0 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda937fe640 1 -- 172.21.15.39:0/1628893241 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84004c60 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.209+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda941a3aa0 con 0x7fda94108030 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 Processor -- start 2024-09-10T22:00:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda937fe640 1 -- 172.21.15.39:0/1628893241 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fda84010460 con 0x7fda94108030 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 -- start start 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9cf9ea0 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9ce92d0 con 0x55a1b9d83a10 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.212+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9ced0e0 con 0x55a1b9d830f0 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47770/0 (socket says 172.21.15.39:47770) 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda9a171640 1 -- 172.21.15.39:0/1422142647 learned_addr learned my addr 172.21.15.39:0/1422142647 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 -- 172.21.15.39:0/1422142647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 msgr2=0x55a1b9d834d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d834d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 -- 172.21.15.39:0/1422142647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 msgr2=0x55a1b9d8f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 -- 172.21.15.39:0/1422142647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1b9a47650 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda9a171640 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda937fe640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 0x7fda7c0b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda9a171640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 0x7fda7c0b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda99970640 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d91d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fda88000f80 tx=0x7fda880093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f86053e716d4406 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda937fe640 1 -- 172.21.15.39:0/1628893241 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fda840e54b0 con 0x7fda94108030 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda90de6640 1 -- 172.21.15.39:0/1422142647 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88032e30 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda90de6640 1 -- 172.21.15.39:0/1422142647 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda88036070 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.213+0000 7fda90de6640 1 -- 172.21.15.39:0/1422142647 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda880042a0 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 -- 172.21.15.39:0/1422142647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 msgr2=0x55a1b9d91d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9a171640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 0x7fda7c0b9a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a1b9d81e00 tx=0x7fda8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d91d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fda88000f80 tx=0x7fda880093d0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 -- 172.21.15.39:0/1422142647 shutdown_connections 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d91d90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/1422142647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d834d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.214+0000 7fda9e7aa740 1 -- 172.21.15.39:0/1422142647 >> 172.21.15.39:0/1422142647 conn(0x55a1b9d80f20 msgr2=0x55a1b9d820c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- 172.21.15.39:0/1422142647 shutdown_connections 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- 172.21.15.39:0/1422142647 wait complete. 2024-09-10T22:00:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- start start 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 Processor -- start 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d8ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9b4a700 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9c84160 con 0x55a1b9d830f0 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a1b9d92440 con 0x55a1b9d83a10 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9e7aa740 10 client.0 _ll_register_callbacks cb 0x55a1b9c9d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47774/0 (socket says 172.21.15.39:47774) 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9a171640 1 -- 172.21.15.39:0/891759549 learned_addr learned my addr 172.21.15.39:0/891759549 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.215+0000 7fda9a972640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d8ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda99970640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 -- 172.21.15.39:0/891759549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 msgr2=0x55a1b9d8c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 -- 172.21.15.39:0/891759549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 msgr2=0x55a1b9d8ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d8ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 -- 172.21.15.39:0/891759549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1b9cb1c90 con 0x55a1b9d830f0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a972640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d8ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9a171640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda8c004620 tx=0x7fda8c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9131684c40e6312 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c009cf0 con 0x55a1b9d830f0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda88036070 con 0x55a1b9d830f0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.216+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fda8c003ac0 con 0x55a1b9d830f0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fda8c003cc0 con 0x55a1b9d830f0 2024-09-10T22:00:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 10 client.26369 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a1b9d9deb0 con 0x55a1b9d830f0 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda88036070 con 0x55a1b9d830f0 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fda8c027070 con 0x55a1b9d830f0 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 10 client.26369 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 10 client.26369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 20 client.26369 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9d9f380 0x55a1b9da17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 4 client.26369 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1b9cfbdf0 con 0x55a1b9d9f380 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.217+0000 7fda99970640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9d9f380 0x55a1b9da17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.218+0000 7fda79ffb640 10 client.26369 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.218+0000 7fda99970640 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9d9f380 0x55a1b9da17e0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6091e49a9228cf76 server_cookie=821b9417b8c3264b in_seq=0 out_seq=0 2024-09-10T22:00:32.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda79ffb640 1 -- 172.21.15.39:0/891759549 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1b9cfbdf0 con 0x55a1b9d9f380 2024-09-10T22:00:32.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda79ffb640 10 client.26369 handle_command_reply: tid=0 2024-09-10T22:00:32.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 client.26369 shutdown 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 msgr2=0x55a1b9d8f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda8c004620 tx=0x7fda8c004730 comp rx=0 tx=0).stop 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 shutdown_connections 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9d9f380 0x55a1b9da17e0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d8ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d8c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda79ffb640 0 client.26369 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/891759549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9d8f350 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 >> 172.21.15.39:0/891759549 conn(0x55a1b9d80f20 msgr2=0x55a1b9d86ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 shutdown_connections 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.220+0000 7fda9e7aa740 1 -- 172.21.15.39:0/891759549 wait complete. 2024-09-10T22:00:32.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.221+0000 7fda9e7aa740 20 client.26369 trim_cache size 0 max 16384 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.234+0000 7fda9e7aa740 1 Processor -- start 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.234+0000 7fda9e7aa740 1 -- start start 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d87160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d9b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda941ac160 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda941add00 con 0x55a1b9d83a10 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda941ac830 con 0x55a1b9d830f0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46856/0 (socket says 172.21.15.39:46856) 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 -- 172.21.15.39:0/4075732044 learned_addr learned my addr 172.21.15.39:0/4075732044 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda99970640 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d9b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a171640 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d87160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 -- 172.21.15.39:0/4075732044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 msgr2=0x55a1b9d87160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d87160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 -- 172.21.15.39:0/4075732044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 msgr2=0x55a1b9d9b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d9b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 -- 172.21.15.39:0/4075732044 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1b9d8ef80 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda9a972640 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fda840e3010 tx=0x7fda84009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b598a6219b37a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda7bfff640 1 -- 172.21.15.39:0/4075732044 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84020040 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda7bfff640 1 -- 172.21.15.39:0/4075732044 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda840abd30 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.235+0000 7fda7bfff640 1 -- 172.21.15.39:0/4075732044 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda840a8130 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- 172.21.15.39:0/4075732044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 msgr2=0x55a1b9d90d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fda840e3010 tx=0x7fda84009f00 comp rx=0 tx=0).stop 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- 172.21.15.39:0/4075732044 shutdown_connections 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d90d90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d83a10 0x55a1b9d9b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/4075732044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d830f0 0x55a1b9d87160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- 172.21.15.39:0/4075732044 >> 172.21.15.39:0/4075732044 conn(0x55a1b9d80f20 msgr2=0x55a1b9d879f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- 172.21.15.39:0/4075732044 shutdown_connections 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- 172.21.15.39:0/4075732044 wait complete. 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.236+0000 7fda9e7aa740 1 -- start start 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 Processor -- start 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d97720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda941ad5d0 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda941acf00 con 0x55a1b9d830f0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda941aa140 con 0x55a1b9d83a10 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9e7aa740 10 client.0 _ll_register_callbacks cb 0x7fda8c009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47790/0 (socket says 172.21.15.39:47790) 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46860/0 (socket says 172.21.15.39:46860) 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a171640 1 -- 172.21.15.39:0/541156923 learned_addr learned my addr 172.21.15.39:0/541156923 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda99970640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d97720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 -- 172.21.15.39:0/541156923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 msgr2=0x55a1b9d97720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d97720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 -- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 msgr2=0x55a1b9da7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a972640 1 -- 172.21.15.39:0/541156923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1b9d92740 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.237+0000 7fda9a171640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9a972640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda840e3010 tx=0x7fda840932e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4fd04324a688d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84020050 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fda84091d50 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda840abd30 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fda840e52e0 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 10 client.16752 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a1b9e0c630 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda840abd30 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fda840b3ae0 con 0x55a1b9d8f9a0 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 10 client.16752 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 20 client.16752 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9e0cca0 0x55a1b9e0f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 4 client.16752 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.238+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1b9cf78a0 con 0x55a1b9e0cca0 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.239+0000 7fda9a171640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9e0cca0 0x55a1b9e0f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.239+0000 7fda9a171640 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9e0cca0 0x55a1b9e0f0c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6cbdd13c9123e8a server_cookie=327f11161e79e974 in_seq=0 out_seq=0 2024-09-10T22:00:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.239+0000 7fda79ffb640 10 client.16752 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda79ffb640 1 -- 172.21.15.39:0/541156923 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1b9cf78a0 con 0x55a1b9e0cca0 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda79ffb640 10 client.16752 handle_command_reply: tid=0 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 client.16752 shutdown 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 msgr2=0x55a1b9d97eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda840e3010 tx=0x7fda840932e0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 shutdown_connections 2024-09-10T22:00:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a1b9e0cca0 0x55a1b9e0f0c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda79ffb640 0 client.16752 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1b9d8f9a0 0x55a1b9d97eb0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a1b9d83a10 0x55a1b9d97720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 --2- 172.21.15.39:0/541156923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1b9d830f0 0x55a1b9da7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 >> 172.21.15.39:0/541156923 conn(0x55a1b9d80f20 msgr2=0x55a1b9d8ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 shutdown_connections 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.241+0000 7fda9e7aa740 1 -- 172.21.15.39:0/541156923 wait complete. 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9e7aa740 20 client.16752 trim_cache size 0 max 16384 2024-09-10T22:00:32.246 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 msgr2=0x7fda7c0b9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 0x7fda7c0b9a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a1b9d81e00 tx=0x7fda8c005f90 comp rx=0 tx=0).stop 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 msgr2=0x7fda9419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fda8400d750 tx=0x7fda8400dc10 comp rx=0 tx=0).stop 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 shutdown_connections 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fda7c0b7570 0x7fda7c0b9a30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda94108030 0x7fda9419c920 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda941076b0 0x7fda94197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 --2- 172.21.15.39:0/1628893241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda94101ca0 0x7fda94197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 >> 172.21.15.39:0/1628893241 conn(0x7fda940fd6f0 msgr2=0x7fda940ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 shutdown_connections 2024-09-10T22:00:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:32.242+0000 7fda9c3d5640 1 -- 172.21.15.39:0/1628893241 wait complete. 2024-09-10T22:00:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:32 smithi070 ceph-mon[34909]: pgmap v507: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 841 KiB/s wr, 419 op/s 2024-09-10T22:00:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:32 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:32 smithi039 ceph-mon[30872]: pgmap v507: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 841 KiB/s wr, 419 op/s 2024-09-10T22:00:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:32 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:33.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:32 smithi173 ceph-mon[35294]: pgmap v507: 97 pgs: 97 active+clean; 373 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 841 KiB/s wr, 419 op/s 2024-09-10T22:00:33.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:32 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:00:33.976 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:00:33.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:00:34.589 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:34 smithi070 ceph-mon[34909]: pgmap v508: 97 pgs: 97 active+clean; 380 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 452 op/s 2024-09-10T22:00:35.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:34 smithi039 ceph-mon[30872]: pgmap v508: 97 pgs: 97 active+clean; 380 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 452 op/s 2024-09-10T22:00:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:34 smithi173 ceph-mon[35294]: pgmap v508: 97 pgs: 97 active+clean; 380 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 452 op/s 2024-09-10T22:00:35.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.290+0000 7fbf97edb640 1 -- 172.21.15.39:0/70047176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 msgr2=0x7fbf901040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.290+0000 7fbf97edb640 1 --2- 172.21.15.39:0/70047176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf901040a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009900 tx=0x7fbf8402a410 comp rx=0 tx=0).stop 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.290+0000 7fbf97edb640 1 -- 172.21.15.39:0/70047176 shutdown_connections 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.290+0000 7fbf97edb640 1 --2- 172.21.15.39:0/70047176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 0x7fbf9010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.290+0000 7fbf97edb640 1 --2- 172.21.15.39:0/70047176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 0x7fbf9010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 --2- 172.21.15.39:0/70047176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf901040a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- 172.21.15.39:0/70047176 >> 172.21.15.39:0/70047176 conn(0x7fbf900fd740 msgr2=0x7fbf900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- 172.21.15.39:0/70047176 shutdown_connections 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- 172.21.15.39:0/70047176 wait complete. 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 Processor -- start 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- start start 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 0x7fbf90199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 0x7fbf9019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90112d90 con 0x7fbf90103cc0 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90112c10 con 0x7fbf9010d120 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.291+0000 7fbf97edb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90112f10 con 0x7fbf901045e0 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46868/0 (socket says 172.21.15.39:46868) 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 -- 172.21.15.39:0/4108730575 learned_addr learned my addr 172.21.15.39:0/4108730575 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf96478640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 0x7fbf9019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95476640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 0x7fbf90199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 -- 172.21.15.39:0/4108730575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 msgr2=0x7fbf90199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 0x7fbf90199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 -- 172.21.15.39:0/4108730575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 msgr2=0x7fbf9019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 0x7fbf9019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 -- 172.21.15.39:0/4108730575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9019f3b0 con 0x7fbf90103cc0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf95c77640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005940 tx=0x7fbf840040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf82ffd640 1 -- 172.21.15.39:0/4108730575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8403f030 con 0x7fbf90103cc0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf82ffd640 1 -- 172.21.15.39:0/4108730575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf840044c0 con 0x7fbf90103cc0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf82ffd640 1 -- 172.21.15.39:0/4108730575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84035070 con 0x7fbf90103cc0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9019f640 con 0x7fbf90103cc0 2024-09-10T22:00:35.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.292+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf901a5d60 con 0x7fbf90103cc0 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.295+0000 7fbf9a2b0740 1 Processor -- start 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.295+0000 7fbf9a2b0740 1 -- start start 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.295+0000 7fbf82ffd640 1 -- 172.21.15.39:0/4108730575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbf8403ba20 con 0x7fbf90103cc0 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce316250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce318b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5653ce280e60 con 0x5653ce316790 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653ce270290 con 0x5653ce309ee0 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653ce2740a0 con 0x5653ce30a800 2024-09-10T22:00:35.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf95c77640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce316250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf95476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce318b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47808/0 (socket says 172.21.15.39:47808) 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 -- 172.21.15.39:0/2698233693 learned_addr learned my addr 172.21.15.39:0/2698233693 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 -- 172.21.15.39:0/2698233693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 msgr2=0x5653ce316250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce316250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 -- 172.21.15.39:0/2698233693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 msgr2=0x5653ce318b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce318b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 -- 172.21.15.39:0/2698233693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cdfce930 con 0x5653ce309ee0 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf95476640 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce318b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.296+0000 7fbf96478640 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009f50 tx=0x7fbf880118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd783a2dca8a316e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf82ffd640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 0x7fbf7c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf7bfff640 1 -- 172.21.15.39:0/2698233693 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88004d20 con 0x5653ce309ee0 2024-09-10T22:00:35.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf7bfff640 1 -- 172.21.15.39:0/2698233693 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf88004050 con 0x5653ce309ee0 2024-09-10T22:00:35.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf7bfff640 1 -- 172.21.15.39:0/2698233693 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88005280 con 0x5653ce309ee0 2024-09-10T22:00:35.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf95c77640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 0x7fbf7c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf82ffd640 1 -- 172.21.15.39:0/4108730575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbf841061f0 con 0x7fbf90103cc0 2024-09-10T22:00:35.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/2698233693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 msgr2=0x5653ce30a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009f50 tx=0x7fbf880118d0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.297+0000 7fbf95c77640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 0x7fbf7c0b7820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbf84104070 tx=0x7fbf84109cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/2698233693 shutdown_connections 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce318b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce316250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/2698233693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce30a2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/2698233693 >> 172.21.15.39:0/2698233693 conn(0x5653ce307d10 msgr2=0x5653ce308eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/2698233693 shutdown_connections 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/2698233693 wait complete. 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 -- start start 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.298+0000 7fbf9a2b0740 1 Processor -- start 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce316790 0x5653ce3141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5653ce0d1890 con 0x5653ce30a800 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653ce20ad40 con 0x5653ce309ee0 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653ce319440 con 0x5653ce316790 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 10 client.0 _ll_register_callbacks cb 0x5653ce26ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf95476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf95476640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46894/0 (socket says 172.21.15.39:46894) 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47820/0 (socket says 172.21.15.39:47820) 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf95476640 1 -- 172.21.15.39:0/812360552 learned_addr learned my addr 172.21.15.39:0/812360552 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce316790 0x5653ce3141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 -- 172.21.15.39:0/812360552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce316790 msgr2=0x5653ce3141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce316790 0x5653ce3141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 -- 172.21.15.39:0/812360552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 msgr2=0x5653ce313ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 -- 172.21.15.39:0/812360552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ce322880 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf95476640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf96478640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbf88003fd0 tx=0x7fbf88004910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e3232d66a86d621 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8802b020 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbf88004c50 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.299+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf88004050 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf88027470 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 10 client.26387 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5653ce325230 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf88004050 con 0x5653ce309ee0 2024-09-10T22:00:35.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fbf88025630 con 0x5653ce309ee0 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 10 client.26387 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 10 client.26387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 20 client.26387 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce3265e0 0x5653ce3289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 4 client.26387 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ce282db0 con 0x5653ce3265e0 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.300+0000 7fbf95476640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce3265e0 0x5653ce3289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.301+0000 7fbf797fa640 10 client.26387 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:35.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.301+0000 7fbf95476640 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce3265e0 0x5653ce3289d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81432457b90397ed server_cookie=6ac9b32814fcf758 in_seq=0 out_seq=0 2024-09-10T22:00:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.302+0000 7fbf797fa640 1 -- 172.21.15.39:0/812360552 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653ce282db0 con 0x5653ce3265e0 2024-09-10T22:00:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.302+0000 7fbf797fa640 10 client.26387 handle_command_reply: tid=0 2024-09-10T22:00:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.302+0000 7fbf9a2b0740 1 client.26387 shutdown 2024-09-10T22:00:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 msgr2=0x5653ce313760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbf88003fd0 tx=0x7fbf88004910 comp rx=0 tx=0).stop 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 shutdown_connections 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce3265e0 0x5653ce3289d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce316790 0x5653ce3141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce30a800 0x5653ce313ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/812360552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce313760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf797fa640 0 client.26387 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 >> 172.21.15.39:0/812360552 conn(0x5653ce307d10 msgr2=0x5653ce306f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 shutdown_connections 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/812360552 wait complete. 2024-09-10T22:00:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.303+0000 7fbf9a2b0740 20 client.26387 trim_cache size 0 max 16384 2024-09-10T22:00:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 Processor -- start 2024-09-10T22:00:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 -- start start 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce311290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce308d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ae410 con 0x5653ce316790 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901affb0 con 0x5653ce309ee0 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901aeae0 con 0x5653ce30a800 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf96478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce311290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf96478640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf95476640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce308d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf96478640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46902/0 (socket says 172.21.15.39:46902) 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.321+0000 7fbf96478640 1 -- 172.21.15.39:0/4030589992 learned_addr learned my addr 172.21.15.39:0/4030589992 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 -- 172.21.15.39:0/4030589992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 msgr2=0x5653ce311290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce311290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 -- 172.21.15.39:0/4030589992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 msgr2=0x5653ce3092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 -- 172.21.15.39:0/4030589992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ce3126c0 con 0x5653ce30a800 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf96478640 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf95476640 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce308d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5653ce3290d0 tx=0x7fbf8c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d9812189f3ce32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf7b7fe640 1 -- 172.21.15.39:0/4030589992 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c004250 con 0x5653ce30a800 2024-09-10T22:00:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf7b7fe640 1 -- 172.21.15.39:0/4030589992 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf8c0043f0 con 0x5653ce30a800 2024-09-10T22:00:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.322+0000 7fbf7b7fe640 1 -- 172.21.15.39:0/4030589992 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0047a0 con 0x5653ce30a800 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/4030589992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 msgr2=0x5653ce308d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce308d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5653ce3290d0 tx=0x7fbf8c005f90 comp rx=0 tx=0).stop 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/4030589992 shutdown_connections 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce30a800 0x5653ce308d60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/4030589992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce309ee0 0x5653ce311290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/4030589992 >> 172.21.15.39:0/4030589992 conn(0x5653ce307d10 msgr2=0x5653ce310b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/4030589992 shutdown_connections 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/4030589992 wait complete. 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.323+0000 7fbf9a2b0740 1 -- start start 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 Processor -- start 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce309ee0 0x5653ce31e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3196f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901af880 con 0x5653ce316790 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901af1b0 con 0x5653ce30a800 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ac3f0 con 0x5653ce309ee0 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf9a2b0740 10 client.0 _ll_register_callbacks cb 0x7fbf9006c530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf95476640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf96478640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf95476640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47840/0 (socket says 172.21.15.39:47840) 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf95476640 1 -- 172.21.15.39:0/3113006435 learned_addr learned my addr 172.21.15.39:0/3113006435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.324+0000 7fbf96478640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce309ee0 0x5653ce31e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 -- 172.21.15.39:0/3113006435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce309ee0 msgr2=0x5653ce31e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce309ee0 0x5653ce31e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 -- 172.21.15.39:0/3113006435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 msgr2=0x5653ce3196f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:35.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3196f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 -- 172.21.15.39:0/3113006435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ce328f00 con 0x5653ce30a800 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf95476640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd087ae97b5bd316 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c032020 con 0x5653ce30a800 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fbf8c011870 con 0x5653ce30a800 2024-09-10T22:00:35.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf8c0043f0 con 0x5653ce30a800 2024-09-10T22:00:35.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.325+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf8c029040 con 0x5653ce30a800 2024-09-10T22:00:35.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 10 client.26393 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:35.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5653ce393830 con 0x5653ce30a800 2024-09-10T22:00:35.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf8c0043f0 con 0x5653ce30a800 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fbf8c004700 con 0x5653ce30a800 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 10 client.26393 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 10 client.26393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 20 client.26393 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce393f30 0x5653ce396350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 4 client.26393 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5653ce27e860 con 0x5653ce393f30 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.326+0000 7fbf96478640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce393f30 0x5653ce396350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.327+0000 7fbf797fa640 10 client.26393 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.327+0000 7fbf96478640 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce393f30 0x5653ce396350 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed61dd2eb27c8092 server_cookie=bf6b564942315f49 in_seq=0 out_seq=0 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf797fa640 1 -- 172.21.15.39:0/3113006435 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5653ce27e860 con 0x5653ce393f30 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf797fa640 10 client.26393 handle_command_reply: tid=0 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 client.26393 shutdown 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 msgr2=0x5653ce31ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009e50 tx=0x7fbf8c009e80 comp rx=0 tx=0).stop 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 shutdown_connections 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5653ce393f30 0x5653ce396350 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653ce316790 0x5653ce3196f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653ce30a800 0x5653ce31ec80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf797fa640 0 client.26393 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 --2- 172.21.15.39:0/3113006435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653ce309ee0 0x5653ce31e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 >> 172.21.15.39:0/3113006435 conn(0x5653ce307d10 msgr2=0x5653ce310b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.418+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 shutdown_connections 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf9a2b0740 1 -- 172.21.15.39:0/3113006435 wait complete. 2024-09-10T22:00:35.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf9a2b0740 20 client.26393 trim_cache size 0 max 16384 2024-09-10T22:00:35.422 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:00:35.422 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T22:00:35.422 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "956ae779-ac12-4a63-9d38-bbcac731e7fd", 2024-09-10T22:00:35.422 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T22:00:35.422 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 msgr2=0x7fbf7c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 0x7fbf7c0b7820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbf84104070 tx=0x7fbf84109cd0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 msgr2=0x7fbf90199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005940 tx=0x7fbf840040c0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 shutdown_connections 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fbf7c0b5360 0x7fbf7c0b7820 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf9010d120 0x7fbf9019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf901045e0 0x7fbf90199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 --2- 172.21.15.39:0/4108730575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf90103cc0 0x7fbf90199300 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:35.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 >> 172.21.15.39:0/4108730575 conn(0x7fbf900fd740 msgr2=0x7fbf9010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:35.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 shutdown_connections 2024-09-10T22:00:35.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:35.419+0000 7fbf97edb640 1 -- 172.21.15.39:0/4108730575 wait complete. 2024-09-10T22:00:36.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:00:36.503 INFO:tasks.workunit.client.0.smithi039.stdout: 119 768759 420 511942 279 458901 978 2024-09-10T22:00:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:00:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:36 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T22:00:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:36 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:36 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:36 smithi070 ceph-mon[34909]: pgmap v509: 97 pgs: 97 active+clean; 384 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-09-10T22:00:37.168 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:36 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T22:00:37.168 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:36 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:37.168 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:36 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:37.169 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:36 smithi039 ceph-mon[30872]: pgmap v509: 97 pgs: 97 active+clean; 384 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-09-10T22:00:37.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:36 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T22:00:37.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:36 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:37.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:36 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:37.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:36 smithi173 ceph-mon[35294]: pgmap v509: 97 pgs: 97 active+clean; 384 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-09-10T22:00:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1996085489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd41080c0 msgr2=0x7f9dd410e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1996085489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd41080c0 0x7f9dd410e8c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009ca0 tx=0x7f9dcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1996085489 shutdown_connections 2024-09-10T22:00:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1996085489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd41080c0 0x7f9dd410e8c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1996085489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1996085489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd4101d30 0x7f9dd4102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1996085489 >> 172.21.15.39:0/1996085489 conn(0x7f9dd40fd7e0 msgr2=0x7f9dd40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1996085489 shutdown_connections 2024-09-10T22:00:37.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.431+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1996085489 wait complete. 2024-09-10T22:00:37.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 Processor -- start 2024-09-10T22:00:37.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 -- start start 2024-09-10T22:00:37.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd40fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd41080c0 0x7f9dd40fea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4111d40 con 0x7f9dd4107740 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4111bc0 con 0x7f9dd4101d30 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.432+0000 7f9ddbb9a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4111ec0 con 0x7f9dd41080c0 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd40fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47864/0 (socket says 172.21.15.39:47864) 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 -- 172.21.15.39:0/1049308253 learned_addr learned my addr 172.21.15.39:0/1049308253 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9135640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd40fe4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46936/0 (socket says 172.21.15.39:46936) 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dda137640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd41080c0 0x7f9dd40fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 -- 172.21.15.39:0/1049308253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd41080c0 msgr2=0x7f9dd40fea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd41080c0 0x7f9dd40fea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 -- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 msgr2=0x7f9dd40fe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd40fe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 -- 172.21.15.39:0/1049308253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd41a7680 con 0x7f9dd4101d30 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dd9936640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9e0 tx=0x7f9dc400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dcaffd640 1 -- 172.21.15.39:0/1049308253 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400cd50 con 0x7f9dd4101d30 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41a7970 con 0x7f9dd4101d30 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dcaffd640 1 -- 172.21.15.39:0/1049308253 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dc40035f0 con 0x7f9dd4101d30 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.433+0000 7f9dcaffd640 1 -- 172.21.15.39:0/1049308253 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4010690 con 0x7f9dd4101d30 2024-09-10T22:00:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.434+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41a7f00 con 0x7f9dd4101d30 2024-09-10T22:00:37.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.436+0000 7f9dcaffd640 1 -- 172.21.15.39:0/1049308253 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9dc4004000 con 0x7f9dd4101d30 2024-09-10T22:00:37.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.436+0000 7f9dddf6f740 1 Processor -- start 2024-09-10T22:00:37.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 -- start start 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf600480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dcaffd640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 0x7f9dc00b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf60ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf576e50 con 0x55bcdf6000a0 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf566280 con 0x55bcdf60c950 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf56a090 con 0x55bcdf6009c0 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:46290/0 (socket says 172.21.15.39:46290) 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dd9135640 1 -- 172.21.15.39:0/527655919 learned_addr learned my addr 172.21.15.39:0/527655919 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dda137640 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf600480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.437+0000 7f9dd9936640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 0x7f9dc00b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 -- 172.21.15.39:0/527655919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 msgr2=0x55bcdf60ed40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:00:37.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf60ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 -- 172.21.15.39:0/527655919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 msgr2=0x55bcdf600480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dcaffd640 1 -- 172.21.15.39:0/1049308253 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9dc40e5de0 con 0x7f9dd4101d30 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf600480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9936640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 0x7f9dc00b7860 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40e3940 tx=0x7f9dc40a8c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 -- 172.21.15.39:0/527655919 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcdf2c4650 con 0x55bcdf6009c0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dda137640 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf600480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.438+0000 7f9dd9135640 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009c90 tx=0x7f9dd0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1375c79ae530596b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.439+0000 7f9dbffff640 1 -- 172.21.15.39:0/527655919 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001e070 con 0x55bcdf6009c0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.439+0000 7f9dbffff640 1 -- 172.21.15.39:0/527655919 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd0019ae0 con 0x55bcdf6009c0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.439+0000 7f9dbffff640 1 -- 172.21.15.39:0/527655919 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000e920 con 0x55bcdf6009c0 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- 172.21.15.39:0/527655919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 msgr2=0x55bcdf60c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009c90 tx=0x7f9dd0011810 comp rx=0 tx=0).stop 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- 172.21.15.39:0/527655919 shutdown_connections 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf60ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf60c410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/527655919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf600480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- 172.21.15.39:0/527655919 >> 172.21.15.39:0/527655919 conn(0x55bcdf5fded0 msgr2=0x55bcdf5ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- 172.21.15.39:0/527655919 shutdown_connections 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- 172.21.15.39:0/527655919 wait complete. 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 -- start start 2024-09-10T22:00:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.440+0000 7f9dddf6f740 1 Processor -- start 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf60c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf60c950 0x55bcdf609bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf3c7700 con 0x55bcdf60c950 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf501110 con 0x55bcdf6000a0 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bcdf60f5d0 con 0x55bcdf6009c0 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dddf6f740 10 client.0 _ll_register_callbacks cb 0x55bcdf51a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dda137640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf60c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:46294/0 (socket says 172.21.15.39:46294) 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dda137640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf60c950 0x55bcdf609bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dd9135640 1 -- 172.21.15.39:0/3996987122 learned_addr learned my addr 172.21.15.39:0/3996987122 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.441+0000 7f9dd9135640 1 -- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 msgr2=0x55bcdf60c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dd9135640 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf60c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dd9135640 1 -- 172.21.15.39:0/3996987122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf60c950 msgr2=0x55bcdf609bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dd9135640 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf60c950 0x55bcdf609bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dd9135640 1 -- 172.21.15.39:0/3996987122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcdf52ec40 con 0x55bcdf6009c0 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dd9135640 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005bc0 tx=0x7f9dd0019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e62ae8c8806813 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001e040 con 0x55bcdf6009c0 2024-09-10T22:00:37.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9dd0004030 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd0019ae0 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9dd0005c50 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dddf6f740 10 client.26314 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.442+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcdf61aed0 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd0019ae0 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9dd00046c0 con 0x55bcdf6009c0 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 10 client.26314 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 10 client.26314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 20 client.26314 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf61c690 0x55bcdf61ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 4 client.26314 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:37.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcdf578da0 con 0x55bcdf61c690 2024-09-10T22:00:37.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.443+0000 7f9dda137640 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf61c690 0x55bcdf61ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.444+0000 7f9dda137640 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf61c690 0x55bcdf61ead0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492081fb45ea5529 server_cookie=b201e8596e75ba27 in_seq=0 out_seq=0 2024-09-10T22:00:37.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.444+0000 7f9dbd7fa640 10 client.26314 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/3996987122 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcdf578da0 con 0x55bcdf61c690 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dbd7fa640 10 client.26314 handle_command_reply: tid=0 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 client.26314 shutdown 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 msgr2=0x55bcdf609630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005bc0 tx=0x7f9dd0019660 comp rx=0 tx=0).stop 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 shutdown_connections 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf61c690 0x55bcdf61ead0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf60c950 0x55bcdf609bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf609630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/3996987122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf60c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dbd7fa640 0 client.26314 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 >> 172.21.15.39:0/3996987122 conn(0x55bcdf5fded0 msgr2=0x55bcdf603a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 shutdown_connections 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 1 -- 172.21.15.39:0/3996987122 wait complete. 2024-09-10T22:00:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.448+0000 7f9dddf6f740 20 client.26314 trim_cache size 0 max 16384 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 Processor -- start 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 -- start start 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf604e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf5febb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b05a0 con 0x55bcdf6000a0 2024-09-10T22:00:37.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b2140 con 0x55bcdf60c950 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b0c70 con 0x55bcdf6009c0 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dda137640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf604e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dda137640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46970/0 (socket says 172.21.15.39:46970) 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dda137640 1 -- 172.21.15.39:0/1801677213 learned_addr learned my addr 172.21.15.39:0/1801677213 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dda137640 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf5febb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 -- 172.21.15.39:0/1801677213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 msgr2=0x55bcdf5febb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf5febb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 -- 172.21.15.39:0/1801677213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 msgr2=0x55bcdf6048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dd9135640 1 -- 172.21.15.39:0/1801677213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcdf6007f0 con 0x55bcdf6009c0 2024-09-10T22:00:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.467+0000 7f9dda137640 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.468+0000 7f9dd9135640 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf604e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009250 tx=0x7f9dd0012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15156cc40f13439 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.468+0000 7f9dbf7fe640 1 -- 172.21.15.39:0/1801677213 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001e040 con 0x55bcdf6009c0 2024-09-10T22:00:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.468+0000 7f9dbf7fe640 1 -- 172.21.15.39:0/1801677213 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd00098c0 con 0x55bcdf6009c0 2024-09-10T22:00:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.468+0000 7f9dbf7fe640 1 -- 172.21.15.39:0/1801677213 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000eb60 con 0x55bcdf6009c0 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- 172.21.15.39:0/1801677213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 msgr2=0x55bcdf604e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf604e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009250 tx=0x7f9dd0012f90 comp rx=0 tx=0).stop 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- 172.21.15.39:0/1801677213 shutdown_connections 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf60c950 0x55bcdf5febb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf6009c0 0x55bcdf604e00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/1801677213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6000a0 0x55bcdf6048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- 172.21.15.39:0/1801677213 >> 172.21.15.39:0/1801677213 conn(0x55bcdf5fded0 msgr2=0x55bcdf6093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- 172.21.15.39:0/1801677213 shutdown_connections 2024-09-10T22:00:37.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- 172.21.15.39:0/1801677213 wait complete. 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 -- start start 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.469+0000 7f9dddf6f740 1 Processor -- start 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 0x55bcdf615220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf60c950 0x55bcdf60d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b1a10 con 0x55bcdf6009c0 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b1340 con 0x55bcdf6000a0 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41ae580 con 0x55bcdf60c950 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dddf6f740 10 client.0 _ll_register_callbacks cb 0x7f9dd001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:47898/0 (socket says 172.21.15.39:47898) 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 -- 172.21.15.39:0/996993532 learned_addr learned my addr 172.21.15.39:0/996993532 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dd9135640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 0x55bcdf615220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf60c950 0x55bcdf60d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 -- 172.21.15.39:0/996993532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf60c950 msgr2=0x55bcdf60d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf60c950 0x55bcdf60d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.470+0000 7f9dda137640 1 -- 172.21.15.39:0/996993532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 msgr2=0x55bcdf615220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dda137640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 0x55bcdf615220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dda137640 1 -- 172.21.15.39:0/996993532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcdf60e210 con 0x55bcdf6000a0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dd9135640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 0x55bcdf615220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dda137640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc005e30 tx=0x7f9dcc03e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228ae0190cd238f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc046040 con 0x55bcdf6000a0 2024-09-10T22:00:37.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f9dcc031af0 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bcdf574850 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9dcc031910 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dddf6f740 10 client.26408 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.471+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bcdf6135a0 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bcdf574850 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9dcc04c040 con 0x55bcdf6000a0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 10 client.26408 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 10 client.26408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 20 client.26408 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf6899b0 0x55bcdf68bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 4 client.26408 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bcdf571c80 con 0x55bcdf6899b0 2024-09-10T22:00:37.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dd9135640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf6899b0 0x55bcdf68bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dbd7fa640 10 client.26408 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:37.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.472+0000 7f9dd9135640 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf6899b0 0x55bcdf68bdd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fb916978210c28b server_cookie=dd14269c3798b200 in_seq=0 out_seq=0 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dbd7fa640 1 -- 172.21.15.39:0/996993532 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2566 (crc 0 0 0) 0x55bcdf571c80 con 0x55bcdf6899b0 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dbd7fa640 10 client.26408 handle_command_reply: tid=0 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 client.26408 shutdown 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 msgr2=0x55bcdf614cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc005e30 tx=0x7f9dcc03e040 comp rx=0 tx=0).stop 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 shutdown_connections 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcdf6899b0 0x55bcdf68bdd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcdf60c950 0x55bcdf60d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcdf6009c0 0x55bcdf615220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 --2- 172.21.15.39:0/996993532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcdf6000a0 0x55bcdf614cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 >> 172.21.15.39:0/996993532 conn(0x55bcdf5fded0 msgr2=0x55bcdf6048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dbd7fa640 0 client.26408 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 shutdown_connections 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 1 -- 172.21.15.39:0/996993532 wait complete. 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.478+0000 7f9dddf6f740 20 client.26408 trim_cache size 0 max 16384 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (134 inodes in the stack)", 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T22:00:37.481 INFO:teuthology.orchestra.run.smithi039.stdout: "956ae779-ac12-4a63-9d38-bbcac731e7fd": { 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "956ae779-ac12-4a63-9d38-bbcac731e7fd", 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.482 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "956ae779-ac12-4a63-9d38-bbcac731e7fd": { 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:00:35.416798+0000", 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T22:00:37.483 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.485 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:00:37.486 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:00:37.487 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 msgr2=0x7f9dc00b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 0x7f9dc00b7860 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40e3940 tx=0x7f9dc40a8c80 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 msgr2=0x7f9dd40fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9e0 tx=0x7f9dc400eea0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 shutdown_connections 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f9dc00b53a0 0x7f9dc00b7860 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd41080c0 0x7f9dd40fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4107740 0x7f9dd40fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 --2- 172.21.15.39:0/1049308253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd4101d30 0x7f9dd40fdfa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:37.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 >> 172.21.15.39:0/1049308253 conn(0x7f9dd40fd7e0 msgr2=0x7f9dd406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:37.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 shutdown_connections 2024-09-10T22:00:37.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:00:37.479+0000 7f9ddbb9a640 1 -- 172.21.15.39:0/1049308253 wait complete. 2024-09-10T22:00:38.547 INFO:tasks.cephfs.filesystem:scrub status for tag:956ae779-ac12-4a63-9d38-bbcac731e7fd - {'path': '/', 'tag': '956ae779-ac12-4a63-9d38-bbcac731e7fd', 'options': 'recursive,force'} 2024-09-10T22:00:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:38 smithi070 ceph-mon[34909]: pgmap v510: 97 pgs: 97 active+clean; 398 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-09-10T22:00:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:38 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:39.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:38 smithi039 ceph-mon[30872]: pgmap v510: 97 pgs: 97 active+clean; 398 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-09-10T22:00:39.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:38 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:39.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:38 smithi173 ceph-mon[35294]: pgmap v510: 97 pgs: 97 active+clean; 398 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-09-10T22:00:39.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:38 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 -- 172.21.15.39:0/3104891150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 msgr2=0x7f71c8107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 --2- 172.21.15.39:0/3104891150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c8107f30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009900 tx=0x7f71b802a410 comp rx=0 tx=0).stop 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 -- 172.21.15.39:0/3104891150 shutdown_connections 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 --2- 172.21.15.39:0/3104891150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c810ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 --2- 172.21.15.39:0/3104891150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c8107f30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 --2- 172.21.15.39:0/3104891150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c8105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.906+0000 7f71cfde2640 1 -- 172.21.15.39:0/3104891150 >> 172.21.15.39:0/3104891150 conn(0x7f71c80fd140 msgr2=0x7f71c80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.907+0000 7f71cfde2640 1 -- 172.21.15.39:0/3104891150 shutdown_connections 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.907+0000 7f71cfde2640 1 -- 172.21.15.39:0/3104891150 wait complete. 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 Processor -- start 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 -- start start 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810e5a0 con 0x7f71c8105ac0 2024-09-10T22:00:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810e420 con 0x7f71c8108670 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cfde2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71c810e720 con 0x7f71c806b470 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71ce37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cd37d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71ce37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:41192/0 (socket says 172.21.15.39:41192) 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71ce37f640 1 -- 172.21.15.39:0/1094016820 learned_addr learned my addr 172.21.15.39:0/1094016820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.908+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 -- 172.21.15.39:0/1094016820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 msgr2=0x7f71c819af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c819af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 -- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 msgr2=0x7f71c819b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c819b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 -- 172.21.15.39:0/1094016820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c819cab0 con 0x7f71c8108670 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:00:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71ce37f640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71c000efd0 tx=0x7f71c000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71beffd640 1 -- 172.21.15.39:0/1094016820 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0003b70 con 0x7f71c8108670 2024-09-10T22:00:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c819cda0 con 0x7f71c8108670 2024-09-10T22:00:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.909+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c8193e60 con 0x7f71c8108670 2024-09-10T22:00:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.910+0000 7f71beffd640 1 -- 172.21.15.39:0/1094016820 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c0009820 con 0x7f71c8108670 2024-09-10T22:00:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.910+0000 7f71beffd640 1 -- 172.21.15.39:0/1094016820 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0010790 con 0x7f71c8108670 2024-09-10T22:00:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.913+0000 7f71d2c8a740 1 Processor -- start 2024-09-10T22:00:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71beffd640 1 -- 172.21.15.39:0/1094016820 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f71c001f020 con 0x7f71c8108670 2024-09-10T22:00:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 -- start start 2024-09-10T22:00:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6d7860 0x55de7a6d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6dcbd0 0x55de7a6df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55de7a6496f0 con 0x55de7a6dcbd0 2024-09-10T22:00:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de7a638b20 con 0x55de7a6da190 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de7a63c930 con 0x55de7a6d7860 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71cd37d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6d7860 0x55de7a6d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.914+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:41194/0 (socket says 172.21.15.39:41194) 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3140780965 learned_addr learned my addr 172.21.15.39:0/3140780965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6dcbd0 0x55de7a6df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3140780965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6d7860 msgr2=0x55de7a6d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6d7860 0x55de7a6d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3140780965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6dcbd0 msgr2=0x55de7a6df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6dcbd0 0x55de7a6df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3140780965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7a5fe530 con 0x55de7a6da190 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009d50 tx=0x7f71c40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60dcdf900640fb3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71beffd640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 0x7f71b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.915+0000 7f71b3fff640 1 -- 172.21.15.39:0/3140780965 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4012650 con 0x55de7a6da190 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.916+0000 7f71b3fff640 1 -- 172.21.15.39:0/3140780965 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c4009e40 con 0x55de7a6da190 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.916+0000 7f71b3fff640 1 -- 172.21.15.39:0/3140780965 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400fb50 con 0x55de7a6da190 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.916+0000 7f71beffd640 1 -- 172.21.15.39:0/1094016820 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f71c00e5c50 con 0x7f71c8108670 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.916+0000 7f71cd37d640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 0x7f71b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3140780965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 msgr2=0x55de7a6dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009d50 tx=0x7f71c40117b0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3140780965 shutdown_connections 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6dcbd0 0x55de7a6df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6dc580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3140780965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6d7860 0x55de7a6d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3140780965 >> 172.21.15.39:0/3140780965 conn(0x55de7a6d29b0 msgr2=0x55de7a6d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.917+0000 7f71cd37d640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 0x7f71b40b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009230 tx=0x7f71b802a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.918+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3140780965 shutdown_connections 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.918+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3140780965 wait complete. 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.918+0000 7f71d2c8a740 1 -- start start 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.918+0000 7f71d2c8a740 1 Processor -- start 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6e1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55de7a570ab0 con 0x55de7a6d7860 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de7a5de730 con 0x55de7a6da190 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de7a6dfbb0 con 0x55de7a6dcbd0 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71d2c8a740 10 client.0 _ll_register_callbacks cb 0x55de7a6326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.919+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55444/0 (socket says 172.21.15.39:55444) 2024-09-10T22:00:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3323559493 learned_addr learned my addr 172.21.15.39:0/3323559493 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 -- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 msgr2=0x55de7a6e1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6e1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 -- 172.21.15.39:0/3323559493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 msgr2=0x55de7a6e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 -- 172.21.15.39:0/3323559493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7a39a790 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71ce37f640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e2130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71c00e3ad0 tx=0x7f71c00ac070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb563b73c7784c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.920+0000 7f71b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c00b59b0 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f71c0004d50 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de7a64b640 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f71c00d31b0 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71d2c8a740 10 client.26332 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55de7a413620 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.921+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55de7a64b640 con 0x55de7a6dcbd0 2024-09-10T22:00:39.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f71c00a7d70 con 0x55de7a6dcbd0 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 10 client.26332 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 10 client.26332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 20 client.26332 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a6fd8f0 0x55de7a6ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 4 client.26332 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de7a6470f0 con 0x55de7a6fd8f0 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.922+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a6fd8f0 0x55de7a6ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.923+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a6fd8f0 0x55de7a6ffd40 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d032c6d82be125 server_cookie=c4881b3275460e2e in_seq=0 out_seq=0 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.923+0000 7f71b17fa640 10 client.26332 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.925+0000 7f71b17fa640 1 -- 172.21.15.39:0/3323559493 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de7a6470f0 con 0x55de7a6fd8f0 2024-09-10T22:00:39.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.925+0000 7f71b17fa640 10 client.26332 handle_command_reply: tid=0 2024-09-10T22:00:39.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.926+0000 7f71d2c8a740 1 client.26332 shutdown 2024-09-10T22:00:39.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 msgr2=0x55de7a6e2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e2130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71c00e3ad0 tx=0x7f71c00ac070 comp rx=0 tx=0).stop 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 shutdown_connections 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a6fd8f0 0x55de7a6ffd40 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e2130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6da190 0x55de7a6e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3323559493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 >> 172.21.15.39:0/3323559493 conn(0x55de7a6d29b0 msgr2=0x55de7a6d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.927+0000 7f71b17fa640 0 client.26332 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.928+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 shutdown_connections 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.928+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3323559493 wait complete. 2024-09-10T22:00:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.928+0000 7f71d2c8a740 20 client.26332 trim_cache size 0 max 16384 2024-09-10T22:00:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.954+0000 7f71d2c8a740 1 Processor -- start 2024-09-10T22:00:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.954+0000 7f71d2c8a740 1 -- start start 2024-09-10T22:00:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00e390 con 0x55de7a6d7860 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00ff30 con 0x55de7a6dcbd0 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00ea60 con 0x55de7a6da190 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cdb7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55460/0 (socket says 172.21.15.39:55460) 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6d6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71ce37f640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cdb7e640 1 -- 172.21.15.39:0/3168316668 learned_addr learned my addr 172.21.15.39:0/3168316668 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cd37d640 1 -- 172.21.15.39:0/3168316668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 msgr2=0x55de7a6d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cd37d640 1 -- 172.21.15.39:0/3168316668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 msgr2=0x55de7a6e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.955+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71cd37d640 1 -- 172.21.15.39:0/3168316668 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7a6e18d0 con 0x55de7a6da190 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71cd37d640 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6d6c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b8041040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c4c0b4bb7fcc6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71b37fe640 1 -- 172.21.15.39:0/3168316668 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8005540 con 0x55de7a6da190 2024-09-10T22:00:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71b37fe640 1 -- 172.21.15.39:0/3168316668 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b8047030 con 0x55de7a6da190 2024-09-10T22:00:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.956+0000 7f71b37fe640 1 -- 172.21.15.39:0/3168316668 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b80316a0 con 0x55de7a6da190 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3168316668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 msgr2=0x55de7a6d6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6d6c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b8041040 comp rx=0 tx=0).stop 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3168316668 shutdown_connections 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6d6c90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/3168316668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3168316668 >> 172.21.15.39:0/3168316668 conn(0x55de7a6d29b0 msgr2=0x55de7a6d5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3168316668 shutdown_connections 2024-09-10T22:00:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- 172.21.15.39:0/3168316668 wait complete. 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 -- start start 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.957+0000 7f71d2c8a740 1 Processor -- start 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00f800 con 0x55de7a6d7860 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00f130 con 0x55de7a6dcbd0 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac00c370 con 0x55de7a6da190 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71d2c8a740 10 client.0 _ll_register_callbacks cb 0x7f71c00a8a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71ce37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:55922/0 (socket says 172.21.15.39:55922) 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 -- 172.21.15.39:0/1444763133 learned_addr learned my addr 172.21.15.39:0/1444763133 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 -- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 msgr2=0x55de7a6e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 -- 172.21.15.39:0/1444763133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 msgr2=0x55de7a6e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.958+0000 7f71cd37d640 1 -- 172.21.15.39:0/1444763133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7a6e7500 con 0x55de7a6da190 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71cd37d640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009a20 tx=0x7f71b8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d82449370d244a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8065060 con 0x55de7a6da190 2024-09-10T22:00:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71ce37f640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b8047030 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f71b803f850 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f71b803fa50 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71d2c8a740 10 client.26338 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55de7a6e88c0 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.959+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b8047030 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f71b805f030 con 0x55de7a6da190 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 10 client.26338 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 10 client.26338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 20 client.26338 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a76a910 0x55de7a76cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 4 client.26338 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de7a644520 con 0x55de7a76a910 2024-09-10T22:00:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a76a910 0x55de7a76cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.960+0000 7f71b17fa640 10 client.26338 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:39.961+0000 7f71cdb7e640 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a76a910 0x55de7a76cd30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e61ca5212f6c01 server_cookie=e2d4f46a0aa49f73 in_seq=0 out_seq=0 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:00:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:39 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:00:40.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:39 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:40.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:00:40.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:39 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:40 smithi070 ceph-mon[34909]: pgmap v511: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 550 op/s 2024-09-10T22:00:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:40 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:40 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.167+0000 7f71b17fa640 1 -- 172.21.15.39:0/1444763133 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de7a644520 con 0x55de7a76a910 2024-09-10T22:00:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.167+0000 7f71b17fa640 10 client.26338 handle_command_reply: tid=0 2024-09-10T22:00:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.167+0000 7f71d2c8a740 1 client.26338 shutdown 2024-09-10T22:00:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 msgr2=0x55de7a6e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009a20 tx=0x7f71b8005800 comp rx=0 tx=0).stop 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 shutdown_connections 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55de7a76a910 0x55de7a76cd30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de7a6dcbd0 0x55de7a6e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de7a6da190 0x55de7a6e6100 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71b17fa640 0 client.26338 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 --2- 172.21.15.39:0/1444763133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55de7a6d7860 0x55de7a6e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 >> 172.21.15.39:0/1444763133 conn(0x55de7a6d29b0 msgr2=0x55de7a6d5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 shutdown_connections 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 1 -- 172.21.15.39:0/1444763133 wait complete. 2024-09-10T22:00:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.168+0000 7f71d2c8a740 20 client.26338 trim_cache size 0 max 16384 2024-09-10T22:00:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:00:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:00:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:00:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 msgr2=0x7f71b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 0x7f71b40b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009230 tx=0x7f71b802a410 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 msgr2=0x7f71c819c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71c000efd0 tx=0x7f71c000c6a0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 shutdown_connections 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f71b40b52e0 0x7f71b40b77a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71c8108670 0x7f71c819c1f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71c8105ac0 0x7f71c819b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 --2- 172.21.15.39:0/1094016820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71c806b470 0x7f71c819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 >> 172.21.15.39:0/1094016820 conn(0x7f71c80fd140 msgr2=0x7f71c8103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 shutdown_connections 2024-09-10T22:00:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:41.169+0000 7f71cfde2640 1 -- 172.21.15.39:0/1094016820 wait complete. 2024-09-10T22:00:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:40 smithi039 ceph-mon[30872]: pgmap v511: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 550 op/s 2024-09-10T22:00:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:40 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:40 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:40 smithi173 ceph-mon[35294]: pgmap v511: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 550 op/s 2024-09-10T22:00:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:40 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:40 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:42 smithi070 ceph-mon[34909]: pgmap v512: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 366 op/s 2024-09-10T22:00:43.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:42 smithi039 ceph-mon[30872]: pgmap v512: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 366 op/s 2024-09-10T22:00:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:42 smithi173 ceph-mon[35294]: pgmap v512: 97 pgs: 97 active+clean; 417 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 366 op/s 2024-09-10T22:00:45.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:44 smithi070 ceph-mon[34909]: pgmap v513: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-10T22:00:45.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:44 smithi039 ceph-mon[30872]: pgmap v513: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-10T22:00:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:44 smithi173 ceph-mon[35294]: pgmap v513: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 1.16k op/s 2024-09-10T22:00:46.502 INFO:tasks.workunit.client.0.smithi039.stdout: 120 482923 131 317863 122 288058 445 2024-09-10T22:00:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:46 smithi070 ceph-mon[34909]: pgmap v514: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 1.32k op/s 2024-09-10T22:00:47.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:46 smithi039 ceph-mon[30872]: pgmap v514: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 1.32k op/s 2024-09-10T22:00:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:46 smithi173 ceph-mon[35294]: pgmap v514: 97 pgs: 97 active+clean; 404 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 1.32k op/s 2024-09-10T22:00:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:48 smithi039 ceph-mon[30872]: pgmap v515: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 1.50k op/s 2024-09-10T22:00:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:48 smithi173 ceph-mon[35294]: pgmap v515: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 1.50k op/s 2024-09-10T22:00:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:48 smithi070 ceph-mon[34909]: pgmap v515: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 1.50k op/s 2024-09-10T22:00:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:50 smithi039 ceph-mon[30872]: pgmap v516: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 1.75k op/s 2024-09-10T22:00:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:50 smithi173 ceph-mon[35294]: pgmap v516: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 1.75k op/s 2024-09-10T22:00:51.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:50 smithi070 ceph-mon[34909]: pgmap v516: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 1.75k op/s 2024-09-10T22:00:52.655 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:52 smithi070 ceph-mon[34909]: pgmap v517: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.67k op/s 2024-09-10T22:00:52.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:52 smithi039 ceph-mon[30872]: pgmap v517: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.67k op/s 2024-09-10T22:00:52.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:52 smithi173 ceph-mon[35294]: pgmap v517: 97 pgs: 97 active+clean; 406 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 1.67k op/s 2024-09-10T22:00:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.262+0000 7f0a9b47f640 1 -- 172.21.15.39:0/879456221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 msgr2=0x7f0a94102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.262+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/879456221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a94102e30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009930 tx=0x7f0a8402a420 comp rx=0 tx=0).stop 2024-09-10T22:00:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 -- 172.21.15.39:0/879456221 shutdown_connections 2024-09-10T22:00:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/879456221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 0x7f0a94109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/879456221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a94102e30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/879456221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a94101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 -- 172.21.15.39:0/879456221 >> 172.21.15.39:0/879456221 conn(0x7f0a940fd140 msgr2=0x7f0a940ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 -- 172.21.15.39:0/879456221 shutdown_connections 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 -- 172.21.15.39:0/879456221 wait complete. 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 Processor -- start 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 -- start start 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.263+0000 7f0a9b47f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a9410a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 0x7f0a9410ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9410e600 con 0x7f0a941029b0 2024-09-10T22:00:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9410e480 con 0x7f0a94101860 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9410e780 con 0x7f0a94103370 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a9410a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34538/0 (socket says 172.21.15.39:34538) 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9921b640 1 -- 172.21.15.39:0/3536168634 learned_addr learned my addr 172.21.15.39:0/3536168634 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 0x7f0a9410ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 -- 172.21.15.39:0/3536168634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 msgr2=0x7f0a9410ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 0x7f0a9410ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 -- 172.21.15.39:0/3536168634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 msgr2=0x7f0a9410c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 -- 172.21.15.39:0/3536168634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9410b6f0 con 0x7f0a941029b0 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9921b640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a9410a940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009230 tx=0x7f0a840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a8a7fc640 1 -- 172.21.15.39:0/3536168634 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8403f030 con 0x7f0a941029b0 2024-09-10T22:00:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a8a7fc640 1 -- 172.21.15.39:0/3536168634 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a84031910 con 0x7f0a941029b0 2024-09-10T22:00:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a8a7fc640 1 -- 172.21.15.39:0/3536168634 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84035070 con 0x7f0a941029b0 2024-09-10T22:00:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.264+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a941a2e10 con 0x7f0a941029b0 2024-09-10T22:00:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.265+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a941a3220 con 0x7f0a941029b0 2024-09-10T22:00:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 Processor -- start 2024-09-10T22:00:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 -- start start 2024-09-10T22:00:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a8a7fc640 1 -- 172.21.15.39:0/3536168634 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0a8403b9e0 con 0x7f0a941029b0 2024-09-10T22:00:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 0x5619b8fa4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa4bd0 0x5619b8fa7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5619b8f116f0 con 0x5619b8f9f860 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5619b8f00b20 con 0x5619b8fa2190 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.267+0000 7f0a9e253740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5619b8f04930 con 0x5619b8fa4bd0 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 0x5619b8fa4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a98a1a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa4bd0 0x5619b8fa7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39862/0 (socket says 172.21.15.39:39862) 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 -- 172.21.15.39:0/3298190567 learned_addr learned my addr 172.21.15.39:0/3298190567 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 -- 172.21.15.39:0/3298190567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa4bd0 msgr2=0x5619b8fa7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa4bd0 0x5619b8fa7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 -- 172.21.15.39:0/3298190567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 msgr2=0x5619b8fa4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 0x5619b8fa4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 -- 172.21.15.39:0/3298190567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b8ec6530 con 0x5619b8f9f860 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a9921b640 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 0x5619b8fa4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009fd0 tx=0x7f0a8c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f782a064e3d9dc37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a7f7fe640 1 -- 172.21.15.39:0/3298190567 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c004d20 con 0x5619b8f9f860 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a7f7fe640 1 -- 172.21.15.39:0/3298190567 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a8c004050 con 0x5619b8f9f860 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.268+0000 7f0a7f7fe640 1 -- 172.21.15.39:0/3298190567 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c005280 con 0x5619b8f9f860 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a8a7fc640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 0x7f0a800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9921b640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 0x7f0a800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a8a7fc640 1 -- 172.21.15.39:0/3536168634 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0a84106270 con 0x7f0a941029b0 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 -- 172.21.15.39:0/3298190567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 msgr2=0x5619b8fa1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009fd0 tx=0x7f0a8c0118d0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9921b640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 0x7f0a800b7820 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009620 tx=0x7f0a90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 -- 172.21.15.39:0/3298190567 shutdown_connections 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa4bd0 0x5619b8fa7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa2190 0x5619b8fa4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 --2- 172.21.15.39:0/3298190567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8fa1c50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 -- 172.21.15.39:0/3298190567 >> 172.21.15.39:0/3298190567 conn(0x5619b8f9a9b0 msgr2=0x5619b8f9b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 -- 172.21.15.39:0/3298190567 shutdown_connections 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.269+0000 7f0a9e253740 1 -- 172.21.15.39:0/3298190567 wait complete. 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 -- start start 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 Processor -- start 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 0x5619b8fa8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8fa9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa4bd0 0x5619b8faa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5619b8e38ab0 con 0x5619b8fa4bd0 2024-09-10T22:00:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5619b8ea6730 con 0x5619b8f9f860 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5619b8fa7bb0 con 0x5619b8fa2190 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9e253740 10 client.0 _ll_register_callbacks cb 0x5619b8efa6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 0x5619b8fa8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a99a1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa4bd0 0x5619b8faa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a98a1a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8fa9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 0x5619b8fa8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34558/0 (socket says 172.21.15.39:34558) 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a9921b640 1 -- 172.21.15.39:0/1657510261 learned_addr learned my addr 172.21.15.39:0/1657510261 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 msgr2=0x5619b8fa8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 0x5619b8fa8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1657510261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa4bd0 msgr2=0x5619b8faa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.270+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa4bd0 0x5619b8faa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1657510261 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b8c62790 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8fa9570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a84103dd0 tx=0x7f0a84005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf706262f8d87ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84049070 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a8c004050 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0a840d5d40 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a840c9140 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 10 client.26350 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5619b8cdb620 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a8c004050 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f0a840d1190 con 0x5619b8fa2190 2024-09-10T22:00:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 10 client.26350 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 10 client.26350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.271+0000 7f0a9e253740 20 client.26350 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b8fb4800 0x5619b8fb6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a9e253740 4 client.26350 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b8f13640 con 0x5619b8fb4800 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a9921b640 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b8fb4800 0x5619b8fb6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a7cff9640 10 client.26350 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:54.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.272+0000 7f0a9921b640 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b8fb4800 0x5619b8fb6c40 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7f310798db4c017 server_cookie=cb1091ad2d5903ca in_seq=0 out_seq=0 2024-09-10T22:00:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1657510261 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619b8f13640 con 0x5619b8fb4800 2024-09-10T22:00:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a7cff9640 10 client.26350 handle_command_reply: tid=0 2024-09-10T22:00:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 client.26350 shutdown 2024-09-10T22:00:54.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 msgr2=0x5619b8fa9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8fa9570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a84103dd0 tx=0x7f0a84005e00 comp rx=0 tx=0).stop 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 shutdown_connections 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b8fb4800 0x5619b8fb6c40 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa4bd0 0x5619b8faa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8fa9570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1657510261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8f9f860 0x5619b8fa8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a7cff9640 0 client.26350 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 >> 172.21.15.39:0/1657510261 conn(0x5619b8f9a9b0 msgr2=0x5619b8f99bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 shutdown_connections 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 1 -- 172.21.15.39:0/1657510261 wait complete. 2024-09-10T22:00:54.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.276+0000 7f0a9e253740 20 client.26350 trim_cache size 0 max 16384 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.292+0000 7f0a9e253740 1 Processor -- start 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.292+0000 7f0a9e253740 1 -- start start 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8f9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8f9f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941ac000 con 0x5619b8f9f860 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941adba0 con 0x5619b8fa4bd0 2024-09-10T22:00:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9e253740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941ac6d0 con 0x5619b8fa2190 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39872/0 (socket says 172.21.15.39:39872) 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 -- 172.21.15.39:0/533489488 learned_addr learned my addr 172.21.15.39:0/533489488 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8f9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8f9f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 -- 172.21.15.39:0/533489488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 msgr2=0x5619b8f9ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8f9ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 -- 172.21.15.39:0/533489488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 msgr2=0x5619b8f9f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8f9f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 -- 172.21.15.39:0/533489488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b8faa4b0 con 0x5619b8f9f860 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a9921b640 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5619b8fb7450 tx=0x7f0a9001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f357c0303ed1c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.293+0000 7f0a7effd640 1 -- 172.21.15.39:0/533489488 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000fd90 con 0x5619b8f9f860 2024-09-10T22:00:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a7effd640 1 -- 172.21.15.39:0/533489488 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a90003e70 con 0x5619b8f9f860 2024-09-10T22:00:54.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a7effd640 1 -- 172.21.15.39:0/533489488 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9002bc90 con 0x5619b8f9f860 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 -- 172.21.15.39:0/533489488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 msgr2=0x5619b8faaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5619b8fb7450 tx=0x7f0a9001b000 comp rx=0 tx=0).stop 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 -- 172.21.15.39:0/533489488 shutdown_connections 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8f9f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8fa2190 0x5619b8f9ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 --2- 172.21.15.39:0/533489488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8f9f860 0x5619b8faaa10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 -- 172.21.15.39:0/533489488 >> 172.21.15.39:0/533489488 conn(0x5619b8f9a9b0 msgr2=0x5619b8f9b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 -- 172.21.15.39:0/533489488 shutdown_connections 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.294+0000 7f0a9e253740 1 -- 172.21.15.39:0/533489488 wait complete. 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 -- start start 2024-09-10T22:00:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 Processor -- start 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8f9f860 0x5619b8fb06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8faf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941ad470 con 0x5619b8fa2190 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941acda0 con 0x5619b8fa4bd0 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941a9fe0 con 0x5619b8f9f860 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9e253740 10 client.0 _ll_register_callbacks cb 0x7f0a84109a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39878/0 (socket says 172.21.15.39:39878) 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1910033817 learned_addr learned my addr 172.21.15.39:0/1910033817 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:00:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a99a1c640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8faf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a9921b640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8f9f860 0x5619b8fb06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1910033817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8f9f860 msgr2=0x5619b8fb06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8f9f860 0x5619b8fb06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.295+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 msgr2=0x5619b8faf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8faf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a98a1a640 1 -- 172.21.15.39:0/1910033817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b8fa1fc0 con 0x5619b8fa2190 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a98a1a640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0a84000c00 tx=0x7f0a840045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121c7748cd452a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84049070 con 0x5619b8fa2190 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0a840cbd50 con 0x5619b8fa2190 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a90003e70 con 0x5619b8fa2190 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a840c8260 con 0x5619b8fa2190 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 10 client.16824 fetch_fsmap learned FSMap version 32 2024-09-10T22:00:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5619b8faea60 con 0x5619b8fa2190 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a90003e70 con 0x5619b8fa2190 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f0a840d26b0 con 0x5619b8fa2190 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 10 client.16824 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 10 client.16824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 20 client.16824 populate_metadata read hostname 'smithi039' 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b9021b40 0x5619b9023f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 4 client.16824 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.296+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619b8f0f0f0 con 0x5619b9021b40 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.297+0000 7f0a9921b640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b9021b40 0x5619b9023f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.297+0000 7f0a7cff9640 10 client.16824 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.297+0000 7f0a9921b640 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b9021b40 0x5619b9023f60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e03aff85042346 server_cookie=c29ce9090c9e4fb7 in_seq=0 out_seq=0 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a7cff9640 1 -- 172.21.15.39:0/1910033817 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619b8f0f0f0 con 0x5619b9021b40 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a7cff9640 10 client.16824 handle_command_reply: tid=0 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 client.16824 shutdown 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 msgr2=0x5619b8faf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0a84000c00 tx=0x7f0a840045a0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 shutdown_connections 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x5619b9021b40 0x5619b9023f60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619b8fa4bd0 0x5619b8faf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5619b8fa2190 0x5619b8faf3a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 --2- 172.21.15.39:0/1910033817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5619b8f9f860 0x5619b8fb06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a7cff9640 0 client.16824 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.680+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 >> 172.21.15.39:0/1910033817 conn(0x5619b8f9a9b0 msgr2=0x5619b8f9e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 shutdown_connections 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9e253740 1 -- 172.21.15.39:0/1910033817 wait complete. 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9e253740 20 client.16824 trim_cache size 0 max 16384 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:00:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:00:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:00:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 msgr2=0x7f0a800b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 0x7f0a800b7820 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009620 tx=0x7f0a90005f90 comp rx=0 tx=0).stop 2024-09-10T22:00:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 msgr2=0x7f0a9410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a9410a940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009230 tx=0x7f0a840042f0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 shutdown_connections 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0a800b5360 0x7f0a800b7820 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a94103370 0x7f0a9410ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a941029b0 0x7f0a9410a940 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 --2- 172.21.15.39:0/3536168634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a94101860 0x7f0a9410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 >> 172.21.15.39:0/3536168634 conn(0x7f0a940fd140 msgr2=0x7f0a94103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.681+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 shutdown_connections 2024-09-10T22:00:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:00:54.682+0000 7f0a9b47f640 1 -- 172.21.15.39:0/3536168634 wait complete. 2024-09-10T22:00:54.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:54 smithi070 ceph-mon[34909]: pgmap v518: 97 pgs: 97 active+clean; 408 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 2.09k op/s 2024-09-10T22:00:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:54 smithi039 ceph-mon[30872]: pgmap v518: 97 pgs: 97 active+clean; 408 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 2.09k op/s 2024-09-10T22:00:54.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:54 smithi173 ceph-mon[35294]: pgmap v518: 97 pgs: 97 active+clean; 408 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 2.09k op/s 2024-09-10T22:00:55.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:55 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:55.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:55 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:55.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:55 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:00:56.502 INFO:tasks.workunit.client.0.smithi039.stdout: 120 1792 1 958 2 841 0 2024-09-10T22:00:56.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:56 smithi070 ceph-mon[34909]: pgmap v519: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 KiB/s wr, 1.41k op/s 2024-09-10T22:00:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:56 smithi039 ceph-mon[30872]: pgmap v519: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 KiB/s wr, 1.41k op/s 2024-09-10T22:00:56.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:56 smithi173 ceph-mon[35294]: pgmap v519: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 KiB/s wr, 1.41k op/s 2024-09-10T22:00:58.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:00:58 smithi070 ceph-mon[34909]: pgmap v520: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 835 KiB/s wr, 1.31k op/s 2024-09-10T22:00:58.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:00:58 smithi039 ceph-mon[30872]: pgmap v520: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 835 KiB/s wr, 1.31k op/s 2024-09-10T22:00:58.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:00:58 smithi173 ceph-mon[35294]: pgmap v520: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 835 KiB/s wr, 1.31k op/s 2024-09-10T22:01:00.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:00 smithi070 ceph-mon[34909]: pgmap v521: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 1.31k op/s 2024-09-10T22:01:00.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:00 smithi039 ceph-mon[30872]: pgmap v521: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 1.31k op/s 2024-09-10T22:01:00.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:00 smithi173 ceph-mon[35294]: pgmap v521: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 1.31k op/s 2024-09-10T22:01:02.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:02 smithi070 ceph-mon[34909]: pgmap v522: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 971 op/s 2024-09-10T22:01:02.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:02 smithi039 ceph-mon[30872]: pgmap v522: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 971 op/s 2024-09-10T22:01:02.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:02 smithi173 ceph-mon[35294]: pgmap v522: 97 pgs: 97 active+clean; 405 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 971 op/s 2024-09-10T22:01:04.795 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-10T22:01:04.795 INFO:tasks.workunit.client.0.smithi039.stdout:Final score for writes: 120 2024-09-10T22:01:04.796 INFO:tasks.workunit.client.0.smithi039.stdout:Final score for reads : 252561 2024-09-10T22:01:04.796 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-10T22:01:04.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T22:01:04.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:01:04.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:04 smithi070 ceph-mon[34909]: pgmap v523: 97 pgs: 97 active+clean; 415 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.02k op/s 2024-09-10T22:01:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:04 smithi039 ceph-mon[30872]: pgmap v523: 97 pgs: 97 active+clean; 415 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.02k op/s 2024-09-10T22:01:04.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:04 smithi173 ceph-mon[35294]: pgmap v523: 97 pgs: 97 active+clean; 415 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.02k op/s 2024-09-10T22:01:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:06 smithi070 ceph-mon[34909]: pgmap v524: 97 pgs: 97 active+clean; 416 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 589 op/s 2024-09-10T22:01:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:06 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:06.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:06 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:06.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:06 smithi039 ceph-mon[30872]: pgmap v524: 97 pgs: 97 active+clean; 416 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 589 op/s 2024-09-10T22:01:06.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:06 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:06.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:06 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:06 smithi173 ceph-mon[35294]: pgmap v524: 97 pgs: 97 active+clean; 416 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 589 op/s 2024-09-10T22:01:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:06 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:06.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:06 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 -- 172.21.15.39:0/374729680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41029b0 msgr2=0x7efcc4102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/374729680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41029b0 0x7efcc4102db0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7efcac009930 tx=0x7efcac02a420 comp rx=0 tx=0).stop 2024-09-10T22:01:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 -- 172.21.15.39:0/374729680 shutdown_connections 2024-09-10T22:01:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/374729680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc41044c0 0x7efcc410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/374729680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4103b00 0x7efcc4103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/374729680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41029b0 0x7efcc4102db0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.771+0000 7efcc9c7f640 1 -- 172.21.15.39:0/374729680 >> 172.21.15.39:0/374729680 conn(0x7efcc40fe270 msgr2=0x7efcc4100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- 172.21.15.39:0/374729680 shutdown_connections 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- 172.21.15.39:0/374729680 wait complete. 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 Processor -- start 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- start start 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc41029b0 0x7efcc419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc4103b00 0x7efcc419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410e600 con 0x7efcc41044c0 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410e480 con 0x7efcc4103b00 2024-09-10T22:01:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.772+0000 7efcc9c7f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efcc410e780 con 0x7efcc41029b0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35566/0 (socket says 172.21.15.39:35566) 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 -- 172.21.15.39:0/2321926022 learned_addr learned my addr 172.21.15.39:0/2321926022 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc4103b00 0x7efcc419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc41029b0 0x7efcc419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 -- 172.21.15.39:0/2321926022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc41029b0 msgr2=0x7efcc419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc41029b0 0x7efcc419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 -- 172.21.15.39:0/2321926022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc4103b00 msgr2=0x7efcc419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc4103b00 0x7efcc419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 -- 172.21.15.39:0/2321926022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc419cb00 con 0x7efcc41044c0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc3fff640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00eb10 tx=0x7efcbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc0ff9640 1 -- 172.21.15.39:0/2321926022 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004b20 con 0x7efcc41044c0 2024-09-10T22:01:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc0ff9640 1 -- 172.21.15.39:0/2321926022 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcbc004cc0 con 0x7efcc41044c0 2024-09-10T22:01:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc419cdf0 con 0x7efcc41044c0 2024-09-10T22:01:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc0ff9640 1 -- 172.21.15.39:0/2321926022 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc010670 con 0x7efcc41044c0 2024-09-10T22:01:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.773+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41a34c0 con 0x7efcc41044c0 2024-09-10T22:01:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 Processor -- start 2024-09-10T22:01:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc0ff9640 1 -- 172.21.15.39:0/2321926022 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efcbc005020 con 0x7efcc41044c0 2024-09-10T22:01:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 -- start start 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071d9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071d9f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556071d096f0 con 0x556071d9cbd0 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556071cf8b20 con 0x556071d97860 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efccca4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556071cfc930 con 0x556071d9a190 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071d9f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58646/0 (socket says 172.21.15.39:58646) 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 -- 172.21.15.39:0/777417162 learned_addr learned my addr 172.21.15.39:0/777417162 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc37fe640 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071d9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 -- 172.21.15.39:0/777417162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 msgr2=0x556071d9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071d9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 -- 172.21.15.39:0/777417162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 msgr2=0x556071d9f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071d9f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc2ffd640 1 -- 172.21.15.39:0/777417162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556071cbe530 con 0x556071d97860 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.776+0000 7efcc37fe640 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071d9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcb4012830 tx=0x7efcb400b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4937afa2a934746 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcc0ff9640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 0x7efcb00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcb9ffb640 1 -- 172.21.15.39:0/777417162 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4004020 con 0x556071d97860 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 0x7efcb00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcb9ffb640 1 -- 172.21.15.39:0/777417162 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcb400fc10 con 0x556071d97860 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcb9ffb640 1 -- 172.21.15.39:0/777417162 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4003970 con 0x556071d97860 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.777+0000 7efcc0ff9640 1 -- 172.21.15.39:0/2321926022 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efcbc0e61a0 con 0x7efcc41044c0 2024-09-10T22:01:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- 172.21.15.39:0/777417162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 msgr2=0x556071d99c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcb4012830 tx=0x7efcb400b410 comp rx=0 tx=0).stop 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 0x7efcb00b77a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcac000c00 tx=0x7efcac0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- 172.21.15.39:0/777417162 shutdown_connections 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071d9f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071d9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- 172.21.15.39:0/777417162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d97860 0x556071d99c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- 172.21.15.39:0/777417162 >> 172.21.15.39:0/777417162 conn(0x556071d929b0 msgr2=0x556071d93740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- 172.21.15.39:0/777417162 shutdown_connections 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- 172.21.15.39:0/777417162 wait complete. 2024-09-10T22:01:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- start start 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 Processor -- start 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071da2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556071c30ab0 con 0x556071d9cbd0 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556071c9e730 con 0x556071d9a190 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.778+0000 7efccca4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556071d9fbb0 con 0x556071d97860 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efccca4f740 10 client.0 _ll_register_callbacks cb 0x556071cf26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071da2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58660/0 (socket says 172.21.15.39:58660) 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 -- 172.21.15.39:0/2995593096 learned_addr learned my addr 172.21.15.39:0/2995593096 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 -- 172.21.15.39:0/2995593096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 msgr2=0x556071da0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 -- 172.21.15.39:0/2995593096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 msgr2=0x556071da2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071da2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 -- 172.21.15.39:0/2995593096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556071a5a790 con 0x556071d9a190 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcb400be70 tx=0x7efcb400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33800675e650f83c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efca2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4005030 con 0x556071d9a190 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb400fc10 con 0x556071d9a190 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efcb40051d0 con 0x556071d9a190 2024-09-10T22:01:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efcb40053d0 con 0x556071d9a190 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efccca4f740 10 client.26456 fetch_fsmap learned FSMap version 32 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.779+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556071ad3620 con 0x556071d9a190 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcb400fc10 con 0x556071d9a190 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7efcb40046c0 con 0x556071d9a190 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 10 client.26456 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 10 client.26456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 20 client.26456 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071dac5f0 0x556071dae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 4 client.26456 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556071d0b640 con 0x556071dac5f0 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071dac5f0 0x556071dae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efca2ffd640 10 client.26456 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.780+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071dac5f0 0x556071dae9e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd4c3d195b62477 server_cookie=4fa5e6c8eb0ee966 in_seq=0 out_seq=0 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efca2ffd640 1 -- 172.21.15.39:0/2995593096 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556071d0b640 con 0x556071dac5f0 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efca2ffd640 10 client.26456 handle_command_reply: tid=0 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 client.26456 shutdown 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 msgr2=0x556071da15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcb400be70 tx=0x7efcb400bea0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 shutdown_connections 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071dac5f0 0x556071dae9e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9cbd0 0x556071da2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9a190 0x556071da15c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 --2- 172.21.15.39:0/2995593096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efca2ffd640 0 client.26456 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 >> 172.21.15.39:0/2995593096 conn(0x556071d929b0 msgr2=0x556071d91bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 shutdown_connections 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.782+0000 7efccca4f740 1 -- 172.21.15.39:0/2995593096 wait complete. 2024-09-10T22:01:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.783+0000 7efccca4f740 20 client.26456 trim_cache size 0 max 16384 2024-09-10T22:01:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.797+0000 7efccca4f740 1 Processor -- start 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.797+0000 7efccca4f740 1 -- start start 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071da0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ac0c0 con 0x556071d97860 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41adc60 con 0x556071d9cbd0 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efccca4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ac790 con 0x556071d9a190 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35594/0 (socket says 172.21.15.39:35594) 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 -- 172.21.15.39:0/2435713045 learned_addr learned my addr 172.21.15.39:0/2435713045 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc3fff640 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 -- 172.21.15.39:0/2435713045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 msgr2=0x556071da0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071da0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 -- 172.21.15.39:0/2435713045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 msgr2=0x556071da06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 -- 172.21.15.39:0/2435713045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556071da2500 con 0x556071d97860 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcc37fe640 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7efcac032fd0 tx=0x7efcac03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a356a98c0fd25b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcb97fa640 1 -- 172.21.15.39:0/2435713045 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac035050 con 0x556071d97860 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcb97fa640 1 -- 172.21.15.39:0/2435713045 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcac0044d0 con 0x556071d97860 2024-09-10T22:01:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.798+0000 7efcb97fa640 1 -- 172.21.15.39:0/2435713045 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0035f0 con 0x556071d97860 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- 172.21.15.39:0/2435713045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 msgr2=0x556071da1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7efcac032fd0 tx=0x7efcac03d000 comp rx=0 tx=0).stop 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- 172.21.15.39:0/2435713045 shutdown_connections 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d9a190 0x556071da0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 --2- 172.21.15.39:0/2435713045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d97860 0x556071da1630 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- 172.21.15.39:0/2435713045 >> 172.21.15.39:0/2435713045 conn(0x556071d929b0 msgr2=0x556071da0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- 172.21.15.39:0/2435713045 shutdown_connections 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- 172.21.15.39:0/2435713045 wait complete. 2024-09-10T22:01:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.799+0000 7efccca4f740 1 -- start start 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 Processor -- start 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ad530 con 0x556071d9a190 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ace60 con 0x556071d9cbd0 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41aa0a0 con 0x556071d97860 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efccca4f740 10 client.0 _ll_register_callbacks cb 0x7efcb400bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35602/0 (socket says 172.21.15.39:35602) 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 -- 172.21.15.39:0/3405516606 learned_addr learned my addr 172.21.15.39:0/3405516606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc3fff640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc37fe640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 -- 172.21.15.39:0/3405516606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 msgr2=0x556071da5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 -- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 msgr2=0x556071da7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 -- 172.21.15.39:0/3405516606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556071d9c8f0 con 0x556071d9a190 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc3fff640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efcc2ffd640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7efcb4004b10 tx=0x7efcb400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79726636a58ccc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.800+0000 7efca2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4004860 con 0x556071d9a190 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7efcb400f970 con 0x556071d9a190 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcac0044d0 con 0x556071d9a190 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efcb4042050 con 0x556071d9a190 2024-09-10T22:01:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 10 client.16842 fetch_fsmap learned FSMap version 32 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556071da8ab0 con 0x556071d9a190 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcac0044d0 con 0x556071d9a190 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7efcb403b550 con 0x556071d9a190 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 10 client.16842 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 10 client.16842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 20 client.16842 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071e19700 0x556071e1bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 4 client.16842 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556071d070f0 con 0x556071e19700 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.801+0000 7efcc37fe640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071e19700 0x556071e1bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.802+0000 7efca2ffd640 10 client.16842 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:07.802+0000 7efcc37fe640 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071e19700 0x556071e1bb20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a4cc947455888b server_cookie=cd84625e269dec78 in_seq=0 out_seq=0 2024-09-10T22:01:07.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:07 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:07.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:07 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:07.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:07 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:07 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:07 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:07.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:07 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:07 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:07 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:08.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:07 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efca2ffd640 1 -- 172.21.15.39:0/3405516606 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556071d070f0 con 0x556071e19700 2024-09-10T22:01:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efca2ffd640 10 client.16842 handle_command_reply: tid=0 2024-09-10T22:01:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 client.16842 shutdown 2024-09-10T22:01:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 msgr2=0x556071da64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7efcb4004b10 tx=0x7efcb400b410 comp rx=0 tx=0).stop 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 shutdown_connections 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x556071e19700 0x556071e1bb20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efca2ffd640 0 client.16842 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556071d9cbd0 0x556071da7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556071d9a190 0x556071da64c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 --2- 172.21.15.39:0/3405516606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556071d97860 0x556071da5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.371+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 >> 172.21.15.39:0/3405516606 conn(0x556071d929b0 msgr2=0x556071d91bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 shutdown_connections 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efccca4f740 1 -- 172.21.15.39:0/3405516606 wait complete. 2024-09-10T22:01:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efccca4f740 20 client.16842 trim_cache size 0 max 16384 2024-09-10T22:01:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:01:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:01:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:01:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:01:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 msgr2=0x7efcb00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 0x7efcb00b77a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcac000c00 tx=0x7efcac0314a0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 msgr2=0x7efcc419c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00eb10 tx=0x7efcbc00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 shutdown_connections 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.372+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7efcb00b52e0 0x7efcb00b77a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcc41044c0 0x7efcc419c240 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc4103b00 0x7efcc419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 --2- 172.21.15.39:0/2321926022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc41029b0 0x7efcc419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 >> 172.21.15.39:0/2321926022 conn(0x7efcc40fe270 msgr2=0x7efcc4109290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 shutdown_connections 2024-09-10T22:01:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:08.373+0000 7efcc9c7f640 1 -- 172.21.15.39:0/2321926022 wait complete. 2024-09-10T22:01:08.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:01:08.809 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:08.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:08 smithi039 ceph-mon[30872]: pgmap v525: 97 pgs: 97 active+clean; 415 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.6 MiB/s wr, 464 op/s 2024-09-10T22:01:08.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:08 smithi173 ceph-mon[35294]: pgmap v525: 97 pgs: 97 active+clean; 415 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.6 MiB/s wr, 464 op/s 2024-09-10T22:01:09.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:08 smithi070 ceph-mon[34909]: pgmap v525: 97 pgs: 97 active+clean; 415 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.6 MiB/s wr, 464 op/s 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 -- 172.21.15.39:0/2198726632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4108020 msgr2=0x7f06d410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 --2- 172.21.15.39:0/2198726632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4108020 0x7f06d410e820 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009ca0 tx=0x7f06cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 -- 172.21.15.39:0/2198726632 shutdown_connections 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 --2- 172.21.15.39:0/2198726632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4108020 0x7f06d410e820 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 --2- 172.21.15.39:0/2198726632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 --2- 172.21.15.39:0/2198726632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4101c90 0x7f06d4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 -- 172.21.15.39:0/2198726632 >> 172.21.15.39:0/2198726632 conn(0x7f06d40fd700 msgr2=0x7f06d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 -- 172.21.15.39:0/2198726632 shutdown_connections 2024-09-10T22:01:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.303+0000 7f06da567640 1 -- 172.21.15.39:0/2198726632 wait complete. 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 Processor -- start 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 -- start start 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4108020 0x7f06d40fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4111ce0 con 0x7f06d4101c90 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4111b60 con 0x7f06d41076a0 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06da567640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4111e60 con 0x7f06d4108020 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35628/0 (socket says 172.21.15.39:35628) 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06d3fff640 1 -- 172.21.15.39:0/1888715551 learned_addr learned my addr 172.21.15.39:0/1888715551 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06d37fe640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.304+0000 7f06d8b04640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4108020 0x7f06d40fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 -- 172.21.15.39:0/1888715551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4108020 msgr2=0x7f06d40fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4108020 0x7f06d40fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 -- 172.21.15.39:0/1888715551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 msgr2=0x7f06d40fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d40fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 -- 172.21.15.39:0/1888715551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41a76e0 con 0x7f06d4101c90 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d37fe640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d40fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d3fff640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d770 tx=0x7f06c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d17fa640 1 -- 172.21.15.39:0/1888715551 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4017070 con 0x7f06d4101c90 2024-09-10T22:01:09.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d41a79d0 con 0x7f06d4101c90 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41a7f10 con 0x7f06d4101c90 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d17fa640 1 -- 172.21.15.39:0/1888715551 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c40054d0 con 0x7f06d4101c90 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.305+0000 7f06d17fa640 1 -- 172.21.15.39:0/1888715551 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4004c30 con 0x7f06d4101c90 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 Processor -- start 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 -- start start 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06d17fa640 1 -- 172.21.15.39:0/1888715551 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f06c4010460 con 0x7f06d4101c90 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c05550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564cb0b64e50 con 0x564cb0bee9c0 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cb0b54280 con 0x564cb0bee0a0 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06dc93c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564cb0b58090 con 0x564cb0c03160 2024-09-10T22:01:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58706/0 (socket says 172.21.15.39:58706) 2024-09-10T22:01:09.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06d8b04640 1 -- 172.21.15.39:0/2388700820 learned_addr learned my addr 172.21.15.39:0/2388700820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:09.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.308+0000 7f06d3fff640 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d37fe640 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c05550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 -- 172.21.15.39:0/2388700820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 msgr2=0x564cb0c05550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c05550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 -- 172.21.15.39:0/2388700820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 msgr2=0x564cb0c02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 -- 172.21.15.39:0/2388700820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb08b2650 con 0x564cb0bee0a0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d8b04640 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06cc035000 tx=0x7f06cc005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99bdbce48a289 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06d17fa640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 0x7f06bc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06ba7fc640 1 -- 172.21.15.39:0/2388700820 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc031cf0 con 0x564cb0bee0a0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06ba7fc640 1 -- 172.21.15.39:0/2388700820 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06cc036030 con 0x564cb0bee0a0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.309+0000 7f06ba7fc640 1 -- 172.21.15.39:0/2388700820 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0042a0 con 0x564cb0bee0a0 2024-09-10T22:01:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06d3fff640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 0x7f06bc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06d17fa640 1 -- 172.21.15.39:0/1888715551 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f06c40e53a0 con 0x7f06d4101c90 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 -- 172.21.15.39:0/2388700820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 msgr2=0x564cb0bee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06d3fff640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 0x7f06bc0b7820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c40e3220 tx=0x7f06c4093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06cc035000 tx=0x7f06cc005fa0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 -- 172.21.15.39:0/2388700820 shutdown_connections 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c05550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 --2- 172.21.15.39:0/2388700820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bee480 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 -- 172.21.15.39:0/2388700820 >> 172.21.15.39:0/2388700820 conn(0x564cb0bebed0 msgr2=0x564cb0bed070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 -- 172.21.15.39:0/2388700820 shutdown_connections 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.310+0000 7f06dc93c740 1 -- 172.21.15.39:0/2388700820 wait complete. 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 -- start start 2024-09-10T22:01:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 Processor -- start 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 0x564cb0c029e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0c03160 0x564cb0c003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564cb09b5700 con 0x564cb0bee9c0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cb0aef110 con 0x564cb0c03160 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564cb0c05c00 con 0x564cb0bee0a0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06dc93c740 10 client.0 _ll_register_callbacks cb 0x564cb0b08990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.311+0000 7f06d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35650/0 (socket says 172.21.15.39:35650) 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 -- 172.21.15.39:0/836574245 learned_addr learned my addr 172.21.15.39:0/836574245 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d8b04640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0c03160 0x564cb0c003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d8b04640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 0x564cb0c029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 -- 172.21.15.39:0/836574245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 msgr2=0x564cb0c029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 0x564cb0c029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 -- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0c03160 msgr2=0x564cb0c003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0c03160 0x564cb0c003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 -- 172.21.15.39:0/836574245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb0b1cc40 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d8b04640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 0x564cb0c029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06d37fe640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06c8012d20 tx=0x7f06c800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722872ba3268151b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8012110 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f06c8004050 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.312+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc036030 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f06c80122b0 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 10 client.16854 fetch_fsmap learned FSMap version 32 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564cb0c115c0 con 0x564cb0bee9c0 2024-09-10T22:01:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06cc036030 con 0x564cb0bee9c0 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f06c8010430 con 0x564cb0bee9c0 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 10 client.16854 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 20 client.16854 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c14fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 4 client.16854 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cb0b66da0 con 0x564cb0c12b70 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.313+0000 7f06d8b04640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c14fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.314+0000 7f06d8b04640 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c14fb0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72adf6ffabafe23b server_cookie=37611c7fb3a8791b in_seq=0 out_seq=0 2024-09-10T22:01:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.314+0000 7f06b37fe640 10 client.16854 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:09.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.315+0000 7f06b37fe640 1 -- 172.21.15.39:0/836574245 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564cb0b66da0 con 0x564cb0c12b70 2024-09-10T22:01:09.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.315+0000 7f06b37fe640 10 client.16854 handle_command_reply: tid=0 2024-09-10T22:01:09.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.315+0000 7f06dc93c740 1 client.16854 shutdown 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 msgr2=0x564cb0bffe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06c8012d20 tx=0x7f06c800f790 comp rx=0 tx=0).stop 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 shutdown_connections 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c14fb0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06b37fe640 0 client.16854 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0c03160 0x564cb0c003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0bffe30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 --2- 172.21.15.39:0/836574245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0bee0a0 0x564cb0c029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 >> 172.21.15.39:0/836574245 conn(0x564cb0bebed0 msgr2=0x564cb0bf1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 shutdown_connections 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 1 -- 172.21.15.39:0/836574245 wait complete. 2024-09-10T22:01:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.316+0000 7f06dc93c740 20 client.16854 trim_cache size 0 max 16384 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.333+0000 7f06dc93c740 1 Processor -- start 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.333+0000 7f06dc93c740 1 -- start start 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c1adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000e430 con 0x564cb0bee9c0 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000ffd0 con 0x564cb0bee0a0 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06dc93c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000eb00 con 0x564cb0c03160 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:58724/0 (socket says 172.21.15.39:58724) 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35666/0 (socket says 172.21.15.39:35666) 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 -- 172.21.15.39:0/1383096323 learned_addr learned my addr 172.21.15.39:0/1383096323 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c1adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 -- 172.21.15.39:0/1383096323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 msgr2=0x564cb0c1adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c1adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 -- 172.21.15.39:0/1383096323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 msgr2=0x564cb0c1a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 -- 172.21.15.39:0/1383096323 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb0bee7f0 con 0x564cb0bee0a0 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d37fe640 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.334+0000 7f06d8b04640 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06cc006010 tx=0x7f06cc0093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64adc6138698eba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06b9ffb640 1 -- 172.21.15.39:0/1383096323 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc031af0 con 0x564cb0bee0a0 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06b9ffb640 1 -- 172.21.15.39:0/1383096323 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06cc036070 con 0x564cb0bee0a0 2024-09-10T22:01:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06b9ffb640 1 -- 172.21.15.39:0/1383096323 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0042a0 con 0x564cb0bee0a0 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 -- 172.21.15.39:0/1383096323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 msgr2=0x564cb0bed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06cc006010 tx=0x7f06cc0093c0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 -- 172.21.15.39:0/1383096323 shutdown_connections 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c1adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee9c0 0x564cb0c1a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 --2- 172.21.15.39:0/1383096323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee0a0 0x564cb0bed6d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 -- 172.21.15.39:0/1383096323 >> 172.21.15.39:0/1383096323 conn(0x564cb0bebed0 msgr2=0x564cb0becfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 -- 172.21.15.39:0/1383096323 shutdown_connections 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.335+0000 7f06dc93c740 1 -- 172.21.15.39:0/1383096323 wait complete. 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 -- start start 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 Processor -- start 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 0x564cb0c0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c07ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000f8a0 con 0x564cb0bee0a0 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000f1d0 con 0x564cb0bee9c0 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000c410 con 0x564cb0c03160 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06dc93c740 10 client.0 _ll_register_callbacks cb 0x7f06c8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06d8b04640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35672/0 (socket says 172.21.15.39:35672) 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.336+0000 7f06d8b04640 1 -- 172.21.15.39:0/3125710137 learned_addr learned my addr 172.21.15.39:0/3125710137 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d37fe640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 0x564cb0c0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c07ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 -- 172.21.15.39:0/3125710137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 msgr2=0x564cb0c07ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c07ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 -- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 msgr2=0x564cb0c0b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 0x564cb0c0b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 -- 172.21.15.39:0/3125710137 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb0c08560 con 0x564cb0bee0a0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d37fe640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 0x564cb0c0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06d8b04640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009a60 tx=0x7f06cc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4500e4bd67502302 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc06b060 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f06cc031450 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.337+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06cc036070 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f06cc04a040 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 10 client.16860 fetch_fsmap learned FSMap version 32 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564cb0c803e0 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06cc036070 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f06cc043070 con 0x564cb0bee0a0 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 10 client.16860 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 10 client.16860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 20 client.16860 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c82810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 4 client.16860 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564cb0b62850 con 0x564cb0c12b70 2024-09-10T22:01:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.338+0000 7f06d37fe640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c82810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:09.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.339+0000 7f06b37fe640 10 client.16860 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:09.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.339+0000 7f06d37fe640 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c82810 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289eaee2715d21f0 server_cookie=5a87225651a393f6 in_seq=0 out_seq=0 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.340+0000 7f06b37fe640 1 -- 172.21.15.39:0/3125710137 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x564cb0b62850 con 0x564cb0c12b70 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.340+0000 7f06b37fe640 10 client.16860 handle_command_reply: tid=0 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.340+0000 7f06dc93c740 1 client.16860 shutdown 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 msgr2=0x564cb0c0b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009a60 tx=0x7f06cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 shutdown_connections 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x564cb0c12b70 0x564cb0c82810 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564cb0c03160 0x564cb0c07ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cb0bee9c0 0x564cb0c0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06b37fe640 0 client.16860 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 --2- 172.21.15.39:0/3125710137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cb0bee0a0 0x564cb0c0b100 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 >> 172.21.15.39:0/3125710137 conn(0x564cb0bebed0 msgr2=0x564cb0c01460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 shutdown_connections 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 1 -- 172.21.15.39:0/3125710137 wait complete. 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.341+0000 7f06dc93c740 20 client.16860 trim_cache size 0 max 16384 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T22:01:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "956ae779-ac12-4a63-9d38-bbcac731e7fd": { 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:00:35.416798+0000", 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T22:01:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T22:01:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:09.352 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 msgr2=0x7f06bc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 0x7f06bc0b7820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c40e3220 tx=0x7f06c4093040 comp rx=0 tx=0).stop 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 msgr2=0x7f06d40fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d770 tx=0x7f06c400dc30 comp rx=0 tx=0).stop 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 shutdown_connections 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f06bc0b5360 0x7f06bc0b7820 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d4108020 0x7f06d40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41076a0 0x7f06d40fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 --2- 172.21.15.39:0/1888715551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06d4101c90 0x7f06d40fdc00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:09.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 >> 172.21.15.39:0/1888715551 conn(0x7f06d40fd700 msgr2=0x7f06d406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:09.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 shutdown_connections 2024-09-10T22:01:09.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:09.342+0000 7f06da567640 1 -- 172.21.15.39:0/1888715551 wait complete. 2024-09-10T22:01:09.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:09 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:01:09.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:09 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:01:10.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:09 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:01:10.185 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:01:10.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:01:10.512 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:10 smithi039 ceph-mon[30872]: pgmap v526: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 507 op/s 2024-09-10T22:01:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:01:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:01:10.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:01:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:10 smithi173 ceph-mon[35294]: pgmap v526: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 507 op/s 2024-09-10T22:01:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:01:10.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:01:10.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 -- 172.21.15.39:0/1989562390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c1045c0 msgr2=0x7f341c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 --2- 172.21.15.39:0/1989562390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c1045c0 0x7f341c10cab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3418009900 tx=0x7f341802a410 comp rx=0 tx=0).stop 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 -- 172.21.15.39:0/1989562390 shutdown_connections 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 --2- 172.21.15.39:0/1989562390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c10d100 0x7f341c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 --2- 172.21.15.39:0/1989562390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c1045c0 0x7f341c10cab0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 --2- 172.21.15.39:0/1989562390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 0x7f341c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 -- 172.21.15.39:0/1989562390 >> 172.21.15.39:0/1989562390 conn(0x7f341c0fd700 msgr2=0x7f341c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:11.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.046+0000 7f34239f5640 1 -- 172.21.15.39:0/1989562390 shutdown_connections 2024-09-10T22:01:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 -- 172.21.15.39:0/1989562390 wait complete. 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 Processor -- start 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 -- start start 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 0x7f341c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c10d100 0x7f341c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f341c112d70 con 0x7f341c10d100 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f341c112bf0 con 0x7f341c1045c0 2024-09-10T22:01:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.047+0000 7f34239f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f341c112ef0 con 0x7f341c103ca0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3421791640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 0x7f341c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3421f92640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c10d100 0x7f341c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33280/0 (socket says 172.21.15.39:33280) 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 -- 172.21.15.39:0/310517210 learned_addr learned my addr 172.21.15.39:0/310517210 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 -- 172.21.15.39:0/310517210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 msgr2=0x7f341c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 0x7f341c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 -- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c10d100 msgr2=0x7f341c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c10d100 0x7f341c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 -- 172.21.15.39:0/310517210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c19f3d0 con 0x7f341c1045c0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f3420f90640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3418032fd0 tx=0x7f3418031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341803f030 con 0x7f341c1045c0 2024-09-10T22:01:11.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c19f660 con 0x7f341c1045c0 2024-09-10T22:01:11.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3418004490 con 0x7f341c1045c0 2024-09-10T22:01:11.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.048+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418035070 con 0x7f341c1045c0 2024-09-10T22:01:11.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.049+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1a5d80 con 0x7f341c1045c0 2024-09-10T22:01:11.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.049+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c104080 con 0x7f341c1045c0 2024-09-10T22:01:11.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.051+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f341803ba30 con 0x7f341c1045c0 2024-09-10T22:01:11.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.052+0000 7f340e7fc640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 0x7f34080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:11.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.052+0000 7f3421791640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 0x7f34080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:11.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.052+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f34181065d0 con 0x7f341c1045c0 2024-09-10T22:01:11.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.053+0000 7f3421791640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 0x7f34080b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3410005fd0 tx=0x7f341000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:11.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.058+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34180ccdf0 con 0x7f341c1045c0 2024-09-10T22:01:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:10 smithi070 ceph-mon[34909]: pgmap v526: 97 pgs: 97 active+clean; 412 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 507 op/s 2024-09-10T22:01:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:01:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:01:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:01:11.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.285+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f341c19a450 con 0x7f341c1045c0 2024-09-10T22:01:11.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.286+0000 7f340e7fc640 1 -- 172.21.15.39:0/310517210 <== mon.2 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11976 (secure 0 0 0) 0x7f34180d1820 con 0x7f341c1045c0 2024-09-10T22:01:11.288 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:01:11.288 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"btime":"2024-09-10T22:00:31:861943+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T22:00:31.010587+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[2,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T22:01:11.288 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 32 2024-09-10T22:01:11.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 msgr2=0x7f34080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 0x7f34080b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3410005fd0 tx=0x7f341000b390 comp rx=0 tx=0).stop 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 msgr2=0x7f341c199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3418032fd0 tx=0x7f3418031a20 comp rx=0 tx=0).stop 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 shutdown_connections 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f34080b52e0 0x7f34080b77a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f341c10d100 0x7f341c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f341c1045c0 0x7f341c199860 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 --2- 172.21.15.39:0/310517210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f341c103ca0 0x7f341c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 >> 172.21.15.39:0/310517210 conn(0x7f341c0fd700 msgr2=0x7f341c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 shutdown_connections 2024-09-10T22:01:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:11.288+0000 7f34239f5640 1 -- 172.21.15.39:0/310517210 wait complete. 2024-09-10T22:01:11.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:11 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/310517210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:11.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T22:01:11.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:11 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/310517210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:12.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:11 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/310517210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:12.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 -- 172.21.15.39:0/2663605509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 msgr2=0x7f219410e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 --2- 172.21.15.39:0/2663605509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f219410e840 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ca0 tx=0x7f218c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 -- 172.21.15.39:0/2663605509 shutdown_connections 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 --2- 172.21.15.39:0/2663605509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f219410e840 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 --2- 172.21.15.39:0/2663605509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21941076c0 0x7f2194107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 --2- 172.21.15.39:0/2663605509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2194101cb0 0x7f2194102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 -- 172.21.15.39:0/2663605509 >> 172.21.15.39:0/2663605509 conn(0x7f21940fd700 msgr2=0x7f21940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 -- 172.21.15.39:0/2663605509 shutdown_connections 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.668+0000 7f219c1ec640 1 -- 172.21.15.39:0/2663605509 wait complete. 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 Processor -- start 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 -- start start 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2194101cb0 0x7f21940fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21941076c0 0x7f21940fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2194111d50 con 0x7f2194108040 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2194111bd0 con 0x7f2194101cb0 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219c1ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2194111ed0 con 0x7f21941076c0 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36526/0 (socket says 172.21.15.39:36526) 2024-09-10T22:01:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 -- 172.21.15.39:0/633032115 learned_addr learned my addr 172.21.15.39:0/633032115 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f2199f88640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2194101cb0 0x7f21940fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f2199787640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21941076c0 0x7f21940fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 -- 172.21.15.39:0/633032115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21941076c0 msgr2=0x7f21940fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21941076c0 0x7f21940fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 -- 172.21.15.39:0/633032115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2194101cb0 msgr2=0x7f21940fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2194101cb0 0x7f21940fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.669+0000 7f219a789640 1 -- 172.21.15.39:0/633032115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21941a76d0 con 0x7f2194108040 2024-09-10T22:01:12.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f219a789640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f218c009430 tx=0x7f218c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f218affd640 1 -- 172.21.15.39:0/633032115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c003b70 con 0x7f2194108040 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f218affd640 1 -- 172.21.15.39:0/633032115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f218c003d10 con 0x7f2194108040 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f218affd640 1 -- 172.21.15.39:0/633032115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c02fa30 con 0x7f2194108040 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21941a7960 con 0x7f2194108040 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.670+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21941a7ef0 con 0x7f2194108040 2024-09-10T22:01:12.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.672+0000 7f218affd640 1 -- 172.21.15.39:0/633032115 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f218c02fbd0 con 0x7f2194108040 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 Processor -- start 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 -- start start 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561534227ea0 con 0x5615342b14d0 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5615342172d0 con 0x5615342b1df0 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f219e5c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56153421b0e0 con 0x5615342bdd80 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f2199f88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f2199f88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33318/0 (socket says 172.21.15.39:33318) 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36538/0 (socket says 172.21.15.39:36538) 2024-09-10T22:01:12.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.673+0000 7f2199f88640 1 -- 172.21.15.39:0/1828694768 learned_addr learned my addr 172.21.15.39:0/1828694768 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f218affd640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 0x7f21800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 -- 172.21.15.39:0/1828694768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 msgr2=0x5615342c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199787640 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 -- 172.21.15.39:0/1828694768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 msgr2=0x5615342b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 -- 172.21.15.39:0/1828694768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561533f75650 con 0x5615342b1df0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199787640 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f218affd640 1 -- 172.21.15.39:0/633032115 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f218c106e30 con 0x7f2194108040 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f219a789640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 0x7f21800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f2199f88640 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f219000bd10 tx=0x7f21900107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e858071db519e77d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f217ffff640 1 -- 172.21.15.39:0/1828694768 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190004030 con 0x5615342b1df0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f217ffff640 1 -- 172.21.15.39:0/1828694768 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21900035f0 con 0x5615342b1df0 2024-09-10T22:01:12.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.674+0000 7f217ffff640 1 -- 172.21.15.39:0/1828694768 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190011750 con 0x5615342b1df0 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 -- 172.21.15.39:0/1828694768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 msgr2=0x5615342bd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f219000bd10 tx=0x7f21900107a0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219a789640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 0x7f21800b7820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f218c0cd590 tx=0x7f218c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 -- 172.21.15.39:0/1828694768 shutdown_connections 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342bd840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1828694768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 -- 172.21.15.39:0/1828694768 >> 172.21.15.39:0/1828694768 conn(0x5615342af300 msgr2=0x5615342b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 -- 172.21.15.39:0/1828694768 shutdown_connections 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.675+0000 7f219e5c1740 1 -- 172.21.15.39:0/1828694768 wait complete. 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 -- start start 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 Processor -- start 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342bdd80 0x5615342bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561534078700 con 0x5615342bdd80 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5615341b2160 con 0x5615342b14d0 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615342c0a00 con 0x5615342b1df0 2024-09-10T22:01:12.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f219e5c1740 10 client.0 _ll_register_callbacks cb 0x5615341cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f2199787640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f2199787640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33326/0 (socket says 172.21.15.39:33326) 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f2199f88640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f2199787640 1 -- 172.21.15.39:0/2323092596 learned_addr learned my addr 172.21.15.39:0/2323092596 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.676+0000 7f2199787640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342bdd80 0x5615342bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 -- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 msgr2=0x5615342baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 -- 172.21.15.39:0/2323092596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342bdd80 msgr2=0x5615342bb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342bdd80 0x5615342bb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 -- 172.21.15.39:0/2323092596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615341dfc90 con 0x5615342b14d0 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199f88640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:12.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f2199787640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2184009560 tx=0x7f2184005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4062ad491e1ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.677+0000 7f217d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:12.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.680+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840130d0 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.680+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2184004030 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.680+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21900035f0 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2184013270 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 10 client.26498 fetch_fsmap learned FSMap version 33 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5615342cc340 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21900035f0 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2184003cd0 con 0x5615342b14d0 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 10 client.26498 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T22:01:12.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 10 client.26498 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 20 client.26498 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5615342cd7a0 0x5615342cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 4 client.26498 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561534229df0 con 0x5615342cd7a0 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.681+0000 7f2199f88640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5615342cd7a0 0x5615342cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f2199f88640 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5615342cd7a0 0x5615342cfb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c8b14260b84fc91 server_cookie=c165b34b72288b8b in_seq=0 out_seq=0 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f217d7fa640 10 client.26498 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f217d7fa640 1 -- 172.21.15.39:0/2323092596 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561534229df0 con 0x5615342cd7a0 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f217d7fa640 10 client.26498 handle_command_reply: tid=0 2024-09-10T22:01:12.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f219e5c1740 1 client.26498 shutdown 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 msgr2=0x5615342bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.682+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2184009560 tx=0x7f2184005f90 comp rx=0 tx=0).stop 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 shutdown_connections 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x5615342cd7a0 0x5615342cfb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342bdd80 0x5615342bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2323092596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b14d0 0x5615342bd650 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f217d7fa640 0 client.26498 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 >> 172.21.15.39:0/2323092596 conn(0x5615342af300 msgr2=0x5615342b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 shutdown_connections 2024-09-10T22:01:12.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 1 -- 172.21.15.39:0/2323092596 wait complete. 2024-09-10T22:01:12.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.683+0000 7f219e5c1740 20 client.26498 trim_cache size 0 max 16384 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.696+0000 7f219e5c1740 1 Processor -- start 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.696+0000 7f219e5c1740 1 -- start start 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342bf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342bdd80 0x5615342bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f21941b05d0 con 0x5615342b14d0 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21941b2140 con 0x5615342bdd80 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f219e5c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21941b0ca0 con 0x5615342b1df0 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36556/0 (socket says 172.21.15.39:36556) 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 -- 172.21.15.39:0/1956361142 learned_addr learned my addr 172.21.15.39:0/1956361142 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199f88640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342bdd80 0x5615342bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 -- 172.21.15.39:0/1956361142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 msgr2=0x5615342bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 -- 172.21.15.39:0/1956361142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342bdd80 msgr2=0x5615342bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342bdd80 0x5615342bf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 -- 172.21.15.39:0/1956361142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615342bb3f0 con 0x5615342b14d0 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199f88640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.697+0000 7f2199787640 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f218400a010 tx=0x7f2184005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3949509f13736905 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f217f7fe640 1 -- 172.21.15.39:0/1956361142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840052b0 con 0x5615342b14d0 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f217f7fe640 1 -- 172.21.15.39:0/1956361142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2184019030 con 0x5615342b14d0 2024-09-10T22:01:12.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f217f7fe640 1 -- 172.21.15.39:0/1956361142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218400fea0 con 0x5615342b14d0 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 -- 172.21.15.39:0/1956361142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 msgr2=0x5615342aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f218400a010 tx=0x7f2184005970 comp rx=0 tx=0).stop 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 -- 172.21.15.39:0/1956361142 shutdown_connections 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342bdd80 0x5615342bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342b1df0 0x5615342bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 --2- 172.21.15.39:0/1956361142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342aec10 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 -- 172.21.15.39:0/1956361142 >> 172.21.15.39:0/1956361142 conn(0x5615342af300 msgr2=0x5615342b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 -- 172.21.15.39:0/1956361142 shutdown_connections 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.698+0000 7f219e5c1740 1 -- 172.21.15.39:0/1956361142 wait complete. 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 -- start start 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 Processor -- start 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f21941b1a40 con 0x5615342b14d0 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21941b1370 con 0x5615342b1df0 2024-09-10T22:01:12.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21941ae5b0 con 0x5615342bdd80 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f219e5c1740 10 client.0 _ll_register_callbacks cb 0x7f2184009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f2199f88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f2199787640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36562/0 (socket says 172.21.15.39:36562) 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f2199f88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33344/0 (socket says 172.21.15.39:33344) 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.699+0000 7f2199787640 1 -- 172.21.15.39:0/2015031214 learned_addr learned my addr 172.21.15.39:0/2015031214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 -- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 msgr2=0x5615342c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 -- 172.21.15.39:0/2015031214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 msgr2=0x5615342c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 -- 172.21.15.39:0/2015031214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615342c14b0 con 0x5615342b14d0 2024-09-10T22:01:12.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f2199787640 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2184013240 tx=0x7f2184013560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097628b83319a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f217d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184032070 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f21840050e0 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2184019030 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2184005300 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f219e5c1740 10 client.16884 fetch_fsmap learned FSMap version 33 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56153433b0f0 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.700+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2184019030 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2184035020 con 0x5615342b14d0 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 10 client.16884 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T22:01:12.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 10 client.16884 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 20 client.16884 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x56153433b7a0 0x56153433db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 4 client.16884 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615342258a0 con 0x56153433b7a0 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f2199f88640 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x56153433b7a0 0x56153433db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f2199f88640 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x56153433b7a0 0x56153433db90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3846dfc008fcaa86 server_cookie=840089d7eeb371bc in_seq=0 out_seq=0 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.701+0000 7f217d7fa640 10 client.16884 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f217d7fa640 1 -- 172.21.15.39:0/2015031214 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615342258a0 con 0x56153433b7a0 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f217d7fa640 10 client.16884 handle_command_reply: tid=0 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 client.16884 shutdown 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 msgr2=0x5615342c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2184013240 tx=0x7f2184013560 comp rx=0 tx=0).stop 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 shutdown_connections 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x56153433b7a0 0x56153433db90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615342bdd80 0x5615342c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615342b1df0 0x5615342c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 --2- 172.21.15.39:0/2015031214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615342b14d0 0x5615342c5eb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f217d7fa640 0 client.16884 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 >> 172.21.15.39:0/2015031214 conn(0x5615342af300 msgr2=0x5615342bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 shutdown_connections 2024-09-10T22:01:12.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 1 -- 172.21.15.39:0/2015031214 wait complete. 2024-09-10T22:01:12.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219e5c1740 20 client.16884 trim_cache size 0 max 16384 2024-09-10T22:01:12.710 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 msgr2=0x7f21800b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.702+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 0x7f21800b7820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f218c0cd590 tx=0x7f218c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 msgr2=0x7f21940fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f218c009430 tx=0x7f218c0317c0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 shutdown_connections 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f21800b5360 0x7f21800b7820 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2194108040 0x7f21940fe680 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21941076c0 0x7f21940fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 --2- 172.21.15.39:0/633032115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2194101cb0 0x7f21940fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:12.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 >> 172.21.15.39:0/633032115 conn(0x7f21940fd700 msgr2=0x7f219406b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:12.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 shutdown_connections 2024-09-10T22:01:12.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:12.703+0000 7f219c1ec640 1 -- 172.21.15.39:0/633032115 wait complete. 2024-09-10T22:01:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:12 smithi039 ceph-mon[30872]: pgmap v527: 97 pgs: 97 active+clean; 410 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.8 MiB/s wr, 314 op/s 2024-09-10T22:01:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:12 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:12 smithi173 ceph-mon[35294]: pgmap v527: 97 pgs: 97 active+clean; 410 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.8 MiB/s wr, 314 op/s 2024-09-10T22:01:12.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:12 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:12 smithi070 ceph-mon[34909]: pgmap v527: 97 pgs: 97 active+clean; 410 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 1.8 MiB/s wr, 314 op/s 2024-09-10T22:01:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:12 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:13.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T22:01:13.789 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- 172.21.15.39:0/1757930110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc104530 msgr2=0x7fccbc10cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 --2- 172.21.15.39:0/1757930110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc104530 0x7fccbc10cb10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009900 tx=0x7fcca402a410 comp rx=0 tx=0).stop 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- 172.21.15.39:0/1757930110 shutdown_connections 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 --2- 172.21.15.39:0/1757930110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 --2- 172.21.15.39:0/1757930110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc104530 0x7fccbc10cb10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 --2- 172.21.15.39:0/1757930110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc103b30 0x7fccbc103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- 172.21.15.39:0/1757930110 >> 172.21.15.39:0/1757930110 conn(0x7fccbc0fd700 msgr2=0x7fccbc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- 172.21.15.39:0/1757930110 shutdown_connections 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- 172.21.15.39:0/1757930110 wait complete. 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 Processor -- start 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.256+0000 7fccc18d5640 1 -- start start 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 0x7fccbc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc112d60 con 0x7fccbc103b30 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc112be0 con 0x7fccbc10d0e0 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccc18d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc112ee0 con 0x7fccbc104530 2024-09-10T22:01:14.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36576/0 (socket says 172.21.15.39:36576) 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 -- 172.21.15.39:0/3886149618 learned_addr learned my addr 172.21.15.39:0/3886149618 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccba7fc640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 0x7fccbc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 -- 172.21.15.39:0/3886149618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 msgr2=0x7fccbc199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 0x7fccbc199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 -- 172.21.15.39:0/3886149618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 msgr2=0x7fccbc19eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc19eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 -- 172.21.15.39:0/3886149618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc19f2c0 con 0x7fccbc103b30 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccba7fc640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 0x7fccbc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.257+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fccac00cce0 tx=0x7fccac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.258+0000 7fccc08d3640 1 -- 172.21.15.39:0/3886149618 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac00f650 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.258+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc19f5b0 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.258+0000 7fccc08d3640 1 -- 172.21.15.39:0/3886149618 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac00fca0 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.258+0000 7fccc08d3640 1 -- 172.21.15.39:0/3886149618 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac018b40 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.258+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc1a5c70 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.260+0000 7fccc08d3640 1 -- 172.21.15.39:0/3886149618 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fccac00f7f0 con 0x7fccbc103b30 2024-09-10T22:01:14.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.260+0000 7fccc3caa740 1 Processor -- start 2024-09-10T22:01:14.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 -- start start 2024-09-10T22:01:14.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cf0f0 0x557f824cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f82445ea0 con 0x557f824db9a0 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557f824352d0 con 0x557f824cfa10 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc3caa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f824390e0 con 0x557f824cf0f0 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33382/0 (socket says 172.21.15.39:33382) 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36580/0 (socket says 172.21.15.39:36580) 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 -- 172.21.15.39:0/1292904541 learned_addr learned my addr 172.21.15.39:0/1292904541 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cf0f0 0x557f824cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccc08d3640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 0x7fcca80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 -- 172.21.15.39:0/1292904541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cf0f0 msgr2=0x557f824cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cf0f0 0x557f824cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 -- 172.21.15.39:0/1292904541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 msgr2=0x557f824ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.261+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccbaffd640 1 -- 172.21.15.39:0/1292904541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f82193650 con 0x557f824cfa10 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccba7fc640 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 0x7fcca80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccc08d3640 1 -- 172.21.15.39:0/3886149618 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fccac0e60b0 con 0x7fccbc103b30 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fccac0c72b0 tx=0x7fccac0a8720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc5aedb019ed26fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 0x7fcca80b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fccb4004240 tx=0x7fccb40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccb1ffb640 1 -- 172.21.15.39:0/1292904541 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0ac650 con 0x557f824cfa10 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccb1ffb640 1 -- 172.21.15.39:0/1292904541 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac0ac390 con 0x557f824cfa10 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.262+0000 7fccb1ffb640 1 -- 172.21.15.39:0/1292904541 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0abff0 con 0x557f824cfa10 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- 172.21.15.39:0/1292904541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 msgr2=0x557f824db460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fccac0c72b0 tx=0x7fccac0a8720 comp rx=0 tx=0).stop 2024-09-10T22:01:14.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- 172.21.15.39:0/1292904541 shutdown_connections 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cfa10 0x557f824db460 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1292904541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cf0f0 0x557f824cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- 172.21.15.39:0/1292904541 >> 172.21.15.39:0/1292904541 conn(0x557f824ccf20 msgr2=0x557f824ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- 172.21.15.39:0/1292904541 shutdown_connections 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- 172.21.15.39:0/1292904541 wait complete. 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.263+0000 7fccc3caa740 1 -- start start 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 Processor -- start 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824d8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824d8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f82296700 con 0x557f824db9a0 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557f823d0160 con 0x557f824cf0f0 2024-09-10T22:01:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f824de5c0 con 0x557f824cfa10 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccc3caa740 10 client.0 _ll_register_callbacks cb 0x557f823e99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824d8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33392/0 (socket says 172.21.15.39:33392) 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824d8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36586/0 (socket says 172.21.15.39:36586) 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccbaffd640 1 -- 172.21.15.39:0/1628900499 learned_addr learned my addr 172.21.15.39:0/1628900499 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.264+0000 7fccba7fc640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824d8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 -- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 msgr2=0x557f824d8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824d8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 -- 172.21.15.39:0/1628900499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 msgr2=0x557f824d8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824d8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 -- 172.21.15.39:0/1628900499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f823fdc90 con 0x557f824cf0f0 2024-09-10T22:01:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccbaffd640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fccac0e3c10 tx=0x7fccac0e9b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2072acf40fa77f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0ac1d0 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fccac0a81d0 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccac0ac390 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fccac0abff0 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccc3caa740 10 client.26516 fetch_fsmap learned FSMap version 33 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557f824e9f80 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac0ac390 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.265+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fccac0acae0 con 0x557f824cf0f0 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 10 client.26516 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 10 client.26516 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 20 client.26516 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f824eb2d0 0x557f824ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 4 client.26516 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f82447df0 con 0x557f824eb2d0 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccba7fc640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f824eb2d0 0x557f824ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fcc9affd640 10 client.26516 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.266+0000 7fccba7fc640 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f824eb2d0 0x557f824ed6c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7ffbbc2ad011794 server_cookie=43a0d02ad70337c0 in_seq=0 out_seq=0 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fcc9affd640 1 -- 172.21.15.39:0/1628900499 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f82447df0 con 0x557f824eb2d0 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fcc9affd640 10 client.26516 handle_command_reply: tid=0 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 client.26516 shutdown 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 msgr2=0x557f824db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fccac0e3c10 tx=0x7fccac0e9b00 comp rx=0 tx=0).stop 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 shutdown_connections 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824d8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824d8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f824eb2d0 0x557f824ed6c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 --2- 172.21.15.39:0/1628900499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824db2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fcc9affd640 0 client.26516 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 >> 172.21.15.39:0/1628900499 conn(0x557f824ccf20 msgr2=0x557f824d2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 shutdown_connections 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 1 -- 172.21.15.39:0/1628900499 wait complete. 2024-09-10T22:01:14.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.267+0000 7fccc3caa740 20 client.26516 trim_cache size 0 max 16384 2024-09-10T22:01:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 Processor -- start 2024-09-10T22:01:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 -- start start 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ae260 con 0x557f824db9a0 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1afdd0 con 0x557f824cf0f0 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccc3caa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ae930 con 0x557f824cfa10 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33400/0 (socket says 172.21.15.39:33400) 2024-09-10T22:01:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36590/0 (socket says 172.21.15.39:36590) 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 -- 172.21.15.39:0/3992890996 learned_addr learned my addr 172.21.15.39:0/3992890996 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccba7fc640 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 -- 172.21.15.39:0/3992890996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 msgr2=0x557f824da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 -- 172.21.15.39:0/3992890996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 msgr2=0x557f824dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbaffd640 1 -- 172.21.15.39:0/3992890996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f824cf800 con 0x557f824cf0f0 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.281+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:14.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccbaffd640 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ac580 tx=0x7fccac0a8720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950c53f7e48a921e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccb17fa640 1 -- 172.21.15.39:0/3992890996 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0b1070 con 0x557f824cf0f0 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccb17fa640 1 -- 172.21.15.39:0/3992890996 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac0e9950 con 0x557f824cf0f0 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccb17fa640 1 -- 172.21.15.39:0/3992890996 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0c6030 con 0x557f824cf0f0 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 -- 172.21.15.39:0/3992890996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 msgr2=0x557f824cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ac580 tx=0x7fccac0a8720 comp rx=0 tx=0).stop 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 -- 172.21.15.39:0/3992890996 shutdown_connections 2024-09-10T22:01:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824db9a0 0x557f824dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824cfa10 0x557f824da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 --2- 172.21.15.39:0/3992890996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824cc760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 -- 172.21.15.39:0/3992890996 >> 172.21.15.39:0/3992890996 conn(0x557f824ccf20 msgr2=0x557f824d9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 -- 172.21.15.39:0/3992890996 shutdown_connections 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.282+0000 7fccc3caa740 1 -- 172.21.15.39:0/3992890996 wait complete. 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 -- start start 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 Processor -- start 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 0x557f82556e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1af6d0 con 0x557f824cfa10 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1af000 con 0x557f824cf0f0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ac240 con 0x557f824db9a0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccc3caa740 10 client.0 _ll_register_callbacks cb 0x7fccb4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.283+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33410/0 (socket says 172.21.15.39:33410) 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36594/0 (socket says 172.21.15.39:36594) 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 -- 172.21.15.39:0/928876821 learned_addr learned my addr 172.21.15.39:0/928876821 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 0x557f82556e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 -- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 msgr2=0x557f82556e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 0x557f82556e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 -- 172.21.15.39:0/928876821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 msgr2=0x557f824ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 -- 172.21.15.39:0/928876821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f82557540 con 0x557f824cf0f0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbb7fe640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 0x557f82556e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccba7fc640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccbaffd640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ac810 tx=0x7fccac000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbad752aa31bff32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fcc9affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0b1040 con 0x557f824cf0f0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fccac0adbb0 con 0x557f824cf0f0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccac0e9950 con 0x557f824cf0f0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fccac0ac650 con 0x557f824cf0f0 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccc3caa740 10 client.26522 fetch_fsmap learned FSMap version 33 2024-09-10T22:01:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.284+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557f82557540 con 0x557f824cf0f0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac0e9950 con 0x557f824cf0f0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fccac0cfbd0 con 0x557f824cf0f0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 10 client.26522 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 10 client.26522 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 20 client.26522 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f82558b10 0x557f8255af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 4 client.26522 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f824438a0 con 0x557f82558b10 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccba7fc640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f82558b10 0x557f8255af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fccba7fc640 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f82558b10 0x557f8255af30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=82011d0f2633643b server_cookie=d217830fc2e07a9e in_seq=0 out_seq=0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.285+0000 7fcc9affd640 10 client.26522 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fcc9affd640 1 -- 172.21.15.39:0/928876821 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f824438a0 con 0x557f82558b10 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fcc9affd640 10 client.26522 handle_command_reply: tid=0 2024-09-10T22:01:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 client.26522 shutdown 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 msgr2=0x557f824ecf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ac810 tx=0x7fccac000f40 comp rx=0 tx=0).stop 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 shutdown_connections 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f824db9a0 0x557f82556e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f824cfa10 0x557f824ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x557f82558b10 0x557f8255af30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 --2- 172.21.15.39:0/928876821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f824cf0f0 0x557f824ecf00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 >> 172.21.15.39:0/928876821 conn(0x557f824ccf20 msgr2=0x557f824da590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fcc9affd640 0 client.26522 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 shutdown_connections 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 1 -- 172.21.15.39:0/928876821 wait complete. 2024-09-10T22:01:14.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.286+0000 7fccc3caa740 20 client.26522 trim_cache size 0 max 16384 2024-09-10T22:01:14.295 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:14.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 msgr2=0x7fcca80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 0x7fcca80b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fccb4004240 tx=0x7fccb40046c0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 msgr2=0x7fccbc199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:14.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fccac00cce0 tx=0x7fccac00a620 comp rx=0 tx=0).stop 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 shutdown_connections 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcca80b52e0 0x7fcca80b77a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccbc10d0e0 0x7fccbc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc104530 0x7fccbc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 --2- 172.21.15.39:0/3886149618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccbc103b30 0x7fccbc199210 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 >> 172.21.15.39:0/3886149618 conn(0x7fccbc0fd700 msgr2=0x7fccbc0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 shutdown_connections 2024-09-10T22:01:14.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:14.287+0000 7fccc18d5640 1 -- 172.21.15.39:0/3886149618 wait complete. 2024-09-10T22:01:14.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:14 smithi039 ceph-mon[30872]: pgmap v528: 97 pgs: 97 active+clean; 382 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 583 op/s 2024-09-10T22:01:14.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:14 smithi173 ceph-mon[35294]: pgmap v528: 97 pgs: 97 active+clean; 382 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 583 op/s 2024-09-10T22:01:15.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:01:15.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:14 smithi070 ceph-mon[34909]: pgmap v528: 97 pgs: 97 active+clean; 382 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 583 op/s 2024-09-10T22:01:15.339 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:15.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:15 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:15.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 -- 172.21.15.39:0/486419147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a41055a0 msgr2=0x7fa9a4105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 --2- 172.21.15.39:0/486419147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a41055a0 0x7fa9a4105a00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa994009900 tx=0x7fa99402a410 comp rx=0 tx=0).stop 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 -- 172.21.15.39:0/486419147 shutdown_connections 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 --2- 172.21.15.39:0/486419147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a4105f40 0x7fa9a410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 --2- 172.21.15.39:0/486419147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a41055a0 0x7fa9a4105a00 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 --2- 172.21.15.39:0/486419147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 0x7fa9a4101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 -- 172.21.15.39:0/486419147 >> 172.21.15.39:0/486419147 conn(0x7fa9a4078140 msgr2=0x7fa9a40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 -- 172.21.15.39:0/486419147 shutdown_connections 2024-09-10T22:01:15.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.798+0000 7fa9ac287640 1 -- 172.21.15.39:0/486419147 wait complete. 2024-09-10T22:01:15.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 Processor -- start 2024-09-10T22:01:15.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 -- start start 2024-09-10T22:01:15.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 0x7fa9a4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 0x7fa9a4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a4112d80 con 0x7fa9a4105f40 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a4112c00 con 0x7fa9a41055a0 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.799+0000 7fa9ac287640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a4112f00 con 0x7fa9a4101250 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 0x7fa9a4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36618/0 (socket says 172.21.15.39:36618) 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa023640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 0x7fa9a4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 0x7fa9a4199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33416/0 (socket says 172.21.15.39:33416) 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 -- 172.21.15.39:0/3821570817 learned_addr learned my addr 172.21.15.39:0/3821570817 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 -- 172.21.15.39:0/3821570817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 msgr2=0x7fa9a4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 0x7fa9a4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 -- 172.21.15.39:0/3821570817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 msgr2=0x7fa9a4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 0x7fa9a4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 -- 172.21.15.39:0/3821570817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a419f3c0 con 0x7fa9a4105f40 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9aa824640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00ea60 tx=0x7fa99c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa99b7fe640 1 -- 172.21.15.39:0/3821570817 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00ce40 con 0x7fa9a4105f40 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa99b7fe640 1 -- 172.21.15.39:0/3821570817 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa99c005020 con 0x7fa9a4105f40 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa99b7fe640 1 -- 172.21.15.39:0/3821570817 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c010670 con 0x7fa9a4105f40 2024-09-10T22:01:15.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a419f6b0 con 0x7fa9a4105f40 2024-09-10T22:01:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.800+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a41a5d70 con 0x7fa9a4105f40 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.803+0000 7fa9ae65c740 1 Processor -- start 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.803+0000 7fa99b7fe640 1 -- 172.21.15.39:0/3821570817 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa99c0054b0 con 0x7fa9a4105f40 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.803+0000 7fa9ae65c740 1 -- start start 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e11170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564323d78ea0 con 0x564323e0ed80 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564323d682d0 con 0x564323e024d0 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564323d6c0e0 con 0x564323e02df0 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e11170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e11170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36622/0 (socket says 172.21.15.39:36622) 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9a9822640 1 -- 172.21.15.39:0/2206817564 learned_addr learned my addr 172.21.15.39:0/2206817564 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 -- 172.21.15.39:0/2206817564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 msgr2=0x564323e028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 -- 172.21.15.39:0/2206817564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 msgr2=0x564323e11170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e11170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.804+0000 7fa9aa023640 1 -- 172.21.15.39:0/2206817564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564323ac6650 con 0x564323e02df0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa99b7fe640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 0x7fa9900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0005fd0 tx=0x7fa9a00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5400e1203b7611a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa9a9822640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 0x7fa9900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa99b7fe640 1 -- 172.21.15.39:0/3821570817 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa99c0e5fd0 con 0x7fa9a4105f40 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa998de6640 1 -- 172.21.15.39:0/2206817564 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a001c480 con 0x564323e02df0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa998de6640 1 -- 172.21.15.39:0/2206817564 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a001cad0 con 0x564323e02df0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.805+0000 7fa998de6640 1 -- 172.21.15.39:0/2206817564 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0011ad0 con 0x564323e02df0 2024-09-10T22:01:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2206817564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 msgr2=0x564323e0e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0005fd0 tx=0x7fa9a00107a0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9a9822640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 0x7fa9900b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa994005c40 tx=0x7fa994005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2206817564 shutdown_connections 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e11170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0e840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2206817564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2206817564 >> 172.21.15.39:0/2206817564 conn(0x564323e00300 msgr2=0x564323e014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2206817564 shutdown_connections 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2206817564 wait complete. 2024-09-10T22:01:15.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 -- start start 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.806+0000 7fa9ae65c740 1 Processor -- start 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e0c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564323bc9700 con 0x564323e0ed80 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564323d03160 con 0x564323e024d0 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564323e11a00 con 0x564323e02df0 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9ae65c740 10 client.0 _ll_register_callbacks cb 0x564323d1c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa824640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e0c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33440/0 (socket says 172.21.15.39:33440) 2024-09-10T22:01:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 -- 172.21.15.39:0/2063018215 learned_addr learned my addr 172.21.15.39:0/2063018215 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:60994/0 (socket says 172.21.15.39:60994) 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 -- 172.21.15.39:0/2063018215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 msgr2=0x564323e0baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 -- 172.21.15.39:0/2063018215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 msgr2=0x564323e0c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e0c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 -- 172.21.15.39:0/2063018215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564323d30c90 con 0x564323e024d0 2024-09-10T22:01:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa824640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e0c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0005d00 tx=0x7fa9a001ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54acfe1d800bea7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.807+0000 7fa98dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a002b060 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a001c480 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a001cad0 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa9a0011440 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 10 client.26534 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564323e1d310 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a001cad0 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa9a00313d0 con 0x564323e024d0 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 10 client.26534 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:15.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 10 client.26534 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 20 client.26534 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e1e710 0x564323e20b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 4 client.26534 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.808+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564323d7adf0 con 0x564323e1e710 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.809+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e1e710 0x564323e20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.809+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e1e710 0x564323e20b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d244fa6114136b36 server_cookie=5ef7a023aa881e6b in_seq=0 out_seq=0 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.809+0000 7fa98dffb640 10 client.26534 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa98dffb640 1 -- 172.21.15.39:0/2063018215 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564323d7adf0 con 0x564323e1e710 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa98dffb640 10 client.26534 handle_command_reply: tid=0 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 client.26534 shutdown 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 msgr2=0x564323e0e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0005d00 tx=0x7fa9a001ceb0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 shutdown_connections 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e1e710 0x564323e20b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e0ed80 0x564323e0c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e02df0 0x564323e0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa98dffb640 0 client.26534 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2063018215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e024d0 0x564323e0e650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 >> 172.21.15.39:0/2063018215 conn(0x564323e00300 msgr2=0x564323e05e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 shutdown_connections 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2063018215 wait complete. 2024-09-10T22:01:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.810+0000 7fa9ae65c740 20 client.26534 trim_cache size 0 max 16384 2024-09-10T22:01:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.823+0000 7fa9ae65c740 1 Processor -- start 2024-09-10T22:01:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.823+0000 7fa9ae65c740 1 -- start start 2024-09-10T22:01:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e024d0 0x564323e1ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e0ed80 0x564323e17070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41ae440 con 0x564323e02df0 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41affe0 con 0x564323e0ed80 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41aeb40 con 0x564323e024d0 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36642/0 (socket says 172.21.15.39:36642) 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 -- 172.21.15.39:0/1610741747 learned_addr learned my addr 172.21.15.39:0/1610741747 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9aa824640 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e0ed80 0x564323e17070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9aa023640 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e024d0 0x564323e1ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 -- 172.21.15.39:0/1610741747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e024d0 msgr2=0x564323e1ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e024d0 0x564323e1ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 -- 172.21.15.39:0/1610741747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e0ed80 msgr2=0x564323e17070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e0ed80 0x564323e17070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 -- 172.21.15.39:0/1610741747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564323e00fe0 con 0x564323e02df0 2024-09-10T22:01:15.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa9a9822640 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa99402a930 tx=0x7fa994009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378cd5171fc119ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.824+0000 7fa98ffff640 1 -- 172.21.15.39:0/1610741747 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994059070 con 0x564323e02df0 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa98ffff640 1 -- 172.21.15.39:0/1610741747 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa994004400 con 0x564323e02df0 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa98ffff640 1 -- 172.21.15.39:0/1610741747 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994035040 con 0x564323e02df0 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 -- 172.21.15.39:0/1610741747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 msgr2=0x564323dff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa99402a930 tx=0x7fa994009260 comp rx=0 tx=0).stop 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 -- 172.21.15.39:0/1610741747 shutdown_connections 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e0ed80 0x564323e17070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e02df0 0x564323dff310 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/1610741747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e024d0 0x564323e1ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 -- 172.21.15.39:0/1610741747 >> 172.21.15.39:0/1610741747 conn(0x564323e00300 msgr2=0x564323dfec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 -- 172.21.15.39:0/1610741747 shutdown_connections 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.825+0000 7fa9ae65c740 1 -- 172.21.15.39:0/1610741747 wait complete. 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 -- start start 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 Processor -- start 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e02df0 0x564323e250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e0ed80 0x564323e25630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41af8e0 con 0x564323e024d0 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41af210 con 0x564323e02df0 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a41ac420 con 0x564323e0ed80 2024-09-10T22:01:15.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9ae65c740 10 client.0 _ll_register_callbacks cb 0x7fa994009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36654/0 (socket says 172.21.15.39:36654) 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 -- 172.21.15.39:0/2584958390 learned_addr learned my addr 172.21.15.39:0/2584958390 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e02df0 0x564323e250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa824640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e0ed80 0x564323e25630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 -- 172.21.15.39:0/2584958390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e0ed80 msgr2=0x564323e25630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e0ed80 0x564323e25630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 -- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e02df0 msgr2=0x564323e250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e02df0 0x564323e250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.826+0000 7fa9aa023640 1 -- 172.21.15.39:0/2584958390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564323e25ba0 con 0x564323e024d0 2024-09-10T22:01:15.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9aa023640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00107e0 tx=0x7fa9a0005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d4bc0679b7695c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0036070 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a0031a10 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa994004400 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa9a0041050 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 10 client.16920 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564323e900e0 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa994004400 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa9a0005040 con 0x564323e024d0 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 10 client.16920 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:15.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 10 client.16920 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.827+0000 7fa9ae65c740 20 client.16920 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e90860 0x564323e92c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 4 client.16920 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564323d768a0 con 0x564323e90860 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e90860 0x564323e92c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa98dffb640 10 client.16920 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9a9822640 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e90860 0x564323e92c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe36b2e2795d73de server_cookie=626c4694db6c11a0 in_seq=0 out_seq=0 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa98dffb640 1 -- 172.21.15.39:0/2584958390 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564323d768a0 con 0x564323e90860 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa98dffb640 10 client.16920 handle_command_reply: tid=0 2024-09-10T22:01:15.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 client.16920 shutdown 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 msgr2=0x564323e265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00107e0 tx=0x7fa9a0005a70 comp rx=0 tx=0).stop 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 shutdown_connections 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x564323e90860 0x564323e92c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.828+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564323e0ed80 0x564323e25630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564323e02df0 0x564323e250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 1 --2- 172.21.15.39:0/2584958390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564323e024d0 0x564323e265d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 >> 172.21.15.39:0/2584958390 conn(0x564323e00300 msgr2=0x564323e0d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa98dffb640 0 client.16920 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:01:15.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 shutdown_connections 2024-09-10T22:01:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 1 -- 172.21.15.39:0/2584958390 wait complete. 2024-09-10T22:01:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ae65c740 20 client.16920 trim_cache size 0 max 16384 2024-09-10T22:01:15.837 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:15.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 msgr2=0x7fa9900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 0x7fa9900b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa994005c40 tx=0x7fa994005b50 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 msgr2=0x7fa9a419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00ea60 tx=0x7fa99c00ef20 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 shutdown_connections 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa9900b5360 0x7fa9900b7820 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a4105f40 0x7fa9a419ebf0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9a41055a0 0x7fa9a4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 --2- 172.21.15.39:0/3821570817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a4101250 0x7fa9a4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.829+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 >> 172.21.15.39:0/3821570817 conn(0x7fa9a4078140 msgr2=0x7fa9a40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.830+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 shutdown_connections 2024-09-10T22:01:15.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:15.830+0000 7fa9ac287640 1 -- 172.21.15.39:0/3821570817 wait complete. 2024-09-10T22:01:15.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:15 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:16.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:15 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:16.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:01:16.910 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:16.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:16 smithi039 ceph-mon[30872]: pgmap v529: 97 pgs: 97 active+clean; 375 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 523 op/s 2024-09-10T22:01:16.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:16 smithi173 ceph-mon[35294]: pgmap v529: 97 pgs: 97 active+clean; 375 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 523 op/s 2024-09-10T22:01:17.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:16 smithi070 ceph-mon[34909]: pgmap v529: 97 pgs: 97 active+clean; 375 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 523 op/s 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/2467109071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 msgr2=0x7f8e9810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/2467109071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e9810cab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009900 tx=0x7f8e8002a410 comp rx=0 tx=0).stop 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/2467109071 shutdown_connections 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/2467109071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9810d100 0x7f8e9810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/2467109071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e9810cab0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/2467109071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e98103ca0 0x7f8e98104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/2467109071 >> 172.21.15.39:0/2467109071 conn(0x7f8e980fd700 msgr2=0x7f8e980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/2467109071 shutdown_connections 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.388+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/2467109071 wait complete. 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 Processor -- start 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 -- start start 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e98103ca0 0x7f8e981992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e9810d100 0x7f8e9819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98112d70 con 0x7f8e981045c0 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98112bf0 con 0x7f8e9810d100 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e9e9c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98112ef0 con 0x7f8e98103ca0 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.389+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36664/0 (socket says 172.21.15.39:36664) 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 -- 172.21.15.39:0/845161425 learned_addr learned my addr 172.21.15.39:0/845161425 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e97fff640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e98103ca0 0x7f8e981992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e9810d100 0x7f8e9819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 -- 172.21.15.39:0/845161425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e98103ca0 msgr2=0x7f8e981992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e98103ca0 0x7f8e981992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 -- 172.21.15.39:0/845161425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e9810d100 msgr2=0x7f8e9819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e9810d100 0x7f8e9819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 -- 172.21.15.39:0/845161425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9819f390 con 0x7f8e981045c0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e977fe640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8e80032fd0 tx=0x7f8e80031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e957fa640 1 -- 172.21.15.39:0/845161425 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8003f030 con 0x7f8e981045c0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9819f620 con 0x7f8e981045c0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e957fa640 1 -- 172.21.15.39:0/845161425 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e80004490 con 0x7f8e981045c0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e957fa640 1 -- 172.21.15.39:0/845161425 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80035070 con 0x7f8e981045c0 2024-09-10T22:01:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.390+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e981a5d40 con 0x7f8e981045c0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 Processor -- start 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 -- start start 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8e957fa640 1 -- 172.21.15.39:0/845161425 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8e8003ba30 con 0x7f8e981045c0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661064840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x556661067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556660fceea0 con 0x556661058df0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556660fbe2d0 con 0x5566610584d0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.393+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556660fc20e0 con 0x556661064d80 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33482/0 (socket says 172.21.15.39:33482) 2024-09-10T22:01:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 -- 172.21.15.39:0/949248342 learned_addr learned my addr 172.21.15.39:0/949248342 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 -- 172.21.15.39:0/949248342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 msgr2=0x556661067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x556661067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 -- 172.21.15.39:0/949248342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 msgr2=0x556661064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661064840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 -- 172.21.15.39:0/949248342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556660d1c650 con 0x5566610584d0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e90010370 tx=0x7f8e90010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3603fb29aa4ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e957fa640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e8e7fc640 1 -- 172.21.15.39:0/949248342 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90016070 con 0x5566610584d0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e8e7fc640 1 -- 172.21.15.39:0/949248342 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e90004d20 con 0x5566610584d0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e8e7fc640 1 -- 172.21.15.39:0/949248342 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90005420 con 0x5566610584d0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e97fff640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.394+0000 7f8e957fa640 1 -- 172.21.15.39:0/845161425 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e80106130 con 0x7f8e981045c0 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- 172.21.15.39:0/949248342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 msgr2=0x5566610588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8e97fff640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 0x7f8e840b77a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5566610571e0 tx=0x7f8e88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e90010370 tx=0x7f8e90010830 comp rx=0 tx=0).stop 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- 172.21.15.39:0/949248342 shutdown_connections 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x556661067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/949248342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610588b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- 172.21.15.39:0/949248342 >> 172.21.15.39:0/949248342 conn(0x556661056300 msgr2=0x5566610574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- 172.21.15.39:0/949248342 shutdown_connections 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- 172.21.15.39:0/949248342 wait complete. 2024-09-10T22:01:17.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.395+0000 7f8ea0d99740 1 -- start start 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 Processor -- start 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x5566610623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556660e1f700 con 0x556661058df0 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556660f59160 con 0x5566610584d0 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556661067a00 con 0x556661064d80 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8ea0d99740 10 client.0 _ll_register_callbacks cb 0x556660f729e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33498/0 (socket says 172.21.15.39:33498) 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36690/0 (socket says 172.21.15.39:36690) 2024-09-10T22:01:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e97fff640 1 -- 172.21.15.39:0/1693936075 learned_addr learned my addr 172.21.15.39:0/1693936075 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x5566610623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e977fe640 1 -- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 msgr2=0x5566610623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.396+0000 7f8e977fe640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x5566610623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e977fe640 1 -- 172.21.15.39:0/1693936075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 msgr2=0x5566610647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e977fe640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e977fe640 1 -- 172.21.15.39:0/1693936075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556660f86c90 con 0x556661058df0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e97fff640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e977fe640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8e80103c90 tx=0x7f8e80003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911192c56d31ddf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80049040 con 0x556661058df0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e800ccc10 con 0x556661058df0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e90004d20 con 0x556661058df0 2024-09-10T22:01:17.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e800b7070 con 0x556661058df0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8ea0d99740 10 client.16932 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5566610734f0 con 0x556661058df0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e90004d20 con 0x556661058df0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.397+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8e800d5a00 con 0x556661058df0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 10 client.16932 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 10 client.16932 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 20 client.16932 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610748e0 0x556661076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 4 client.16932 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556660fd0df0 con 0x5566610748e0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8e97fff640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610748e0 0x556661076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8e97fff640 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610748e0 0x556661076cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a7219a26819dcd7 server_cookie=a70cabcd459648cc in_seq=0 out_seq=0 2024-09-10T22:01:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.398+0000 7f8e777fe640 10 client.16932 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:01:17.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8e777fe640 1 -- 172.21.15.39:0/1693936075 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556660fd0df0 con 0x5566610748e0 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8e777fe640 10 client.16932 handle_command_reply: tid=0 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 client.16932 shutdown 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 msgr2=0x556661061c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8e80103c90 tx=0x7f8e80003f60 comp rx=0 tx=0).stop 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 shutdown_connections 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610748e0 0x556661076cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8e777fe640 0 client.16932 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x5566610623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661058df0 0x556661061c30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/1693936075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x5566610647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 >> 172.21.15.39:0/1693936075 conn(0x556661056300 msgr2=0x55666105bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.399+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 shutdown_connections 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.400+0000 7f8ea0d99740 1 -- 172.21.15.39:0/1693936075 wait complete. 2024-09-10T22:01:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.400+0000 7f8ea0d99740 20 client.16932 trim_cache size 0 max 16384 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 Processor -- start 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 -- start start 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 0x556661055310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x55666105ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981ae370 con 0x5566610584d0 2024-09-10T22:01:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981aff10 con 0x556661058df0 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981aea70 con 0x556661064d80 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36700/0 (socket says 172.21.15.39:36700) 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e97fff640 1 -- 172.21.15.39:0/3375461544 learned_addr learned my addr 172.21.15.39:0/3375461544 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 0x556661055310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e9cf61640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x55666105ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 -- 172.21.15.39:0/3375461544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 msgr2=0x55666105ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x55666105ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 -- 172.21.15.39:0/3375461544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 msgr2=0x556661051480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 -- 172.21.15.39:0/3375461544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556661062730 con 0x556661058df0 2024-09-10T22:01:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e97fff640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:17.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.414+0000 7f8e977fe640 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 0x556661055310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e800c8f80 tx=0x7f8e8002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=193373ea9d311e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8e8dffb640 1 -- 172.21.15.39:0/3375461544 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80049070 con 0x556661058df0 2024-09-10T22:01:17.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8e8dffb640 1 -- 172.21.15.39:0/3375461544 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e800d11c0 con 0x556661058df0 2024-09-10T22:01:17.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8e8dffb640 1 -- 172.21.15.39:0/3375461544 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e800ccc10 con 0x556661058df0 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 -- 172.21.15.39:0/3375461544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 msgr2=0x556661055310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 0x556661055310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e800c8f80 tx=0x7f8e8002a410 comp rx=0 tx=0).stop 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 -- 172.21.15.39:0/3375461544 shutdown_connections 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661064d80 0x55666105ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556661058df0 0x556661055310 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/3375461544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566610584d0 0x556661051480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 -- 172.21.15.39:0/3375461544 >> 172.21.15.39:0/3375461544 conn(0x556661056300 msgr2=0x556661054c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 -- 172.21.15.39:0/3375461544 shutdown_connections 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.415+0000 7f8ea0d99740 1 -- 172.21.15.39:0/3375461544 wait complete. 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 -- start start 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 Processor -- start 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x55666106ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661058df0 0x55666106d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 0x556661067c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981af810 con 0x556661064d80 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981af140 con 0x5566610584d0 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981ac350 con 0x556661058df0 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8ea0d99740 10 client.0 _ll_register_callbacks cb 0x7f8e8003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.416+0000 7f8e9cf61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 0x556661067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x55666106ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e9cf61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 0x556661067c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36710/0 (socket says 172.21.15.39:36710) 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e9cf61640 1 -- 172.21.15.39:0/953054233 learned_addr learned my addr 172.21.15.39:0/953054233 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e977fe640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661058df0 0x55666106d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 -- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661058df0 msgr2=0x55666106d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661058df0 0x55666106d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 -- 172.21.15.39:0/953054233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 msgr2=0x556661067c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 0x556661067c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 -- 172.21.15.39:0/953054233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556661068370 con 0x5566610584d0 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e97fff640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x55666106ceb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009700 tx=0x7f8e880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6324581a42df6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e777fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:17.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88005020 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556660fcc8a0 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.417+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e88018030 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e880051c0 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 10 client.26558 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5566610e20f0 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556660fcc8a0 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8e8801f4f0 con 0x5566610584d0 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 10 client.26558 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 10 client.26558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 20 client.26558 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610e2820 0x5566610e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:17.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 4 client.26558 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556660fc9cd0 con 0x5566610e2820 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.418+0000 7f8e977fe640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610e2820 0x5566610e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8e977fe640 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610e2820 0x5566610e4c40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bff2b5ce2f340b46 server_cookie=cdce46b20bd0e90c in_seq=0 out_seq=0 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8e777fe640 10 client.26558 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8e777fe640 1 -- 172.21.15.39:0/953054233 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556660fc9cd0 con 0x5566610e2820 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8e777fe640 10 client.26558 handle_command_reply: tid=0 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 client.26558 shutdown 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 msgr2=0x55666106ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x55666106ceb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009700 tx=0x7f8e880046c0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 shutdown_connections 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5566610e2820 0x5566610e4c40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556661064d80 0x556661067c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556661058df0 0x55666106d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 --2- 172.21.15.39:0/953054233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566610584d0 0x55666106ceb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 >> 172.21.15.39:0/953054233 conn(0x556661056300 msgr2=0x556661063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8e777fe640 0 client.26558 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 shutdown_connections 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 1 -- 172.21.15.39:0/953054233 wait complete. 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.419+0000 7f8ea0d99740 20 client.26558 trim_cache size 0 max 16384 2024-09-10T22:01:17.427 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 msgr2=0x7f8e840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 0x7f8e840b77a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5566610571e0 tx=0x7f8e88005f90 comp rx=0 tx=0).stop 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 msgr2=0x7f8e98199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8e80032fd0 tx=0x7f8e80031a20 comp rx=0 tx=0).stop 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 shutdown_connections 2024-09-10T22:01:17.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e9810d100 0x7f8e9819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e981045c0 0x7f8e98199820 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 --2- 172.21.15.39:0/845161425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e98103ca0 0x7f8e981992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 >> 172.21.15.39:0/845161425 conn(0x7f8e980fd700 msgr2=0x7f8e980fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 shutdown_connections 2024-09-10T22:01:17.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:17.420+0000 7f8e9e9c4640 1 -- 172.21.15.39:0/845161425 wait complete. 2024-09-10T22:01:18.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:01:18.568 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:18.984 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:18 smithi039 ceph-mon[30872]: pgmap v530: 97 pgs: 97 active+clean; 362 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 583 op/s 2024-09-10T22:01:18.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:18 smithi173 ceph-mon[35294]: pgmap v530: 97 pgs: 97 active+clean; 362 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 583 op/s 2024-09-10T22:01:19.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 -- 172.21.15.39:0/3916085386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 msgr2=0x7fc8841031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3916085386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc8841031a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc874009900 tx=0x7fc87402a410 comp rx=0 tx=0).stop 2024-09-10T22:01:19.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 -- 172.21.15.39:0/3916085386 shutdown_connections 2024-09-10T22:01:19.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3916085386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc884109150 0x7fc88410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3916085386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 0x7fc884108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3916085386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc8841031a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 -- 172.21.15.39:0/3916085386 >> 172.21.15.39:0/3916085386 conn(0x7fc8840fe830 msgr2=0x7fc884100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 -- 172.21.15.39:0/3916085386 shutdown_connections 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.071+0000 7fc88a94b640 1 -- 172.21.15.39:0/3916085386 wait complete. 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.072+0000 7fc88a94b640 1 Processor -- start 2024-09-10T22:01:19.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.072+0000 7fc88a94b640 1 -- start start 2024-09-10T22:01:19.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 0x7fc884199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc884109150 0x7fc88419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc884112e10 con 0x7fc884102dc0 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc884112c90 con 0x7fc8841087d0 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc88a94b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc884112f90 con 0x7fc884109150 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36726/0 (socket says 172.21.15.39:36726) 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 -- 172.21.15.39:0/3741143963 learned_addr learned my addr 172.21.15.39:0/3741143963 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc8837fe640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 0x7fc884199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 -- 172.21.15.39:0/3741143963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc884109150 msgr2=0x7fc88419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc884109150 0x7fc88419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 -- 172.21.15.39:0/3741143963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 msgr2=0x7fc884199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 0x7fc884199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 -- 172.21.15.39:0/3741143963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88419f3b0 con 0x7fc884102dc0 2024-09-10T22:01:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.073+0000 7fc883fff640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc874005940 tx=0x7fc8740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.074+0000 7fc8817fa640 1 -- 172.21.15.39:0/3741143963 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87403f030 con 0x7fc884102dc0 2024-09-10T22:01:19.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.074+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88419f640 con 0x7fc884102dc0 2024-09-10T22:01:19.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.074+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8841a5d60 con 0x7fc884102dc0 2024-09-10T22:01:19.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.074+0000 7fc8817fa640 1 -- 172.21.15.39:0/3741143963 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc874003cb0 con 0x7fc884102dc0 2024-09-10T22:01:19.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.074+0000 7fc8817fa640 1 -- 172.21.15.39:0/3741143963 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874035070 con 0x7fc884102dc0 2024-09-10T22:01:19.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.076+0000 7fc88cd20740 1 Processor -- start 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.076+0000 7fc88cd20740 1 -- start start 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb24df0 0x55dbcdb30840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb33170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dbcda9aea0 con 0x55dbcdb30d80 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dbcda8a2d0 con 0x55dbcdb244d0 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc88cd20740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dbcda8e0e0 con 0x55dbcdb24df0 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc8817fa640 1 -- 172.21.15.39:0/3741143963 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc87403b460 con 0x7fc884102dc0 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb33170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33536/0 (socket says 172.21.15.39:33536) 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 -- 172.21.15.39:0/2371861874 learned_addr learned my addr 172.21.15.39:0/2371861874 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:19.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc883fff640 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb24df0 0x55dbcdb30840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 -- 172.21.15.39:0/2371861874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb24df0 msgr2=0x55dbcdb30840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb24df0 0x55dbcdb30840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 -- 172.21.15.39:0/2371861874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 msgr2=0x55dbcdb33170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb33170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 -- 172.21.15.39:0/2371861874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbcd7e8650 con 0x55dbcdb244d0 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.077+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009d00 tx=0x7fc87c00b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976e114a98ac85e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc86a7fc640 1 -- 172.21.15.39:0/2371861874 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00bd40 con 0x55dbcdb244d0 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc86a7fc640 1 -- 172.21.15.39:0/2371861874 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc87c017070 con 0x55dbcdb244d0 2024-09-10T22:01:19.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc86a7fc640 1 -- 172.21.15.39:0/2371861874 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0115f0 con 0x55dbcdb244d0 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc8817fa640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 0x7fc86c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 -- 172.21.15.39:0/2371861874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 msgr2=0x55dbcdb248b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009d00 tx=0x7fc87c00b420 comp rx=0 tx=0).stop 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc883fff640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 0x7fc86c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 -- 172.21.15.39:0/2371861874 shutdown_connections 2024-09-10T22:01:19.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb33170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb24df0 0x55dbcdb30840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2371861874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb248b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 -- 172.21.15.39:0/2371861874 >> 172.21.15.39:0/2371861874 conn(0x55dbcdb22300 msgr2=0x55dbcdb234a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc88cd20740 1 -- 172.21.15.39:0/2371861874 shutdown_connections 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.078+0000 7fc8817fa640 1 -- 172.21.15.39:0/3741143963 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc874106570 con 0x7fc884102dc0 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 -- 172.21.15.39:0/2371861874 wait complete. 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc883fff640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 0x7fc86c0b7820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8740cc9e0 tx=0x7fc8740b42e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 -- start start 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 Processor -- start 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb244d0 0x55dbcdb35030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dbcd8eb700 con 0x55dbcdb30d80 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dbcda25160 con 0x55dbcdb24df0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.079+0000 7fc88cd20740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dbcdb33a00 con 0x55dbcdb244d0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc88cd20740 10 client.0 _ll_register_callbacks cb 0x55dbcda3e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc888ee8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:33552/0 (socket says 172.21.15.39:33552) 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 -- 172.21.15.39:0/2136047580 learned_addr learned my addr 172.21.15.39:0/2136047580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb244d0 0x55dbcdb35030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 -- 172.21.15.39:0/2136047580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb244d0 msgr2=0x55dbcdb35030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb244d0 0x55dbcdb35030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 -- 172.21.15.39:0/2136047580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 msgr2=0x55dbcdb3a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 -- 172.21.15.39:0/2136047580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbcda52c90 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8837fe640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bfc0 tx=0x7fc8780118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc184e2a0f2fffb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8637fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878004020 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc87c017070 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.080+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8780041c0 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc8780043c0 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 10 client.26570 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dbcdb437b0 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc87c017070 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc878003a00 con 0x55dbcdb24df0 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 10 client.26570 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:19.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 10 client.26570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 20 client.26570 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdb44d30 0x55dbcdb47150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 4 client.26570 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbcda9cdf0 con 0x55dbcdb44d30 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.081+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdb44d30 0x55dbcdb47150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.082+0000 7fc888ee8640 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdb44d30 0x55dbcdb47150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9b620af2162b10a server_cookie=894a54353895ceb0 in_seq=0 out_seq=0 2024-09-10T22:01:19.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.082+0000 7fc8637fe640 10 client.26570 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.083+0000 7fc8637fe640 1 -- 172.21.15.39:0/2136047580 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbcda9cdf0 con 0x55dbcdb44d30 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.083+0000 7fc8637fe640 10 client.26570 handle_command_reply: tid=0 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.083+0000 7fc88cd20740 1 client.26570 shutdown 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 msgr2=0x55dbcdb355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bfc0 tx=0x7fc8780118d0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 shutdown_connections 2024-09-10T22:01:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdb44d30 0x55dbcdb47150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb355d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 --2- 172.21.15.39:0/2136047580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb244d0 0x55dbcdb35030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 >> 172.21.15.39:0/2136047580 conn(0x55dbcdb22300 msgr2=0x55dbcdb27e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc8637fe640 0 client.26570 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 shutdown_connections 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 1 -- 172.21.15.39:0/2136047580 wait complete. 2024-09-10T22:01:19.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.084+0000 7fc88cd20740 20 client.26570 trim_cache size 0 max 16384 2024-09-10T22:01:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 Processor -- start 2024-09-10T22:01:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 -- start start 2024-09-10T22:01:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb23210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000e420 con 0x55dbcdb24df0 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000ffc0 con 0x55dbcdb244d0 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc88cd20740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000eb20 con 0x55dbcdb30d80 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36758/0 (socket says 172.21.15.39:36758) 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc8837fe640 1 -- 172.21.15.39:0/1236394776 learned_addr learned my addr 172.21.15.39:0/1236394776 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.097+0000 7fc888ee8640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc888ee8640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb23210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 -- 172.21.15.39:0/1236394776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 msgr2=0x55dbcdb23210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb23210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 -- 172.21.15.39:0/1236394776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 msgr2=0x55dbcdb343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 -- 172.21.15.39:0/1236394776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbcdb30360 con 0x55dbcdb24df0 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc888ee8640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb23210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc8837fe640 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bb10 tx=0x7fc878011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04de4d6f2a13f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc869ffb640 1 -- 172.21.15.39:0/1236394776 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878029070 con 0x55dbcdb24df0 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc869ffb640 1 -- 172.21.15.39:0/1236394776 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc878003aa0 con 0x55dbcdb24df0 2024-09-10T22:01:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.098+0000 7fc869ffb640 1 -- 172.21.15.39:0/1236394776 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780107c0 con 0x55dbcdb24df0 2024-09-10T22:01:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- 172.21.15.39:0/1236394776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 msgr2=0x55dbcdb3a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bb10 tx=0x7fc878011dd0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- 172.21.15.39:0/1236394776 shutdown_connections 2024-09-10T22:01:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb23210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3a560 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 --2- 172.21.15.39:0/1236394776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb244d0 0x55dbcdb343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- 172.21.15.39:0/1236394776 >> 172.21.15.39:0/1236394776 conn(0x55dbcdb22300 msgr2=0x55dbcdb33ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- 172.21.15.39:0/1236394776 shutdown_connections 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- 172.21.15.39:0/1236394776 wait complete. 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.099+0000 7fc88cd20740 1 -- start start 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 Processor -- start 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 0x55dbcdb41250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000f8c0 con 0x55dbcdb244d0 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000f1f0 con 0x55dbcdb24df0 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000c400 con 0x55dbcdb30d80 2024-09-10T22:01:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc88cd20740 10 client.0 _ll_register_callbacks cb 0x7fc87800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc888ee8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 0x55dbcdb41250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc888ee8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 0x55dbcdb41250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36760/0 (socket says 172.21.15.39:36760) 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc888ee8640 1 -- 172.21.15.39:0/3845066646 learned_addr learned my addr 172.21.15.39:0/3845066646 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc888ee8640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 -- 172.21.15.39:0/3845066646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 msgr2=0x55dbcdb3ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 -- 172.21.15.39:0/3845066646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 msgr2=0x55dbcdb41250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 0x55dbcdb41250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc8837fe640 1 -- 172.21.15.39:0/3845066646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbcdb3d3a0 con 0x55dbcdb24df0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.100+0000 7fc888ee8640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8837fe640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3c770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc878011910 tx=0x7fc87800b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afe0ce14e08819e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87803b060 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc878003aa0 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc8780035f0 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc878029030 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc88cd20740 10 client.26576 fetch_fsmap learned FSMap version 34 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dbcdbb1a70 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc878003aa0 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.101+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc8780365d0 con 0x55dbcdb24df0 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 10 client.26576 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 10 client.26576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 20 client.26576 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdbb21c0 0x55dbcdbb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 4 client.26576 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dbcda988a0 con 0x55dbcdbb21c0 2024-09-10T22:01:19.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc888ee8640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdbb21c0 0x55dbcdbb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:19.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc8637fe640 10 client.26576 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:19.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.102+0000 7fc888ee8640 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdbb21c0 0x55dbcdbb45e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316234ab07577062 server_cookie=5cb79ab5c13f4050 in_seq=0 out_seq=0 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc8637fe640 1 -- 172.21.15.39:0/3845066646 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dbcda988a0 con 0x55dbcdbb21c0 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc8637fe640 10 client.26576 handle_command_reply: tid=0 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 client.26576 shutdown 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 msgr2=0x55dbcdb3c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3c770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc878011910 tx=0x7fc87800b7a0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 shutdown_connections 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55dbcdbb21c0 0x55dbcdbb45e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dbcdb30d80 0x55dbcdb3ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dbcdb24df0 0x55dbcdb3c770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 --2- 172.21.15.39:0/3845066646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbcdb244d0 0x55dbcdb41250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc8637fe640 0 client.26576 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 >> 172.21.15.39:0/3845066646 conn(0x55dbcdb22300 msgr2=0x55dbcdb23210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 shutdown_connections 2024-09-10T22:01:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 1 -- 172.21.15.39:0/3845066646 wait complete. 2024-09-10T22:01:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.104+0000 7fc88cd20740 20 client.26576 trim_cache size 0 max 16384 2024-09-10T22:01:19.110 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 msgr2=0x7fc86c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 0x7fc86c0b7820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8740cc9e0 tx=0x7fc8740b42e0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 msgr2=0x7fc884199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc874005940 tx=0x7fc8740042f0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 shutdown_connections 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc86c0b5360 0x7fc86c0b7820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc884109150 0x7fc88419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8841087d0 0x7fc884199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 --2- 172.21.15.39:0/3741143963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc884102dc0 0x7fc884199300 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 >> 172.21.15.39:0/3741143963 conn(0x7fc8840fe830 msgr2=0x7fc884100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 shutdown_connections 2024-09-10T22:01:19.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:19.105+0000 7fc88a94b640 1 -- 172.21.15.39:0/3741143963 wait complete. 2024-09-10T22:01:19.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:18 smithi070 ceph-mon[34909]: pgmap v530: 97 pgs: 97 active+clean; 362 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 583 op/s 2024-09-10T22:01:20.943 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:01:20.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:01:20.967 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:20 smithi039 ceph-mon[30872]: pgmap v531: 97 pgs: 97 active+clean; 351 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 665 op/s 2024-09-10T22:01:20.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:20 smithi173 ceph-mon[35294]: pgmap v531: 97 pgs: 97 active+clean; 351 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 665 op/s 2024-09-10T22:01:21.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:20 smithi070 ceph-mon[34909]: pgmap v531: 97 pgs: 97 active+clean; 351 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 665 op/s 2024-09-10T22:01:21.209 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.469+0000 7fd6f4964640 1 -- 172.21.15.39:0/2932986649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0102980 msgr2=0x7fd6f0102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.469+0000 7fd6f4964640 1 --2- 172.21.15.39:0/2932986649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0102980 0x7fd6f0102d80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009930 tx=0x7fd6e002a420 comp rx=0 tx=0).stop 2024-09-10T22:01:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 -- 172.21.15.39:0/2932986649 shutdown_connections 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 --2- 172.21.15.39:0/2932986649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 0x7fd6f010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 --2- 172.21.15.39:0/2932986649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 --2- 172.21.15.39:0/2932986649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0102980 0x7fd6f0102d80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 -- 172.21.15.39:0/2932986649 >> 172.21.15.39:0/2932986649 conn(0x7fd6f00fe240 msgr2=0x7fd6f0100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 -- 172.21.15.39:0/2932986649 shutdown_connections 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 -- 172.21.15.39:0/2932986649 wait complete. 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 Processor -- start 2024-09-10T22:01:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.470+0000 7fd6f4964640 1 -- start start 2024-09-10T22:01:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 0x7fd6f0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 0x7fd6f019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f010e5f0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f010e470 con 0x7fd6f0102980 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f010e770 con 0x7fd6f0104490 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47662/0 (socket says 172.21.15.39:47662) 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 0x7fd6f0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 -- 172.21.15.39:0/3771419214 learned_addr learned my addr 172.21.15.39:0/3771419214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 0x7fd6f019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 -- 172.21.15.39:0/3771419214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 msgr2=0x7fd6f019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 0x7fd6f019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 -- 172.21.15.39:0/3771419214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 msgr2=0x7fd6f0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 0x7fd6f0198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 -- 172.21.15.39:0/3771419214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f019a8f0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 0x7fd6f0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400e9f0 tx=0x7fd6e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6df7fe640 1 -- 172.21.15.39:0/3771419214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400cd80 con 0x7fd6f0103ad0 2024-09-10T22:01:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6df7fe640 1 -- 172.21.15.39:0/3771419214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e40108e0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f019abe0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.471+0000 7fd6df7fe640 1 -- 172.21.15.39:0/3771419214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4018980 con 0x7fd6f0103ad0 2024-09-10T22:01:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.472+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f01a12b0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 Processor -- start 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6df7fe640 1 -- 172.21.15.39:0/3771419214 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd6e4010430 con 0x7fd6f0103ad0 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 -- start start 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0747190 0x55f6f0749580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0749bd0 0x55f6f074c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.483 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f6f06b66f0 con 0x55f6f0744860 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f6f06a5b20 con 0x55f6f0749bd0 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.474+0000 7fd6f7813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f6f06a9930 con 0x55f6f0747190 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47672/0 (socket says 172.21.15.39:47672) 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4471892 learned_addr learned my addr 172.21.15.39:0/4471892 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6edd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0749bd0 0x55f6f074c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0747190 0x55f6f0749580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4471892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0747190 msgr2=0x55f6f0749580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0747190 0x55f6f0749580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4471892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0749bd0 msgr2=0x55f6f074c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0749bd0 0x55f6f074c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4471892 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f066b530 con 0x55f6f0744860 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6df7fe640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 0x7fd6d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f90 tx=0x7fd6e80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398a3d9f5f7f2ced server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 0x7fd6d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6dcff9640 1 -- 172.21.15.39:0/4471892 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8004d20 con 0x55f6f0744860 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6dcff9640 1 -- 172.21.15.39:0/4471892 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e8004050 con 0x55f6f0744860 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6dcff9640 1 -- 172.21.15.39:0/4471892 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8005240 con 0x55f6f0744860 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.475+0000 7fd6df7fe640 1 -- 172.21.15.39:0/3771419214 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd6e40e5eb0 con 0x7fd6f0103ad0 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 0x7fd6d80b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 -- 172.21.15.39:0/4471892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 msgr2=0x55f6f0746c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f90 tx=0x7fd6e80118d0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 -- 172.21.15.39:0/4471892 shutdown_connections 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0749bd0 0x55f6f074c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0747190 0x55f6f0749580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4471892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0744860 0x55f6f0746c50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 -- 172.21.15.39:0/4471892 >> 172.21.15.39:0/4471892 conn(0x55f6f073f9b0 msgr2=0x55f6f0740740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 -- 172.21.15.39:0/4471892 shutdown_connections 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.476+0000 7fd6f7813740 1 -- 172.21.15.39:0/4471892 wait complete. 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 -- start start 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 Processor -- start 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0749bd0 0x55f6f074f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f6f05ddab0 con 0x55f6f0747190 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f6f064b730 con 0x55f6f0744860 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f6f074cbb0 con 0x55f6f0749bd0 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6f7813740 10 client.0 _ll_register_callbacks cb 0x55f6f069f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6edd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:52736/0 (socket says 172.21.15.39:52736) 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6edd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47676/0 (socket says 172.21.15.39:47676) 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 -- 172.21.15.39:0/1229675351 learned_addr learned my addr 172.21.15.39:0/1229675351 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0749bd0 0x55f6f074f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 -- 172.21.15.39:0/1229675351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0749bd0 msgr2=0x55f6f074f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0749bd0 0x55f6f074f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 -- 172.21.15.39:0/1229675351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 msgr2=0x55f6f074e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6ee59c640 1 -- 172.21.15.39:0/1229675351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f0407790 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.477+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009930 tx=0x7fd6e0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c81e42165493ba1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0035040 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd6e0003c40 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6e8004050 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd6e0003e40 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 10 client.26588 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f6f0480620 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e8004050 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fd6e0044030 con 0x55f6f0744860 2024-09-10T22:01:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 10 client.26588 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 10 client.26588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 20 client.26588 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.478+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f0759760 0x55f6f075bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.479+0000 7fd6f7813740 4 client.26588 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.479+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f06b8640 con 0x55f6f0759760 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.479+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f0759760 0x55f6f075bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.479+0000 7fd6d5ffb640 10 client.26588 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.479+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f0759760 0x55f6f075bb70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b351dd16b9cf72c7 server_cookie=132c85b4d34a9aa4 in_seq=0 out_seq=0 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/1229675351 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6f06b8640 con 0x55f6f0759760 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6d5ffb640 10 client.26588 handle_command_reply: tid=0 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 client.26588 shutdown 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 msgr2=0x55f6f074def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009930 tx=0x7fd6e0009260 comp rx=0 tx=0).stop 2024-09-10T22:01:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 shutdown_connections 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f0759760 0x55f6f075bb70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0749bd0 0x55f6f074f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0747190 0x55f6f074e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 --2- 172.21.15.39:0/1229675351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0744860 0x55f6f074def0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6d5ffb640 0 client.26588 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.480+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 >> 172.21.15.39:0/1229675351 conn(0x55f6f073f9b0 msgr2=0x55f6f073ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.481+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 shutdown_connections 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.481+0000 7fd6f7813740 1 -- 172.21.15.39:0/1229675351 wait complete. 2024-09-10T22:01:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.481+0000 7fd6f7813740 20 client.26588 trim_cache size 0 max 16384 2024-09-10T22:01:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 Processor -- start 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 -- start start 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f0743d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0744260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01a9e00 con 0x55f6f0749bd0 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01ab9d0 con 0x55f6f0747190 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6f7813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01aa500 con 0x55f6f0744860 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47678/0 (socket says 172.21.15.39:47678) 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4267474516 learned_addr learned my addr 172.21.15.39:0/4267474516 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f0743d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0744260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4267474516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 msgr2=0x55f6f0743d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f0743d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4267474516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 msgr2=0x55f6f0744260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0744260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.505+0000 7fd6eed9d640 1 -- 172.21.15.39:0/4267474516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f0746fc0 con 0x55f6f0749bd0 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.506+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f30 tx=0x7fd6e8003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ee4b94ff9168e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.506+0000 7fd6d7fff640 1 -- 172.21.15.39:0/4267474516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8004880 con 0x55f6f0749bd0 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.506+0000 7fd6d7fff640 1 -- 172.21.15.39:0/4267474516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e8004050 con 0x55f6f0749bd0 2024-09-10T22:01:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.506+0000 7fd6d7fff640 1 -- 172.21.15.39:0/4267474516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80052a0 con 0x55f6f0749bd0 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- 172.21.15.39:0/4267474516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 msgr2=0x55f6f0749fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f30 tx=0x7fd6e8003bc0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- 172.21.15.39:0/4267474516 shutdown_connections 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0749fb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0744260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 --2- 172.21.15.39:0/4267474516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f0743d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- 172.21.15.39:0/4267474516 >> 172.21.15.39:0/4267474516 conn(0x55f6f073f9b0 msgr2=0x55f6f074da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- 172.21.15.39:0/4267474516 shutdown_connections 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- 172.21.15.39:0/4267474516 wait complete. 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.507+0000 7fd6f7813740 1 -- start start 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 Processor -- start 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f07555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0755c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01ab2d0 con 0x55f6f0749bd0 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01aac00 con 0x55f6f0747190 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01a7de0 con 0x55f6f0744860 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6f7813740 10 client.0 _ll_register_callbacks cb 0x7fd6e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6ee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f07555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47684/0 (socket says 172.21.15.39:47684) 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 -- 172.21.15.39:0/2860526014 learned_addr learned my addr 172.21.15.39:0/2860526014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6edd9b640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0755c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 -- 172.21.15.39:0/2860526014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 msgr2=0x55f6f07555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f07555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 -- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 msgr2=0x55f6f0755c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0755c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.508+0000 7fd6eed9d640 1 -- 172.21.15.39:0/2860526014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f0754c30 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6eed9d640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd6e801b040 tx=0x7fd6e8003fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9101ea49e7575b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8037020 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6e8004050 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd6e8004c90 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd6e800f4e0 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6f7813740 10 client.16974 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f6f0753a50 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.509+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e8004050 con 0x55f6f0749bd0 2024-09-10T22:01:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fd6e8005260 con 0x55f6f0749bd0 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 10 client.16974 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 10 client.16974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 20 client.16974 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f07cf3c0 0x55f6f07d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 4 client.16974 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6f06b40f0 con 0x55f6f07cf3c0 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.510+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f07cf3c0 0x55f6f07d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.511+0000 7fd6ee59c640 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f07cf3c0 0x55f6f07d17e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f48311a9bff74f5 server_cookie=1dceb0ac6227b797 in_seq=0 out_seq=0 2024-09-10T22:01:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.511+0000 7fd6d5ffb640 10 client.16974 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:21 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:21.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.923+0000 7f6b2d59a640 1 -- 172.21.15.39:0/1579225008 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b240318a0 con 0x7f6b30106d40 2024-09-10T22:01:21.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.923+0000 7f6b2f59e640 1 -- 172.21.15.39:0/1579225008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30106d40 msgr2=0x7f6b30107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.923+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/1579225008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30106d40 0x7f6b30107190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009900 tx=0x7f6b2402a400 comp rx=0 tx=0).stop 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.924+0000 7f6b2f59e640 1 -- 172.21.15.39:0/1579225008 shutdown_connections 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.924+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/1579225008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30106d40 0x7f6b30107190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.924+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/1579225008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b30102220 0x7f6b301066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.924+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/1579225008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30101900 0x7f6b30101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.924+0000 7f6b2f59e640 1 -- 172.21.15.39:0/1579225008 >> 172.21.15.39:0/1579225008 conn(0x7f6b300fd5b0 msgr2=0x7f6b300ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.925+0000 7f6b2f59e640 1 -- 172.21.15.39:0/1579225008 shutdown_connections 2024-09-10T22:01:21.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.925+0000 7f6b2f59e640 1 -- 172.21.15.39:0/1579225008 wait complete. 2024-09-10T22:01:21.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.926+0000 7f6b2f59e640 1 Processor -- start 2024-09-10T22:01:21.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 -- start start 2024-09-10T22:01:21.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 0x7f6b300748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 0x7f6b30074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b30106d40 0x7f6b3006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30119310 con 0x7f6b30102220 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30119190 con 0x7f6b30106d40 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.927+0000 7f6b2f59e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30119490 con 0x7f6b30101900 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 0x7f6b30074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 0x7f6b30074e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47696/0 (socket says 172.21.15.39:47696) 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2dd9b640 1 -- 172.21.15.39:0/3172012207 learned_addr learned my addr 172.21.15.39:0/3172012207 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 0x7f6b300748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 -- 172.21.15.39:0/3172012207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b30106d40 msgr2=0x7f6b3006db80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b30106d40 0x7f6b3006db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 -- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 msgr2=0x7f6b30074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 0x7f6b30074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.928+0000 7f6b2e59c640 1 -- 172.21.15.39:0/3172012207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3006e440 con 0x7f6b30101900 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.929+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 0x7f6b300748f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800bd70 tx=0x7f6b2800be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.930+0000 7f6b1f7fe640 1 -- 172.21.15.39:0/3172012207 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28019070 con 0x7f6b30101900 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.930+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3006e730 con 0x7f6b30101900 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.930+0000 7f6b1f7fe640 1 -- 172.21.15.39:0/3172012207 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b280148f0 con 0x7f6b30101900 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.930+0000 7f6b1f7fe640 1 -- 172.21.15.39:0/3172012207 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b280128b0 con 0x7f6b30101900 2024-09-10T22:01:21.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.930+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b300737b0 con 0x7f6b30101900 2024-09-10T22:01:21.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.934+0000 7f6b36db0740 1 Processor -- start 2024-09-10T22:01:21.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.936+0000 7f6b36db0740 1 -- start start 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47710/0 (socket says 172.21.15.39:47710) 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bcd1654e60 con 0x55bcd16de0f0 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bcd1644290 con 0x55bcd16ea9a0 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b36db0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bcd16480a0 con 0x55bcd16dea10 2024-09-10T22:01:21.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.937+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/4206052625 learned_addr learned my addr 172.21.15.39:0/4206052625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.938+0000 7f6b2dd9b640 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/4206052625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 msgr2=0x55bcd16ea460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16ea460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/4206052625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 msgr2=0x55bcd16ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/4206052625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd13a2930 con 0x55bcd16de0f0 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402a9f0 tx=0x7f6b240040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb303542674fc15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.939+0000 7f6b1cff9640 1 -- 172.21.15.39:0/4206052625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2403e030 con 0x55bcd16de0f0 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.940+0000 7f6b1cff9640 1 -- 172.21.15.39:0/4206052625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b240054d0 con 0x55bcd16de0f0 2024-09-10T22:01:21.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.940+0000 7f6b1f7fe640 1 -- 172.21.15.39:0/3172012207 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6b28014440 con 0x7f6b30101900 2024-09-10T22:01:21.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.940+0000 7f6b36db0740 1 -- 172.21.15.39:0/4206052625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 msgr2=0x55bcd16de4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.940+0000 7f6b36db0740 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402a9f0 tx=0x7f6b240040f0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b1f7fe640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 0x7f6b180b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 -- 172.21.15.39:0/4206052625 shutdown_connections 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 --2- 172.21.15.39:0/4206052625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16de0f0 0x55bcd16de4d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 -- 172.21.15.39:0/4206052625 >> 172.21.15.39:0/4206052625 conn(0x55bcd16dbf20 msgr2=0x55bcd16dd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b1f7fe640 1 -- 172.21.15.39:0/3172012207 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b280e56d0 con 0x7f6b30101900 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b36db0740 1 -- 172.21.15.39:0/4206052625 shutdown_connections 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.941+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 0x7f6b180b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 -- 172.21.15.39:0/4206052625 wait complete. 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 -- start start 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 Processor -- start 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 0x7f6b180b7a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009230 tx=0x7f6b240049b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 0x55bcd16e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16dea10 0x55bcd16e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.942+0000 7f6b36db0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bcd14a5890 con 0x55bcd16dea10 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b36db0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bcd15ded40 con 0x55bcd16ea9a0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b36db0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bcd16ed640 con 0x55bcd16de0f0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b36db0740 10 client.0 _ll_register_callbacks cb 0x55bcd1642c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:52776/0 (socket says 172.21.15.39:52776) 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/3324971345 learned_addr learned my addr 172.21.15.39:0/3324971345 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 0x55bcd16e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2dd9b640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16dea10 0x55bcd16e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/3324971345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 msgr2=0x55bcd16e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 0x55bcd16e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/3324971345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16dea10 msgr2=0x55bcd16e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16dea10 0x55bcd16e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/3324971345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd16f6a10 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 0x55bcd16e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b24004850 tx=0x7f6b2402a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9035c78cb4aaf394 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.943+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2403e040 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b240054d0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b240035f0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6b240037f0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 10 client.26600 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bcd16f93c0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b240054d0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f6b24031bd0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 10 client.26600 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 20 client.26600 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd16fa9f0 0x55bcd16fce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 4 client.26600 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.944+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd1656db0 con 0x55bcd16fa9f0 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.945+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd16fa9f0 0x55bcd16fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.945+0000 7f6b15ffb640 10 client.26600 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.945+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd16fa9f0 0x55bcd16fce10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f6e9d92109da0df server_cookie=f05a76a444e041bb in_seq=0 out_seq=0 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b15ffb640 1 -- 172.21.15.39:0/3324971345 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcd1656db0 con 0x55bcd16fa9f0 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b15ffb640 10 client.26600 handle_command_reply: tid=0 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 client.26600 shutdown 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 msgr2=0x55bcd16e8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b24004850 tx=0x7f6b2402a400 comp rx=0 tx=0).stop 2024-09-10T22:01:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 shutdown_connections 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd16fa9f0 0x55bcd16fce10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16ea9a0 0x55bcd16e8380 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16dea10 0x55bcd16e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 --2- 172.21.15.39:0/3324971345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16de0f0 0x55bcd16e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 >> 172.21.15.39:0/3324971345 conn(0x55bcd16dbf20 msgr2=0x55bcd16e1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b15ffb640 0 client.26600 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 shutdown_connections 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 1 -- 172.21.15.39:0/3324971345 wait complete. 2024-09-10T22:01:21.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.948+0000 7f6b36db0740 20 client.26600 trim_cache size 0 max 16384 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6d5ffb640 1 -- 172.21.15.39:0/2860526014 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6f06b40f0 con 0x55f6f07cf3c0 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6d5ffb640 10 client.16974 handle_command_reply: tid=0 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 client.16974 shutdown 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 msgr2=0x55f6f0754430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd6e801b040 tx=0x7fd6e8003fe0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 shutdown_connections 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55f6f07cf3c0 0x55f6f07d17e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f6f0749bd0 0x55f6f0754430 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f6f0747190 0x55f6f0755c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 --2- 172.21.15.39:0/2860526014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6f0744860 0x55f6f07555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 >> 172.21.15.39:0/2860526014 conn(0x55f6f073f9b0 msgr2=0x55f6f0743cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.952+0000 7fd6d5ffb640 0 client.16974 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.953+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 shutdown_connections 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.953+0000 7fd6f7813740 1 -- 172.21.15.39:0/2860526014 wait complete. 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.953+0000 7fd6f7813740 20 client.16974 trim_cache size 0 max 16384 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:01:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:01:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 msgr2=0x7fd6d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 0x7fd6d80b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e00314a0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 msgr2=0x7fd6f0199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400e9f0 tx=0x7fd6e400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 shutdown_connections 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd6d80b52e0 0x7fd6d80b77a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6f0104490 0x7fd6f019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f0103ad0 0x7fd6f0199400 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 --2- 172.21.15.39:0/3771419214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f0102980 0x7fd6f0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 >> 172.21.15.39:0/3771419214 conn(0x7fd6f00fe240 msgr2=0x7fd6f0106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 shutdown_connections 2024-09-10T22:01:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:21.954+0000 7fd6f4964640 1 -- 172.21.15.39:0/3771419214 wait complete. 2024-09-10T22:01:21.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.973+0000 7f6b36db0740 1 Processor -- start 2024-09-10T22:01:21.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.973+0000 7f6b36db0740 1 -- start start 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16e5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd17026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301bcf90 con 0x55bcd16ea9a0 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301beb60 con 0x55bcd16de0f0 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b36db0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301bd690 con 0x55bcd16dea10 2024-09-10T22:01:21.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2dd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd17026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47724/0 (socket says 172.21.15.39:47724) 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:52780/0 (socket says 172.21.15.39:52780) 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/2445427094 learned_addr learned my addr 172.21.15.39:0/2445427094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/2445427094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 msgr2=0x55bcd17026e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd17026e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/2445427094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 msgr2=0x55bcd16e5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16e5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/2445427094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd16dbd50 con 0x55bcd16ea9a0 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2dd9b640 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd17026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.974+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6b24031440 tx=0x7f6b24009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8052391b5ff2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b17fff640 1 -- 172.21.15.39:0/2445427094 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24009520 con 0x55bcd16ea9a0 2024-09-10T22:01:21.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b17fff640 1 -- 172.21.15.39:0/2445427094 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2403e030 con 0x55bcd16ea9a0 2024-09-10T22:01:21.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b17fff640 1 -- 172.21.15.39:0/2445427094 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24003c80 con 0x55bcd16ea9a0 2024-09-10T22:01:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 -- 172.21.15.39:0/2445427094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 msgr2=0x55bcd1702c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6b24031440 tx=0x7f6b24009260 comp rx=0 tx=0).stop 2024-09-10T22:01:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 -- 172.21.15.39:0/2445427094 shutdown_connections 2024-09-10T22:01:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd1702c20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd17026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 --2- 172.21.15.39:0/2445427094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16e5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.975+0000 7f6b36db0740 1 -- 172.21.15.39:0/2445427094 >> 172.21.15.39:0/2445427094 conn(0x55bcd16dbf20 msgr2=0x55bcd16e4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- 172.21.15.39:0/2445427094 shutdown_connections 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- 172.21.15.39:0/2445427094 wait complete. 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- start start 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 Processor -- start 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16eee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301be460 con 0x55bcd16ea9a0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301bdd90 con 0x55bcd16de0f0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301baf70 con 0x55bcd16dea10 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.976+0000 7f6b36db0740 10 client.0 _ll_register_callbacks cb 0x7f6b3006bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:52796/0 (socket says 172.21.15.39:52796) 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2e59c640 1 -- 172.21.15.39:0/1573465299 learned_addr learned my addr 172.21.15.39:0/1573465299 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2dd9b640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/1573465299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 msgr2=0x55bcd16eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 msgr2=0x55bcd16ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 -- 172.21.15.39:0/1573465299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd1766a10 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2dd9b640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b2ed9d640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ef3d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402a9f0 tx=0x7f6b24004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977da3ca15241d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b240054c0 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f6b24043a20 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b2403e030 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6b24043c20 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b36db0740 10 client.16989 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.977+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bcd1767d30 con 0x55bcd16ea9a0 2024-09-10T22:01:21.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2403e030 con 0x55bcd16ea9a0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f6b24073020 con 0x55bcd16ea9a0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 10 client.16989 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 20 client.16989 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd17683e0 0x55bcd176a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 4 client.16989 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bcd1652860 con 0x55bcd17683e0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd17683e0 0x55bcd176a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b2e59c640 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd17683e0 0x55bcd176a7d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4611870db92e40df server_cookie=e518c8e0e7f8af86 in_seq=0 out_seq=0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.978+0000 7f6b15ffb640 10 client.16989 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b15ffb640 1 -- 172.21.15.39:0/1573465299 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bcd1652860 con 0x55bcd17683e0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b15ffb640 10 client.16989 handle_command_reply: tid=0 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 client.16989 shutdown 2024-09-10T22:01:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 msgr2=0x55bcd16ef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ef3d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402a9f0 tx=0x7f6b24004f70 comp rx=0 tx=0).stop 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 shutdown_connections 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55bcd17683e0 0x55bcd176a7d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bcd16ea9a0 0x55bcd16ef3d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bcd16dea10 0x55bcd16eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 --2- 172.21.15.39:0/1573465299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bcd16de0f0 0x55bcd16ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 >> 172.21.15.39:0/1573465299 conn(0x55bcd16dbf20 msgr2=0x55bcd16da750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.980+0000 7f6b15ffb640 0 client.16989 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 shutdown_connections 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b36db0740 1 -- 172.21.15.39:0/1573465299 wait complete. 2024-09-10T22:01:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b36db0740 20 client.16989 trim_cache size 0 max 16384 2024-09-10T22:01:21.988 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:01:21.988 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-10T22:01:21.988 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "c9ad0434-0dcf-46ca-8153-3fbeae3f53d2", 2024-09-10T22:01:21.988 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-10T22:01:21.988 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 msgr2=0x7f6b180b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 0x7f6b180b7a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009230 tx=0x7f6b240049b0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 msgr2=0x7f6b300748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 0x7f6b300748f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800bd70 tx=0x7f6b2800be60 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 shutdown_connections 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f6b180b5560 0x7f6b180b7a20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b30106d40 0x7f6b3006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6b30102220 0x7f6b30074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 --2- 172.21.15.39:0/3172012207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b30101900 0x7f6b300748f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.981+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 >> 172.21.15.39:0/3172012207 conn(0x7f6b300fd5b0 msgr2=0x7f6b30110560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.982+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 shutdown_connections 2024-09-10T22:01:21.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:21.982+0000 7f6b2f59e640 1 -- 172.21.15.39:0/3172012207 wait complete. 2024-09-10T22:01:21.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:21 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:22.151 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:21 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:22.406 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:01:22 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T22:01:22.149+0000 7fb90dfb1640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004e00 [...2,head] /volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73/ auth{1=1} fragtree_t(*^3) v311878 ap=2 RANDEPHEMERALPIN f(v7 m2024-09-10T22:00:38.192213+0000 157=157+0) n(v13 rc2024-09-10T22:00:38.192213+0000 b3866966 158=157+1) (inest sync->mix g=1) caps={24991=pAsLsXsFs/pAsLsXsFsx@42} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 randepin 0x55d869012680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000004e00:[<0x10000000399/blog-73 v196303>,<0x10000000208/blogtest_in v894>,<0x10000000201/src v2289>,<0x10000000006/blogbench-1.0 v2014>,<0x10000000005/tmp v278>,<0x100000001fb/client.0 v265>,<0x100000001fa/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 v279>,<0x10000000001/sv_1 v295>,<0x10000000000/qa v274>,<0x1/volumes v266>]//[]","memoryvalue":"(2)0x10000004e00:[<0x10000000399/blog-73 v311878>,<0x10000000208/blogtest_in v1812>,<0x10000000201/src v2741>,<0x10000000006/blogbench-1.0 v2397>,<0x10000000005/tmp v655>,<0x100000001fb/client.0 v631>,<0x100000001fa/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876 v646>,<0x10000000001/sv_1 v660>,<0x10000000000/qa v641>,<0x1/volumes v627>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T21:59:38.050348+0000 156=156+0)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:00:38.192213+0000 b3866966 158=157+1)","memory_value.dirstat":"f(v7 m2024-09-10T22:00:38.192213+0000 157=157+0)","memory_value.rstat":"n(v13 rc2024-09-10T22:00:38.192213+0000 b3866966 158=157+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-10T22:01:22.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:01:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:22 smithi173 ceph-mon[35294]: pgmap v532: 97 pgs: 97 active+clean; 349 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 539 op/s 2024-09-10T22:01:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:22 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:01:22.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:22 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:01:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:22 smithi070 ceph-mon[34909]: pgmap v532: 97 pgs: 97 active+clean; 349 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 539 op/s 2024-09-10T22:01:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:22 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:01:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:22 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:01:23.165 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:22 smithi039 ceph-mon[30872]: pgmap v532: 97 pgs: 97 active+clean; 349 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 539 op/s 2024-09-10T22:01:23.165 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:22 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:01:23.165 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:22 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:01:23.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 -- 172.21.15.39:0/1279147152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c1087b0 msgr2=0x7f8e2c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/1279147152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c108bf0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009900 tx=0x7f8e2002a410 comp rx=0 tx=0).stop 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 -- 172.21.15.39:0/1279147152 shutdown_connections 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/1279147152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 0x7f8e2c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/1279147152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c108bf0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/1279147152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c102da0 0x7f8e2c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 -- 172.21.15.39:0/1279147152 >> 172.21.15.39:0/1279147152 conn(0x7f8e2c0fe850 msgr2=0x7f8e2c100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 -- 172.21.15.39:0/1279147152 shutdown_connections 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.691+0000 7f8e30d3a640 1 -- 172.21.15.39:0/1279147152 wait complete. 2024-09-10T22:01:23.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 Processor -- start 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 -- start start 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 0x7f8e2c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c112df0 con 0x7f8e2c102da0 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c112c70 con 0x7f8e2c109130 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e30d3a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c112f70 con 0x7f8e2c1087b0 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47768/0 (socket says 172.21.15.39:47768) 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e2a59c640 1 -- 172.21.15.39:0/3029258689 learned_addr learned my addr 172.21.15.39:0/3029258689 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e2ad9d640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 0x7f8e2c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.692+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 -- 172.21.15.39:0/3029258689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c1087b0 msgr2=0x7f8e2c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 -- 172.21.15.39:0/3029258689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 msgr2=0x7f8e2c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 0x7f8e2c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 -- 172.21.15.39:0/3029258689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c19f330 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e9f0 tx=0x7f8e1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e1b7fe640 1 -- 172.21.15.39:0/3029258689 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00cd80 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2c19f620 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e1b7fe640 1 -- 172.21.15.39:0/3029258689 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1c0054d0 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e1b7fe640 1 -- 172.21.15.39:0/3029258689 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c010690 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.693+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e2c1a5ce0 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e1b7fe640 1 -- 172.21.15.39:0/3029258689 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8e1c004e90 con 0x7f8e2c102da0 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 Processor -- start 2024-09-10T22:01:23.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 -- start start 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818467860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b818477c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b81847a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b8183dde50 con 0x55b818467480 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b8183cd280 con 0x55b818478140 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e3310f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b8183d1090 con 0x55b818467da0 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.696+0000 7f8e2ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818467860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e2ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818467860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47784/0 (socket says 172.21.15.39:47784) 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e2ad9d640 1 -- 172.21.15.39:0/511476955 learned_addr learned my addr 172.21.15.39:0/511476955 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b818477c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b81847a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e1b7fe640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 0x7f8e140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 -- 172.21.15.39:0/511476955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 msgr2=0x55b818477c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b818477c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 -- 172.21.15.39:0/511476955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 msgr2=0x55b818467860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818467860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 -- 172.21.15.39:0/511476955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81812b650 con 0x55b818478140 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b818477c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e2ad9d640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 0x7f8e140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e1b7fe640 1 -- 172.21.15.39:0/3029258689 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e1c0e5ff0 con 0x7f8e2c102da0 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b81847a530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009230 tx=0x7f8e20032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aac7c0d19587a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e18ff9640 1 -- 172.21.15.39:0/511476955 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20040070 con 0x55b818478140 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e2ad9d640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 0x7f8e140b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005f40 tx=0x7f8e24004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.697+0000 7f8e18ff9640 1 -- 172.21.15.39:0/511476955 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20004030 con 0x55b818478140 2024-09-10T22:01:23.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e18ff9640 1 -- 172.21.15.39:0/511476955 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20035040 con 0x55b818478140 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 -- 172.21.15.39:0/511476955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 msgr2=0x55b81847a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b81847a530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009230 tx=0x7f8e20032bd0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 -- 172.21.15.39:0/511476955 shutdown_connections 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b81847a530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b818477c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 --2- 172.21.15.39:0/511476955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818467860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 -- 172.21.15.39:0/511476955 >> 172.21.15.39:0/511476955 conn(0x55b8184652b0 msgr2=0x55b818466450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 -- 172.21.15.39:0/511476955 shutdown_connections 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.698+0000 7f8e3310f740 1 -- 172.21.15.39:0/511476955 wait complete. 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 -- start start 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 Processor -- start 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 0x55b8184779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b8184753f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b81822e700 con 0x55b818467da0 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b818368110 con 0x55b818478140 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b81847ad90 con 0x55b818467480 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e3310f740 10 client.0 _ll_register_callbacks cb 0x55b818381990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 0x55b8184779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47792/0 (socket says 172.21.15.39:47792) 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 -- 172.21.15.39:0/536449842 learned_addr learned my addr 172.21.15.39:0/536449842 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e2ad9d640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b8184753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 -- 172.21.15.39:0/536449842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 msgr2=0x55b8184779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 0x55b8184779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 -- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 msgr2=0x55b8184753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b8184753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e29d9b640 1 -- 172.21.15.39:0/536449842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b818395c40 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.699+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 0x55b8184779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8e200095a0 tx=0x7f8e20009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a3a6c0fda3a3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20040070 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e200054d0 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e20004030 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8e20035040 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e3310f740 10 client.17001 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b818486680 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20004030 con 0x55b818467da0 2024-09-10T22:01:23.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.700+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f8e20004cc0 con 0x55b818467da0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 10 client.17001 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 20 client.17001 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184879d0 0x55b818489dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 4 client.17001 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8183dfda0 con 0x55b8184879d0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184879d0 0x55b818489dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184879d0 0x55b818489dc0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa48beb472a03989 server_cookie=544695737ae2aaee in_seq=0 out_seq=0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.701+0000 7f8e11ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e11ffb640 1 -- 172.21.15.39:0/536449842 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8183dfda0 con 0x55b8184879d0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e11ffb640 10 client.17001 handle_command_reply: tid=0 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 client.17001 shutdown 2024-09-10T22:01:23.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 msgr2=0x55b818474e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8e200095a0 tx=0x7f8e20009260 comp rx=0 tx=0).stop 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 shutdown_connections 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184879d0 0x55b818489dc0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818478140 0x55b8184753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467da0 0x55b818474e30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 --2- 172.21.15.39:0/536449842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467480 0x55b8184779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e11ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 >> 172.21.15.39:0/536449842 conn(0x55b8184652b0 msgr2=0x55b81846ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 shutdown_connections 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 1 -- 172.21.15.39:0/536449842 wait complete. 2024-09-10T22:01:23.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.705+0000 7f8e3310f740 20 client.17001 trim_cache size 0 max 16384 2024-09-10T22:01:23.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 Processor -- start 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub queued for path: / 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: active paths [/] 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.727 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:23 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 -- start start 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 0x55b818483fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818478140 0x55b81848f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1ac0a0 con 0x55b818478140 2024-09-10T22:01:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1adc70 con 0x55b818467480 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.725+0000 7f8e3310f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1ac7a0 con 0x55b818467da0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e2ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818478140 0x55b81848f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 0x55b818483fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:40700/0 (socket says 172.21.15.39:40700) 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 -- 172.21.15.39:0/3020565853 learned_addr learned my addr 172.21.15.39:0/3020565853 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 -- 172.21.15.39:0/3020565853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 msgr2=0x55b818483fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 0x55b818483fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 -- 172.21.15.39:0/3020565853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818478140 msgr2=0x55b81848f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818478140 0x55b81848f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 -- 172.21.15.39:0/3020565853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b818466070 con 0x55b818467da0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 0x55b818483fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009900 tx=0x7f8e20031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54d75262b59a9db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e13fff640 1 -- 172.21.15.39:0/3020565853 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20040070 con 0x55b818467da0 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e13fff640 1 -- 172.21.15.39:0/3020565853 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e2004d070 con 0x55b818467da0 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.726+0000 7f8e13fff640 1 -- 172.21.15.39:0/3020565853 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20004900 con 0x55b818467da0 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 -- 172.21.15.39:0/3020565853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 msgr2=0x55b81846acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009900 tx=0x7f8e20031400 comp rx=0 tx=0).stop 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 -- 172.21.15.39:0/3020565853 shutdown_connections 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818478140 0x55b81848f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818467da0 0x55b81846acd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 --2- 172.21.15.39:0/3020565853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467480 0x55b818483fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.727+0000 7f8e3310f740 1 -- 172.21.15.39:0/3020565853 >> 172.21.15.39:0/3020565853 conn(0x55b8184652b0 msgr2=0x55b81846a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- 172.21.15.39:0/3020565853 shutdown_connections 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- 172.21.15.39:0/3020565853 wait complete. 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- start start 2024-09-10T22:01:23.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 Processor -- start 2024-09-10T22:01:23.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467da0 0x55b818480970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818478140 0x55b81847d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1ad570 con 0x55b818467480 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1acea0 con 0x55b818467da0 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.728+0000 7f8e3310f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c1aa080 con 0x55b818478140 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e3310f740 10 client.0 _ll_register_callbacks cb 0x7f8e24009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47814/0 (socket says 172.21.15.39:47814) 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 -- 172.21.15.39:0/597307804 learned_addr learned my addr 172.21.15.39:0/597307804 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467da0 0x55b818480970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2ad9d640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818478140 0x55b81847d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 -- 172.21.15.39:0/597307804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818478140 msgr2=0x55b81847d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818478140 0x55b81847d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 -- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467da0 msgr2=0x55b818480970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467da0 0x55b818480970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 -- 172.21.15.39:0/597307804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81847d950 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e2a59c640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0e3ae0 tx=0x7f8e1c0a8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dbaee748016bda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0abf10 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f8e1c0a8a10 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.729+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2004d070 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8e1c0ac2b0 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 10 client.17007 fetch_fsmap learned FSMap version 35 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b8184f5260 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e2004d070 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f8e1c0e80b0 con 0x55b818467480 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 10 client.17007 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:01:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 20 client.17007 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184f5a30 0x55b8184f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 4 client.17007 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b8183db850 con 0x55b8184f5a30 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.730+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184f5a30 0x55b8184f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.731+0000 7f8e29d9b640 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184f5a30 0x55b8184f7e50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=787faa13a8f129a1 server_cookie=c2ec01631cf1680c in_seq=0 out_seq=0 2024-09-10T22:01:23.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.731+0000 7f8e11ffb640 10 client.17007 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e11ffb640 1 -- 172.21.15.39:0/597307804 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2852 (crc 0 0 0) 0x55b8183db850 con 0x55b8184f5a30 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e11ffb640 10 client.17007 handle_command_reply: tid=0 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 client.17007 shutdown 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 msgr2=0x55b818480410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0e3ae0 tx=0x7f8e1c0a8700 comp rx=0 tx=0).stop 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 shutdown_connections 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55b8184f5a30 0x55b8184f7e50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b818478140 0x55b81847d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b818467da0 0x55b818480970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 --2- 172.21.15.39:0/597307804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b818467480 0x55b818480410 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 >> 172.21.15.39:0/597307804 conn(0x55b8184652b0 msgr2=0x55b818476c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e11ffb640 0 client.17007 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 shutdown_connections 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 1 -- 172.21.15.39:0/597307804 wait complete. 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.733+0000 7f8e3310f740 20 client.17007 trim_cache size 0 max 16384 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "scrub active (11696 inodes in the stack)", 2024-09-10T22:01:23.738 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "c9ad0434-0dcf-46ca-8153-3fbeae3f53d2": { 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "c9ad0434-0dcf-46ca-8153-3fbeae3f53d2", 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.739 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "c9ad0434-0dcf-46ca-8153-3fbeae3f53d2": { 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:01:21.978404+0000", 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "956ae779-ac12-4a63-9d38-bbcac731e7fd": { 2024-09-10T22:01:23.740 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:00:35.416798+0000", 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.742 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T22:01:23.743 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:23.744 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:23.745 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:01:23.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 msgr2=0x7f8e140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 0x7f8e140b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005f40 tx=0x7f8e24004a40 comp rx=0 tx=0).stop 2024-09-10T22:01:23.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 msgr2=0x7f8e2c199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e9f0 tx=0x7f8e1c00edf0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 shutdown_connections 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f8e140b52e0 0x7f8e140b77a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e2c109130 0x7f8e2c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2c1087b0 0x7f8e2c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 --2- 172.21.15.39:0/3029258689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e2c102da0 0x7f8e2c199280 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.734+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 >> 172.21.15.39:0/3029258689 conn(0x7f8e2c0fe850 msgr2=0x7f8e2c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.735+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 shutdown_connections 2024-09-10T22:01:23.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:23.735+0000 7f8e30d3a640 1 -- 172.21.15.39:0/3029258689 wait complete. 2024-09-10T22:01:23.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub queued for path: / 2024-09-10T22:01:23.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:01:23.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details 2024-09-10T22:01:23.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: active paths [/] 2024-09-10T22:01:23.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:23.993 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:23 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub queued for path: / 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: active paths [/] 2024-09-10T22:01:24.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:24.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:24.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:23 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:24.533 INFO:tasks.cephfs.filesystem:scrub status for tag:c9ad0434-0dcf-46ca-8153-3fbeae3f53d2 - {'path': '/', 'tag': 'c9ad0434-0dcf-46ca-8153-3fbeae3f53d2', 'options': 'recursive,force'} 2024-09-10T22:01:24.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:24 smithi039 ceph-mon[30872]: pgmap v533: 97 pgs: 97 active+clean; 301 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 783 op/s 2024-09-10T22:01:24.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:24 smithi173 ceph-mon[35294]: pgmap v533: 97 pgs: 97 active+clean; 301 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 783 op/s 2024-09-10T22:01:25.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:24 smithi070 ceph-mon[34909]: pgmap v533: 97 pgs: 97 active+clean; 301 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 783 op/s 2024-09-10T22:01:26.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:26 smithi173 ceph-mon[35294]: pgmap v534: 97 pgs: 97 active+clean; 294 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-09-10T22:01:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:26 smithi070 ceph-mon[34909]: pgmap v534: 97 pgs: 97 active+clean; 294 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-09-10T22:01:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:26 smithi039 ceph-mon[30872]: pgmap v534: 97 pgs: 97 active+clean; 294 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 607 op/s 2024-09-10T22:01:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:28 smithi173 ceph-mon[35294]: pgmap v535: 97 pgs: 97 active+clean; 293 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 745 op/s 2024-09-10T22:01:28.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:28 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:29.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:28 smithi070 ceph-mon[34909]: pgmap v535: 97 pgs: 97 active+clean; 293 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 745 op/s 2024-09-10T22:01:29.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:28 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:29.172 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:28 smithi039 ceph-mon[30872]: pgmap v535: 97 pgs: 97 active+clean; 293 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 745 op/s 2024-09-10T22:01:29.172 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:28 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:30.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:30 smithi173 ceph-mon[35294]: pgmap v536: 97 pgs: 97 active+clean; 292 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 932 op/s 2024-09-10T22:01:31.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:30 smithi070 ceph-mon[34909]: pgmap v536: 97 pgs: 97 active+clean; 292 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 932 op/s 2024-09-10T22:01:31.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:30 smithi039 ceph-mon[30872]: pgmap v536: 97 pgs: 97 active+clean; 292 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 932 op/s 2024-09-10T22:01:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:32 smithi173 ceph-mon[35294]: pgmap v537: 97 pgs: 97 active+clean; 290 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 868 op/s 2024-09-10T22:01:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:32 smithi070 ceph-mon[34909]: pgmap v537: 97 pgs: 97 active+clean; 290 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 868 op/s 2024-09-10T22:01:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:32 smithi039 ceph-mon[30872]: pgmap v537: 97 pgs: 97 active+clean; 290 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 868 op/s 2024-09-10T22:01:34.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:34 smithi173 ceph-mon[35294]: pgmap v538: 97 pgs: 97 active+clean; 277 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-10T22:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 -- 172.21.15.39:0/2841877170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768103ad0 msgr2=0x7fa768103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 --2- 172.21.15.39:0/2841877170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768103ad0 0x7fa768103f50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009930 tx=0x7fa75c02a420 comp rx=0 tx=0).stop 2024-09-10T22:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 -- 172.21.15.39:0/2841877170 shutdown_connections 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 --2- 172.21.15.39:0/2841877170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 0x7fa76810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 --2- 172.21.15.39:0/2841877170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768103ad0 0x7fa768103f50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 --2- 172.21.15.39:0/2841877170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768102980 0x7fa768102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 -- 172.21.15.39:0/2841877170 >> 172.21.15.39:0/2841877170 conn(0x7fa7680fe240 msgr2=0x7fa768100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 -- 172.21.15.39:0/2841877170 shutdown_connections 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.084+0000 7fa76e060640 1 -- 172.21.15.39:0/2841877170 wait complete. 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 Processor -- start 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 -- start start 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 0x7fa768198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 0x7fa76819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa76810e5f0 con 0x7fa768102980 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa76810e470 con 0x7fa768104490 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa76e060640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa76810e770 con 0x7fa768103ad0 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 0x7fa768198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:60012/0 (socket says 172.21.15.39:60012) 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 -- 172.21.15.39:0/306934011 learned_addr learned my addr 172.21.15.39:0/306934011 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 0x7fa768198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37074/0 (socket says 172.21.15.39:37074) 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa767fff640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 0x7fa76819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 -- 172.21.15.39:0/306934011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 msgr2=0x7fa76819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 0x7fa76819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 -- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 msgr2=0x7fa768198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 0x7fa768198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.085+0000 7fa766ffd640 1 -- 172.21.15.39:0/306934011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76819a8f0 con 0x7fa768103ad0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa766ffd640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009a50 tx=0x7fa75c005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa764ff9640 1 -- 172.21.15.39:0/306934011 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c035070 con 0x7fa768103ad0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76819ab80 con 0x7fa768103ad0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa764ff9640 1 -- 172.21.15.39:0/306934011 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa75c03dc10 con 0x7fa768103ad0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa764ff9640 1 -- 172.21.15.39:0/306934011 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c003de0 con 0x7fa768103ad0 2024-09-10T22:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.086+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa768075560 con 0x7fa768103ad0 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.088+0000 7fa770e2e740 1 Processor -- start 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.088+0000 7fa770e2e740 1 -- start start 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.088+0000 7fa764ff9640 1 -- 172.21.15.39:0/306934011 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa75c03d760 con 0x7fa768103ad0 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 0x55a128d0dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a128c7d6f0 con 0x55a128d0b860 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a128c6cb20 con 0x55a128d0e190 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa770e2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a128c70930 con 0x55a128d10bd0 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa767fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 0x55a128d0dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.095 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:45382/0 (socket says 172.21.15.39:45382) 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 -- 172.21.15.39:0/104911101 learned_addr learned my addr 172.21.15.39:0/104911101 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa766ffd640 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 -- 172.21.15.39:0/104911101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 msgr2=0x55a128d13090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d13090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 -- 172.21.15.39:0/104911101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 msgr2=0x55a128d0dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 0x55a128d0dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 -- 172.21.15.39:0/104911101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128c32530 con 0x55a128d0e190 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa767fff640 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 0x55a128d0dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa764ff9640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 0x7fa7500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.089+0000 7fa7677fe640 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d20 tx=0x7fa758011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f453bcc079cedde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa764ff9640 1 -- 172.21.15.39:0/306934011 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa75c10a630 con 0x7fa768103ad0 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa767fff640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 0x7fa7500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.096 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa74dffb640 1 -- 172.21.15.39:0/104911101 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75801e070 con 0x55a128d0e190 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa74dffb640 1 -- 172.21.15.39:0/104911101 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758019ae0 con 0x55a128d0e190 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa74dffb640 1 -- 172.21.15.39:0/104911101 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75800eac0 con 0x55a128d0e190 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 -- 172.21.15.39:0/104911101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 msgr2=0x55a128d10580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa767fff640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 0x7fa7500b7820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa760009fd0 tx=0x7fa760009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d20 tx=0x7fa758011810 comp rx=0 tx=0).stop 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 -- 172.21.15.39:0/104911101 shutdown_connections 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d10580 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 --2- 172.21.15.39:0/104911101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0b860 0x55a128d0dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.090+0000 7fa770e2e740 1 -- 172.21.15.39:0/104911101 >> 172.21.15.39:0/104911101 conn(0x55a128d069b0 msgr2=0x55a128d07740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- 172.21.15.39:0/104911101 shutdown_connections 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- 172.21.15.39:0/104911101 wait complete. 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- start start 2024-09-10T22:01:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 Processor -- start 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d16110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a128ba4ab0 con 0x55a128d10bd0 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a128c12730 con 0x55a128d0b860 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.091+0000 7fa770e2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a128d13bb0 con 0x55a128d0e190 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa770e2e740 10 client.0 _ll_register_callbacks cb 0x55a128c666b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:45384/0 (socket says 172.21.15.39:45384) 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa767fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d16110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa7677fe640 1 -- 172.21.15.39:0/3638838389 learned_addr learned my addr 172.21.15.39:0/3638838389 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:60030/0 (socket says 172.21.15.39:60030) 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 -- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 msgr2=0x55a128d14ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 -- 172.21.15.39:0/3638838389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 msgr2=0x55a128d16110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d16110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 -- 172.21.15.39:0/3638838389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1289ce790 con 0x55a128d0e190 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa7677fe640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa767fff640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d16110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa766ffd640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa75c108190 tx=0x7fa75c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac312d81708329c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0ccca0 con 0x55a128d0e190 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa758019ae0 con 0x55a128d0e190 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.092+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa75c0b80d0 con 0x55a128d0e190 2024-09-10T22:01:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa75c0d0570 con 0x55a128d0e190 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 10 client.26524 fetch_fsmap learned FSMap version 36 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a128a47620 con 0x55a128d0e190 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758019ae0 con 0x55a128d0e190 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fa75c0d1060 con 0x55a128d0e190 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 10 client.26524 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 10 client.26524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 20 client.26524 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d20770 0x55a128d22b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 4 client.26524 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a128c7f640 con 0x55a128d20770 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.093+0000 7fa7677fe640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d20770 0x55a128d22b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.094+0000 7fa746ffd640 10 client.26524 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:35.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.094+0000 7fa7677fe640 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d20770 0x55a128d22b90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4f7d7d883551ab server_cookie=fd9b255432f6de33 in_seq=0 out_seq=0 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.095+0000 7fa746ffd640 1 -- 172.21.15.39:0/3638838389 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a128c7f640 con 0x55a128d20770 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.095+0000 7fa746ffd640 10 client.26524 handle_command_reply: tid=0 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.095+0000 7fa770e2e740 1 client.26524 shutdown 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 msgr2=0x55a128d15540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa75c108190 tx=0x7fa75c005c90 comp rx=0 tx=0).stop 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 shutdown_connections 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d20770 0x55a128d22b90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d16110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa746ffd640 0 client.26524 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0e190 0x55a128d15540 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 --2- 172.21.15.39:0/3638838389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d14ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 >> 172.21.15.39:0/3638838389 conn(0x55a128d069b0 msgr2=0x55a128d05bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 shutdown_connections 2024-09-10T22:01:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 1 -- 172.21.15.39:0/3638838389 wait complete. 2024-09-10T22:01:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.096+0000 7fa770e2e740 20 client.26524 trim_cache size 0 max 16384 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 Processor -- start 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 -- start start 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d07210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d14100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a7c50 con 0x55a128d0e190 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a9820 con 0x55a128d0b860 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa770e2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a8350 con 0x55a128d10bd0 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37100/0 (socket says 172.21.15.39:37100) 2024-09-10T22:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 -- 172.21.15.39:0/528958508 learned_addr learned my addr 172.21.15.39:0/528958508 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa7677fe640 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d07210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa767fff640 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 -- 172.21.15.39:0/528958508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 msgr2=0x55a128d14100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d14100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 -- 172.21.15.39:0/528958508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 msgr2=0x55a128d07210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d07210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.111+0000 7fa766ffd640 1 -- 172.21.15.39:0/528958508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128d23210 con 0x55a128d0e190 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa766ffd640 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ce070 tx=0x7fa75c0da4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b583f351002819 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa74d7fa640 1 -- 172.21.15.39:0/528958508 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0d0750 con 0x55a128d0e190 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa74d7fa640 1 -- 172.21.15.39:0/528958508 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa75c0ea070 con 0x55a128d0e190 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa74d7fa640 1 -- 172.21.15.39:0/528958508 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0d0bd0 con 0x55a128d0e190 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 -- 172.21.15.39:0/528958508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 msgr2=0x55a128d07750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ce070 tx=0x7fa75c0da4e0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 -- 172.21.15.39:0/528958508 shutdown_connections 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d10bd0 0x55a128d14100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d0e190 0x55a128d07750 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 --2- 172.21.15.39:0/528958508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0b860 0x55a128d07210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.112+0000 7fa770e2e740 1 -- 172.21.15.39:0/528958508 >> 172.21.15.39:0/528958508 conn(0x55a128d069b0 msgr2=0x55a128d10fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- 172.21.15.39:0/528958508 shutdown_connections 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- 172.21.15.39:0/528958508 wait complete. 2024-09-10T22:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- start start 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 Processor -- start 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0b860 0x55a128d19f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d1a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a9120 con 0x55a128d10bd0 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a8a50 con 0x55a128d0e190 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7681a5c50 con 0x55a128d0b860 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa770e2e740 10 client.0 _ll_register_callbacks cb 0x7fa75c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa767fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa767fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37116/0 (socket says 172.21.15.39:37116) 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa767fff640 1 -- 172.21.15.39:0/711916880 learned_addr learned my addr 172.21.15.39:0/711916880 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.113+0000 7fa766ffd640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d1a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa7677fe640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0b860 0x55a128d19f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 -- 172.21.15.39:0/711916880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0b860 msgr2=0x55a128d19f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0b860 0x55a128d19f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 -- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 msgr2=0x55a128d1a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d1a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 -- 172.21.15.39:0/711916880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a128d1b930 con 0x55a128d10bd0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa766ffd640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d1a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa767fff640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa76000fe60 tx=0x7fa760004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c31a36150d4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76002d060 con 0x55a128d10bd0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fa760011400 con 0x55a128d10bd0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa75c0ea070 con 0x55a128d10bd0 2024-09-10T22:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa760028430 con 0x55a128d10bd0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa770e2e740 10 client.17025 fetch_fsmap learned FSMap version 36 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a128d1cda0 con 0x55a128d10bd0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.114+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa75c0ea070 con 0x55a128d10bd0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fa760027070 con 0x55a128d10bd0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 10 client.17025 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 20 client.17025 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d8dcf0 0x55a128d90110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 4 client.17025 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a128c7b0f0 con 0x55a128d8dcf0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa7677fe640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d8dcf0 0x55a128d90110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa746ffd640 10 client.17025 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.115+0000 7fa7677fe640 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d8dcf0 0x55a128d90110 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a3addefd4976af0 server_cookie=a891678fa2091814 in_seq=0 out_seq=0 2024-09-10T22:01:35.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:34 smithi070 ceph-mon[34909]: pgmap v538: 97 pgs: 97 active+clean; 277 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-10T22:01:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:34 smithi039 ceph-mon[30872]: pgmap v538: 97 pgs: 97 active+clean; 277 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-10T22:01:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.513+0000 7fa746ffd640 1 -- 172.21.15.39:0/711916880 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a128c7b0f0 con 0x55a128d8dcf0 2024-09-10T22:01:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.513+0000 7fa746ffd640 10 client.17025 handle_command_reply: tid=0 2024-09-10T22:01:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.513+0000 7fa770e2e740 1 client.17025 shutdown 2024-09-10T22:01:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 msgr2=0x55a128d1b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa76000fe60 tx=0x7fa760004ab0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 shutdown_connections 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55a128d8dcf0 0x55a128d90110 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a128d10bd0 0x55a128d1b100 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a128d0e190 0x55a128d1a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 --2- 172.21.15.39:0/711916880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a128d0b860 0x55a128d19f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa746ffd640 0 client.17025 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 >> 172.21.15.39:0/711916880 conn(0x55a128d069b0 msgr2=0x55a128d0abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 shutdown_connections 2024-09-10T22:01:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 1 -- 172.21.15.39:0/711916880 wait complete. 2024-09-10T22:01:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa770e2e740 20 client.17025 trim_cache size 0 max 16384 2024-09-10T22:01:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:01:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:01:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:01:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 msgr2=0x7fa7500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 0x7fa7500b7820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa760009fd0 tx=0x7fa760009500 comp rx=0 tx=0).stop 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 msgr2=0x7fa768199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009a50 tx=0x7fa75c005e60 comp rx=0 tx=0).stop 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 shutdown_connections 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fa7500b5360 0x7fa7500b7820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa768104490 0x7fa76819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa768103ad0 0x7fa768199400 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 --2- 172.21.15.39:0/306934011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa768102980 0x7fa768198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.514+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 >> 172.21.15.39:0/306934011 conn(0x7fa7680fe240 msgr2=0x7fa768104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.515+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 shutdown_connections 2024-09-10T22:01:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:35.515+0000 7fa76e060640 1 -- 172.21.15.39:0/306934011 wait complete. 2024-09-10T22:01:36.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:36 smithi173 ceph-mon[35294]: pgmap v539: 97 pgs: 97 active+clean; 272 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 930 op/s 2024-09-10T22:01:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:36 smithi070 ceph-mon[34909]: pgmap v539: 97 pgs: 97 active+clean; 272 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 930 op/s 2024-09-10T22:01:37.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:36 smithi039 ceph-mon[30872]: pgmap v539: 97 pgs: 97 active+clean; 272 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 930 op/s 2024-09-10T22:01:38.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:38 smithi173 ceph-mon[35294]: pgmap v540: 97 pgs: 97 active+clean; 262 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 974 op/s 2024-09-10T22:01:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:38 smithi070 ceph-mon[34909]: pgmap v540: 97 pgs: 97 active+clean; 262 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 974 op/s 2024-09-10T22:01:39.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:38 smithi039 ceph-mon[30872]: pgmap v540: 97 pgs: 97 active+clean; 262 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 974 op/s 2024-09-10T22:01:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:40 smithi070 ceph-mon[34909]: pgmap v541: 97 pgs: 97 active+clean; 239 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 1.02k op/s 2024-09-10T22:01:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:40 smithi039 ceph-mon[30872]: pgmap v541: 97 pgs: 97 active+clean; 239 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 1.02k op/s 2024-09-10T22:01:41.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:40 smithi173 ceph-mon[35294]: pgmap v541: 97 pgs: 97 active+clean; 239 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 1.02k op/s 2024-09-10T22:01:43.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:42 smithi070 ceph-mon[34909]: pgmap v542: 97 pgs: 97 active+clean; 238 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 798 op/s 2024-09-10T22:01:43.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:42 smithi039 ceph-mon[30872]: pgmap v542: 97 pgs: 97 active+clean; 238 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 798 op/s 2024-09-10T22:01:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:42 smithi173 ceph-mon[35294]: pgmap v542: 97 pgs: 97 active+clean; 238 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 798 op/s 2024-09-10T22:01:45.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:44 smithi070 ceph-mon[34909]: pgmap v543: 97 pgs: 97 active+clean; 219 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-10T22:01:45.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:44 smithi039 ceph-mon[30872]: pgmap v543: 97 pgs: 97 active+clean; 219 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-10T22:01:45.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:44 smithi173 ceph-mon[35294]: pgmap v543: 97 pgs: 97 active+clean; 219 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-10T22:01:46.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:45 smithi070 ceph-mon[34909]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:46.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:45 smithi039 ceph-mon[30872]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:46.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:45 smithi173 ceph-mon[35294]: scrub summary: idle+waiting paths [/] 2024-09-10T22:01:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:46 smithi070 ceph-mon[34909]: pgmap v544: 97 pgs: 97 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 823 op/s 2024-09-10T22:01:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:46 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:47.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:46 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:47.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:46 smithi039 ceph-mon[30872]: pgmap v544: 97 pgs: 97 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 823 op/s 2024-09-10T22:01:47.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:46 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:47.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:46 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:46 smithi173 ceph-mon[35294]: pgmap v544: 97 pgs: 97 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 823 op/s 2024-09-10T22:01:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:46 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:47.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:46 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:48.074 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:48.075 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:47 smithi039 ceph-mon[30872]: scrub summary: idle 2024-09-10T22:01:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:48.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:47 smithi070 ceph-mon[34909]: scrub summary: idle 2024-09-10T22:01:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:48.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:47 smithi173 ceph-mon[35294]: scrub summary: idle 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.604+0000 7f3e32f0e640 1 -- 172.21.15.39:0/3674837557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c1029b0 msgr2=0x7f3e2c102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.604+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/3674837557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c102e30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009930 tx=0x7f3e1c02a420 comp rx=0 tx=0).stop 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.604+0000 7f3e32f0e640 1 -- 172.21.15.39:0/3674837557 shutdown_connections 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/3674837557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c103370 0x7f3e2c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/3674837557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c102e30 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/3674837557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 0x7f3e2c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- 172.21.15.39:0/3674837557 >> 172.21.15.39:0/3674837557 conn(0x7f3e2c0fd140 msgr2=0x7f3e2c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- 172.21.15.39:0/3674837557 shutdown_connections 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- 172.21.15.39:0/3674837557 wait complete. 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 Processor -- start 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- start start 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 0x7f3e2c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c103370 0x7f3e2c1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d4b0 con 0x7f3e2c103370 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d330 con 0x7f3e2c1029b0 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.605+0000 7f3e32f0e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d630 con 0x7f3e2c101860 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53950/0 (socket says 172.21.15.39:53950) 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 -- 172.21.15.39:0/711818503 learned_addr learned my addr 172.21.15.39:0/711818503 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e30caa640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 0x7f3e2c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e314ab640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c103370 0x7f3e2c1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 -- 172.21.15.39:0/711818503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 msgr2=0x7f3e2c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 0x7f3e2c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 -- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c103370 msgr2=0x7f3e2c1a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c103370 0x7f3e2c1a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 -- 172.21.15.39:0/711818503 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1a0920 con 0x7f3e2c1029b0 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009a50 tx=0x7f3e1c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e29ffb640 1 -- 172.21.15.39:0/711818503 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c03f030 con 0x7f3e2c1029b0 2024-09-10T22:01:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1a0b50 con 0x7f3e2c1029b0 2024-09-10T22:01:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.606+0000 7f3e29ffb640 1 -- 172.21.15.39:0/711818503 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c003cb0 con 0x7f3e2c1029b0 2024-09-10T22:01:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.607+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c1a1090 con 0x7f3e2c1029b0 2024-09-10T22:01:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.607+0000 7f3e29ffb640 1 -- 172.21.15.39:0/711818503 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c049060 con 0x7f3e2c1029b0 2024-09-10T22:01:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.609+0000 7f3e29ffb640 1 -- 172.21.15.39:0/711818503 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3e1c003800 con 0x7f3e2c1029b0 2024-09-10T22:01:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 Processor -- start 2024-09-10T22:01:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 -- start start 2024-09-10T22:01:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ba90256f0 con 0x561ba90b3860 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba9014b20 con 0x561ba90b8bd0 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ba9018930 con 0x561ba90b6190 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e314ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e314ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50992/0 (socket says 172.21.15.39:50992) 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.610+0000 7f3e314ab640 1 -- 172.21.15.39:0/4250302962 learned_addr learned my addr 172.21.15.39:0/4250302962 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 -- 172.21.15.39:0/4250302962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 msgr2=0x561ba90b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 -- 172.21.15.39:0/4250302962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 msgr2=0x561ba90bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 -- 172.21.15.39:0/4250302962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba8fda530 con 0x561ba90b3860 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e314ab640 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009ca0 tx=0x7f3e14011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85f9a6cb7ab34d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e22ffd640 1 -- 172.21.15.39:0/4250302962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401e070 con 0x561ba90b3860 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e22ffd640 1 -- 172.21.15.39:0/4250302962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e14009e50 con 0x561ba90b3860 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e22ffd640 1 -- 172.21.15.39:0/4250302962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400e9f0 con 0x561ba90b3860 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e29ffb640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.611+0000 7f3e30caa640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e29ffb640 1 -- 172.21.15.39:0/711818503 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3e1c106820 con 0x7f3e2c1029b0 2024-09-10T22:01:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4250302962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 msgr2=0x561ba90b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e30caa640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 0x7f3e180b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007f60 tx=0x7f3e240075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009ca0 tx=0x7f3e14011810 comp rx=0 tx=0).stop 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4250302962 shutdown_connections 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4250302962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b5c50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4250302962 >> 172.21.15.39:0/4250302962 conn(0x561ba90ae9b0 msgr2=0x561ba90af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4250302962 shutdown_connections 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4250302962 wait complete. 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 -- start start 2024-09-10T22:01:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.612+0000 7f3e35cdc740 1 Processor -- start 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561ba8f4cab0 con 0x561ba90b6190 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba8fba730 con 0x561ba90b8bd0 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ba90bbbb0 con 0x561ba90b3860 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e35cdc740 10 client.0 _ll_register_callbacks cb 0x561ba900e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51002/0 (socket says 172.21.15.39:51002) 2024-09-10T22:01:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4163603390 learned_addr learned my addr 172.21.15.39:0/4163603390 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e314ab640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4163603390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 msgr2=0x561ba90bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 msgr2=0x561ba90be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4163603390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba8d76790 con 0x561ba90b6190 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.613+0000 7f3e314ab640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c004650 tx=0x7f3e1c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8e385e25f87f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c035030 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3e1c0cd4e0 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e14009e50 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0c8f20 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 10 client.17037 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561ba8def620 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e14009e50 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f3e1c0d60d0 con 0x561ba90b6190 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 10 client.17037 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 20 client.17037 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba90c87f0 0x561ba90cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 4 client.17037 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.614+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ba9027640 con 0x561ba90c87f0 2024-09-10T22:01:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.615+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba90c87f0 0x561ba90cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.615+0000 7f3e0bfff640 10 client.17037 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.615+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba90c87f0 0x561ba90cabe0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae5481a5a2f340f server_cookie=2ea757391e0214a1 in_seq=0 out_seq=0 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.616+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4163603390 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ba9027640 con 0x561ba90c87f0 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.616+0000 7f3e0bfff640 10 client.17037 handle_command_reply: tid=0 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 client.17037 shutdown 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 msgr2=0x561ba90bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c004650 tx=0x7f3e1c009620 comp rx=0 tx=0).stop 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 shutdown_connections 2024-09-10T22:01:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba90c87f0 0x561ba90cabe0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e0bfff640 0 client.17037 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b6190 0x561ba90bd5c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4163603390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 >> 172.21.15.39:0/4163603390 conn(0x561ba90ae9b0 msgr2=0x561ba90adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 shutdown_connections 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4163603390 wait complete. 2024-09-10T22:01:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.617+0000 7f3e35cdc740 20 client.17037 trim_cache size 0 max 16384 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.631+0000 7f3e35cdc740 1 Processor -- start 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.631+0000 7f3e35cdc740 1 -- start start 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1a9df0 con 0x561ba90b3860 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1ab9f0 con 0x561ba90b8bd0 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1aa4f0 con 0x561ba90b6190 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e30caa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53986/0 (socket says 172.21.15.39:53986) 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 -- 172.21.15.39:0/1511925845 learned_addr learned my addr 172.21.15.39:0/1511925845 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 -- 172.21.15.39:0/1511925845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 msgr2=0x561ba90b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 -- 172.21.15.39:0/1511925845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 msgr2=0x561ba90b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 -- 172.21.15.39:0/1511925845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba90b5fc0 con 0x561ba90b8bd0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e314ab640 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e140058c0 tx=0x7f3e14009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e1f06fb95a4395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.632+0000 7f3e227fc640 1 -- 172.21.15.39:0/1511925845 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14029020 con 0x561ba90b8bd0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e227fc640 1 -- 172.21.15.39:0/1511925845 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1401f040 con 0x561ba90b8bd0 2024-09-10T22:01:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e227fc640 1 -- 172.21.15.39:0/1511925845 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401e040 con 0x561ba90b8bd0 2024-09-10T22:01:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 -- 172.21.15.39:0/1511925845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 msgr2=0x561ba90bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e140058c0 tx=0x7f3e14009680 comp rx=0 tx=0).stop 2024-09-10T22:01:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 -- 172.21.15.39:0/1511925845 shutdown_connections 2024-09-10T22:01:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b8bd0 0x561ba90bc160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b6190 0x561ba90b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/1511925845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b3860 0x561ba90b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 -- 172.21.15.39:0/1511925845 >> 172.21.15.39:0/1511925845 conn(0x561ba90ae9b0 msgr2=0x561ba90b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 -- 172.21.15.39:0/1511925845 shutdown_connections 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.633+0000 7f3e35cdc740 1 -- 172.21.15.39:0/1511925845 wait complete. 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 -- start start 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 Processor -- start 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b8bd0 0x561ba90c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1ab2f0 con 0x561ba90b8bd0 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1aabf0 con 0x561ba90b6190 2024-09-10T22:01:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1a7dd0 con 0x561ba90b3860 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e35cdc740 10 client.0 _ll_register_callbacks cb 0x7f3e1c10c220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e314ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b8bd0 0x561ba90c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53994/0 (socket says 172.21.15.39:53994) 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4154445255 learned_addr learned my addr 172.21.15.39:0/4154445255 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.634+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4154445255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 msgr2=0x561ba90c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4154445255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b8bd0 msgr2=0x561ba90c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b8bd0 0x561ba90c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 -- 172.21.15.39:0/4154445255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba90c3f90 con 0x561ba90b6190 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e2bfff640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c106c20 tx=0x7f3e1c0cd510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6e01ea8cc997d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0b8020 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f3e1c0cc4f0 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1401f040 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c035040 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e35cdc740 10 client.26660 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561ba90c2d00 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.635+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1401f040 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f3e1c0b81c0 con 0x561ba90b6190 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 10 client.26660 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 10 client.26660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 20 client.26660 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba9135b80 0x561ba9137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 4 client.26660 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:01:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ba90230f0 con 0x561ba9135b80 2024-09-10T22:01:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba9135b80 0x561ba9137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e30caa640 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba9135b80 0x561ba9137fa0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22d7ac746fc5820 server_cookie=b82a5bcee93c40ef in_seq=0 out_seq=0 2024-09-10T22:01:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:48.636+0000 7f3e0bfff640 10 client.26660 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e0bfff640 1 -- 172.21.15.39:0/4154445255 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ba90230f0 con 0x561ba9135b80 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e0bfff640 10 client.26660 handle_command_reply: tid=0 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 client.26660 shutdown 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 msgr2=0x561ba90c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c106c20 tx=0x7f3e1c0cd510 comp rx=0 tx=0).stop 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 shutdown_connections 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x561ba9135b80 0x561ba9137fa0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e0bfff640 0 client.26660 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ba90b8bd0 0x561ba90c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba90b6190 0x561ba90c3490 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 --2- 172.21.15.39:0/4154445255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ba90b3860 0x561ba90c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 >> 172.21.15.39:0/4154445255 conn(0x561ba90ae9b0 msgr2=0x561ba90b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 shutdown_connections 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 1 -- 172.21.15.39:0/4154445255 wait complete. 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.132+0000 7f3e35cdc740 20 client.26660 trim_cache size 0 max 16384 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:01:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:01:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:01:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 msgr2=0x7f3e180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 0x7f3e180b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007f60 tx=0x7f3e240075b0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 msgr2=0x7f3e2c19d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009a50 tx=0x7f3e1c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 shutdown_connections 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e2c103370 0x7f3e2c1a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e2c1029b0 0x7f3e2c19d9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 --2- 172.21.15.39:0/711818503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e2c101860 0x7f3e2c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 >> 172.21.15.39:0/711818503 conn(0x7f3e2c0fd140 msgr2=0x7f3e2c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 shutdown_connections 2024-09-10T22:01:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:01:49.133+0000 7f3e32f0e640 1 -- 172.21.15.39:0/711818503 wait complete. 2024-09-10T22:01:49.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:48 smithi070 ceph-mon[34909]: pgmap v545: 97 pgs: 97 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T22:01:49.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:48 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:48 smithi039 ceph-mon[30872]: pgmap v545: 97 pgs: 97 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T22:01:49.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:48 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:48 smithi173 ceph-mon[35294]: pgmap v545: 97 pgs: 97 active+clean; 208 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 849 op/s 2024-09-10T22:01:49.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:48 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:01:51.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:50 smithi070 ceph-mon[34909]: pgmap v546: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 852 op/s 2024-09-10T22:01:51.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:50 smithi039 ceph-mon[30872]: pgmap v546: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 852 op/s 2024-09-10T22:01:51.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:50 smithi173 ceph-mon[35294]: pgmap v546: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 852 op/s 2024-09-10T22:01:53.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:52 smithi070 ceph-mon[34909]: pgmap v547: 97 pgs: 97 active+clean; 187 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 649 op/s 2024-09-10T22:01:53.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:52 smithi039 ceph-mon[30872]: pgmap v547: 97 pgs: 97 active+clean; 187 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 649 op/s 2024-09-10T22:01:53.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:52 smithi173 ceph-mon[35294]: pgmap v547: 97 pgs: 97 active+clean; 187 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 649 op/s 2024-09-10T22:01:54.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:01:54.812 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:54.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:54 smithi039 ceph-mon[30872]: pgmap v548: 97 pgs: 97 active+clean; 149 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 776 op/s 2024-09-10T22:01:55.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:54 smithi070 ceph-mon[34909]: pgmap v548: 97 pgs: 97 active+clean; 149 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 776 op/s 2024-09-10T22:01:55.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:54 smithi173 ceph-mon[35294]: pgmap v548: 97 pgs: 97 active+clean; 149 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 776 op/s 2024-09-10T22:01:55.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- 172.21.15.39:0/674759558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88109150 msgr2=0x7f2c8810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/674759558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88109150 0x7f2c8810f950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009ca0 tx=0x7f2c7802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- 172.21.15.39:0/674759558 shutdown_connections 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/674759558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88109150 0x7f2c8810f950 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/674759558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 0x7f2c88108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/674759558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88102dc0 0x7f2c881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- 172.21.15.39:0/674759558 >> 172.21.15.39:0/674759558 conn(0x7f2c880fe830 msgr2=0x7f2c88100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- 172.21.15.39:0/674759558 shutdown_connections 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- 172.21.15.39:0/674759558 wait complete. 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 Processor -- start 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.460+0000 7f2c8d8be640 1 -- start start 2024-09-10T22:01:55.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 0x7f2c881997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88109150 0x7f2c8819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88112dd0 con 0x7f2c88102dc0 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88112c50 con 0x7f2c88109150 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8d8be640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88112f50 con 0x7f2c881087d0 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41846/0 (socket says 172.21.15.39:41846) 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3684131834 learned_addr learned my addr 172.21.15.39:0/3684131834 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88109150 0x7f2c8819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 0x7f2c881997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3684131834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 msgr2=0x7f2c881997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 0x7f2c881997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3684131834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88109150 msgr2=0x7f2c8819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88109150 0x7f2c8819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3684131834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8819f310 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000e9f0 tx=0x7f2c8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8c8bc640 1 -- 172.21.15.39:0/3684131834 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000cd80 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.461+0000 7f2c8c8bc640 1 -- 172.21.15.39:0/3684131834 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c800108e0 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.462+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8819f600 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.462+0000 7f2c8c8bc640 1 -- 172.21.15.39:0/3684131834 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80018980 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.462+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881a5cc0 con 0x7f2c88102dc0 2024-09-10T22:01:55.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 Processor -- start 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 -- start start 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8c8bc640 1 -- 172.21.15.39:0/3684131834 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2c80010430 con 0x7f2c88102dc0 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5608669dce50 con 0x560866a72d30 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5608669cc280 con 0x560866a66480 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5608669d0090 con 0x560866a66da0 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c867fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c867fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41862/0 (socket says 172.21.15.39:41862) 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34576/0 (socket says 172.21.15.39:34576) 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c867fc640 1 -- 172.21.15.39:0/130156941 learned_addr learned my addr 172.21.15.39:0/130156941 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:55.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.465+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c8c8bc640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 0x7f2c740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c8c8bc640 1 -- 172.21.15.39:0/3684131834 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2c800e5f60 con 0x7f2c88102dc0 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c877fe640 1 -- 172.21.15.39:0/130156941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 msgr2=0x560866a727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c877fe640 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c877fe640 1 -- 172.21.15.39:0/130156941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 msgr2=0x560866a75120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c877fe640 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c877fe640 1 -- 172.21.15.39:0/130156941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086672a650 con 0x560866a66480 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.466+0000 7f2c867fc640 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.467+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 0x7f2c740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.467+0000 7f2c877fe640 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c78005e30 tx=0x7f2c78005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b515ab606efb848 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.467+0000 7f2c7dffb640 1 -- 172.21.15.39:0/130156941 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78042030 con 0x560866a66480 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.467+0000 7f2c7dffb640 1 -- 172.21.15.39:0/130156941 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c78036070 con 0x560866a66480 2024-09-10T22:01:55.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.467+0000 7f2c7dffb640 1 -- 172.21.15.39:0/130156941 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780045f0 con 0x560866a66480 2024-09-10T22:01:55.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- 172.21.15.39:0/130156941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 msgr2=0x560866a66860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 0x7f2c740b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c7804c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c78005e30 tx=0x7f2c78005fa0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- 172.21.15.39:0/130156941 shutdown_connections 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/130156941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a66860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- 172.21.15.39:0/130156941 >> 172.21.15.39:0/130156941 conn(0x560866a642b0 msgr2=0x560866a65450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- 172.21.15.39:0/130156941 shutdown_connections 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- 172.21.15.39:0/130156941 wait complete. 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.468+0000 7f2c8fc93740 1 -- start start 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 Processor -- start 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a72640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a72d30 0x560866a700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56086682d700 con 0x560866a66da0 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560866967110 con 0x560866a66480 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560866a75950 con 0x560866a72d30 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c8fc93740 10 client.0 _ll_register_callbacks cb 0x560866980990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c867fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a72640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c867fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41874/0 (socket says 172.21.15.39:41874) 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c867fc640 1 -- 172.21.15.39:0/3831479582 learned_addr learned my addr 172.21.15.39:0/3831479582 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a72d30 0x560866a700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3831479582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a72d30 msgr2=0x560866a700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a72d30 0x560866a700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3831479582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 msgr2=0x560866a6fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3831479582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560866994c40 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.469+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a72640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c800e3ac0 tx=0x7f2c80009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d09cc08e83df50a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800ac500 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2c800b5830 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c78036070 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2c800abea0 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 10 client.26672 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560866a812b0 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c78036070 con 0x560866a66480 2024-09-10T22:01:55.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f2c80018b20 con 0x560866a66480 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 10 client.26672 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 20 client.26672 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866a82600 0x560866a84a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 4 client.26672 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.470+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608669deda0 con 0x560866a82600 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.471+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866a82600 0x560866a84a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.471+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866a82600 0x560866a84a30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f683db98bb8780c server_cookie=2096a3f98174b759 in_seq=0 out_seq=0 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.471+0000 7f2c66ffd640 10 client.26672 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3831479582 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608669deda0 con 0x560866a82600 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c66ffd640 10 client.26672 handle_command_reply: tid=0 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 client.26672 shutdown 2024-09-10T22:01:55.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 msgr2=0x560866a72640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a72640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c800e3ac0 tx=0x7f2c80009310 comp rx=0 tx=0).stop 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 shutdown_connections 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866a82600 0x560866a84a30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a72d30 0x560866a700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66da0 0x560866a6fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3831479582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66480 0x560866a72640 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 >> 172.21.15.39:0/3831479582 conn(0x560866a642b0 msgr2=0x560866a69e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c66ffd640 0 client.26672 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 shutdown_connections 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3831479582 wait complete. 2024-09-10T22:01:55.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.472+0000 7f2c8fc93740 20 client.26672 trim_cache size 0 max 16384 2024-09-10T22:01:55.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 Processor -- start 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 -- start start 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a74120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881ae3b0 con 0x560866a66480 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881affb0 con 0x560866a72d30 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881aeab0 con 0x560866a66da0 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c86ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34596/0 (socket says 172.21.15.39:34596) 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c877fe640 1 -- 172.21.15.39:0/3665156298 learned_addr learned my addr 172.21.15.39:0/3665156298 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.490+0000 7f2c86ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41882/0 (socket says 172.21.15.39:41882) 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a74120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3665156298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 msgr2=0x560866a74120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a74120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3665156298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 msgr2=0x560866a74660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 -- 172.21.15.39:0/3665156298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560866a6f840 con 0x560866a66480 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000c6a0 tx=0x7f2c80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11ad1c96b1d839a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c7d7fa640 1 -- 172.21.15.39:0/3665156298 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800ac080 con 0x560866a66480 2024-09-10T22:01:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c7d7fa640 1 -- 172.21.15.39:0/3665156298 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c800ac240 con 0x560866a66480 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.491+0000 7f2c7d7fa640 1 -- 172.21.15.39:0/3665156298 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800b5a90 con 0x560866a66480 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3665156298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 msgr2=0x560866a7eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000c6a0 tx=0x7f2c80000bc0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3665156298 shutdown_connections 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a72d30 0x560866a74660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66da0 0x560866a74120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3665156298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a66480 0x560866a7eb80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3665156298 >> 172.21.15.39:0/3665156298 conn(0x560866a642b0 msgr2=0x560866a6aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3665156298 shutdown_connections 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3665156298 wait complete. 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 -- start start 2024-09-10T22:01:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.492+0000 7f2c8fc93740 1 Processor -- start 2024-09-10T22:01:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66480 0x560866a7abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 0x560866a7b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881af8b0 con 0x560866a72d30 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881af1b0 con 0x560866a66da0 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881ac390 con 0x560866a66480 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c8fc93740 10 client.0 _ll_register_callbacks cb 0x7f2c80009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 0x560866a7b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41894/0 (socket says 172.21.15.39:41894) 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c877fe640 1 -- 172.21.15.39:0/3055920617 learned_addr learned my addr 172.21.15.39:0/3055920617 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66480 0x560866a7abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 -- 172.21.15.39:0/3055920617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66480 msgr2=0x560866a7abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66480 0x560866a7abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 -- 172.21.15.39:0/3055920617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 msgr2=0x560866a75ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c867fc640 1 -- 172.21.15.39:0/3055920617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560866a7b870 con 0x560866a66da0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.493+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c867fc640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 0x560866a7b130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x560866a70bb0 tx=0x7f2c70004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ead90027edd24698 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70022040 con 0x560866a66da0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f2c700037f0 con 0x560866a66da0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c800ac240 con 0x560866a66da0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2c70003a10 con 0x560866a66da0 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 10 client.26678 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560866aefa70 con 0x560866a66da0 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c800ac240 con 0x560866a66da0 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f2c7002e030 con 0x560866a66da0 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 10 client.26678 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 10 client.26678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 20 client.26678 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.494+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866af0220 0x560866af2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.495+0000 7f2c8fc93740 4 client.26678 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.495+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608669da850 con 0x560866af0220 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.495+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866af0220 0x560866af2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.495+0000 7f2c66ffd640 10 client.26678 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.495+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866af0220 0x560866af2640 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=180ad029fba60474 server_cookie=568e8baff6b0d042 in_seq=0 out_seq=0 2024-09-10T22:01:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.496+0000 7f2c66ffd640 1 -- 172.21.15.39:0/3055920617 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x5608669da850 con 0x560866af0220 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.496+0000 7f2c66ffd640 10 client.26678 handle_command_reply: tid=0 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.496+0000 7f2c8fc93740 1 client.26678 shutdown 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 msgr2=0x560866a7b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 0x560866a7b130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x560866a70bb0 tx=0x7f2c70004410 comp rx=0 tx=0).stop 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 shutdown_connections 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x560866af0220 0x560866af2640 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560866a72d30 0x560866a75ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560866a66da0 0x560866a7b130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c66ffd640 0 client.26678 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 --2- 172.21.15.39:0/3055920617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560866a66480 0x560866a7abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 >> 172.21.15.39:0/3055920617 conn(0x560866a642b0 msgr2=0x560866a710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 shutdown_connections 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 1 -- 172.21.15.39:0/3055920617 wait complete. 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8fc93740 20 client.26678 trim_cache size 0 max 16384 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {}, 2024-09-10T22:01:55.505 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_stats": { 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "a08bf2b3-c577-4804-9533-3881b07a580c": { 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:51.398920+0000", 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "c9ad0434-0dcf-46ca-8153-3fbeae3f53d2": { 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:01:21.978404+0000", 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.506 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "956ae779-ac12-4a63-9d38-bbcac731e7fd": { 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T22:00:35.416798+0000", 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "fc795747-d38b-48fe-bda3-35a3a262b0df": { 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:58:03.244362+0000", 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.507 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "998a7b51-518d-4b13-8ae6-f313900d2c62": { 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:57:15.858781+0000", 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "cdad3e47-0931-4e6b-b03c-92695a6a8296": { 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:56:25.752281+0000", 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.509 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "70562817-5291-43eb-866f-3b35e96de93b": { 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:55:39.136676+0000", 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "09a36bc9-4bdd-4e7e-a30c-266a8ca018c1": { 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:59:46.497268+0000", 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: "916b7da7-e8ca-4525-bb53-e5deafacaea3": { 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: "start_time": "2024-09-10T21:54:53.675036+0000", 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-10T22:01:55.511 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:01:55.512 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_passed": 0, 2024-09-10T22:01:55.512 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_failed": 0, 2024-09-10T22:01:55.512 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_skipped": 0 2024-09-10T22:01:55.512 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:55.512 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:01:55.513 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:01:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 msgr2=0x7f2c740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 0x7f2c740b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c7804c000 comp rx=0 tx=0).stop 2024-09-10T22:01:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 msgr2=0x7f2c88199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000e9f0 tx=0x7f2c8000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 shutdown_connections 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2c740b52e0 0x7f2c740b77a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c88109150 0x7f2c8819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c881087d0 0x7f2c881997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 --2- 172.21.15.39:0/3684131834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c88102dc0 0x7f2c88199260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.497+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 >> 172.21.15.39:0/3684131834 conn(0x7f2c880fe830 msgr2=0x7f2c88100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.498+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 shutdown_connections 2024-09-10T22:01:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:55.498+0000 7f2c8d8be640 1 -- 172.21.15.39:0/3684131834 wait complete. 2024-09-10T22:01:56.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:01:56.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:01:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:56.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:56 smithi039 ceph-mon[30872]: pgmap v549: 97 pgs: 97 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 537 op/s 2024-09-10T22:01:57.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:56 smithi070 ceph-mon[34909]: pgmap v549: 97 pgs: 97 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 537 op/s 2024-09-10T22:01:57.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.166+0000 7f3087570640 1 -- 172.21.15.39:0/159925173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 msgr2=0x7f3080102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.166+0000 7f3087570640 1 --2- 172.21.15.39:0/159925173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f3080102070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f307c009900 tx=0x7f307c02a410 comp rx=0 tx=0).stop 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 -- 172.21.15.39:0/159925173 shutdown_connections 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 --2- 172.21.15.39:0/159925173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3080108020 0x7f308010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 --2- 172.21.15.39:0/159925173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801076a0 0x7f3080107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 --2- 172.21.15.39:0/159925173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f3080102070 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 -- 172.21.15.39:0/159925173 >> 172.21.15.39:0/159925173 conn(0x7f30800fd700 msgr2=0x7f30800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 -- 172.21.15.39:0/159925173 shutdown_connections 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 -- 172.21.15.39:0/159925173 wait complete. 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 Processor -- start 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 -- start start 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.167+0000 7f3087570640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3087570640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30801076a0 0x7f308019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:57.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3087570640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 0x7f308019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3087570640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111ce0 con 0x7f3080101c90 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3087570640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111b60 con 0x7f3080108020 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3087570640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111e60 con 0x7f30801076a0 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41906/0 (socket says 172.21.15.39:41906) 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 -- 172.21.15.39:0/629828871 learned_addr learned my addr 172.21.15.39:0/629828871 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3085b0d640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 0x7f308019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3084b0b640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30801076a0 0x7f308019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 -- 172.21.15.39:0/629828871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30801076a0 msgr2=0x7f308019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30801076a0 0x7f308019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 -- 172.21.15.39:0/629828871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 msgr2=0x7f308019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:57.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 0x7f308019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 -- 172.21.15.39:0/629828871 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30801a5550 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f3085b0d640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 0x7f308019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f308530c640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f307c005940 tx=0x7f307c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.168+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c03f030 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.169+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f307c003aa0 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.169+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30801a57e0 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.169+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c035070 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.169+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30801a5cc0 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.170+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3080102070 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.171+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f307c03bcc0 con 0x7f3080101c90 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.172+0000 7f30767fc640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 0x7f306c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.172+0000 7f3084b0b640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 0x7f306c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:57.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.172+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f307c106510 con 0x7f3080101c90 2024-09-10T22:01:57.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.172+0000 7f3084b0b640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 0x7f306c0b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f308006b6d0 tx=0x7f3070005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:57.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.176+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f307c0ccd90 con 0x7f3080101c90 2024-09-10T22:01:57.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:56 smithi173 ceph-mon[35294]: pgmap v549: 97 pgs: 97 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 537 op/s 2024-09-10T22:01:57.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.415+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f308002e5c0 con 0x7f3080101c90 2024-09-10T22:01:57.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.416+0000 7f30767fc640 1 -- 172.21.15.39:0/629828871 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11978 (secure 0 0 0) 0x7f307c0d17c0 con 0x7f3080101c90 2024-09-10T22:01:57.419 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:01:57.419 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":37,"btime":"2024-09-10T22:01:47:755071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T22:01:47.306395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/4263006579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4263006579},{"type":"v1","addr":"172.21.15.70:6835","nonce":4263006579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24550,24563,24562,24583,24590]},"id":1}]} 2024-09-10T22:01:57.419 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 37 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 msgr2=0x7f306c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 0x7f306c0b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f308006b6d0 tx=0x7f3070005f90 comp rx=0 tx=0).stop 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 msgr2=0x7f308019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f307c005940 tx=0x7f307c004270 comp rx=0 tx=0).stop 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 shutdown_connections 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f306c0b52e0 0x7f306c0b77a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080108020 0x7f308019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30801076a0 0x7f308019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 --2- 172.21.15.39:0/629828871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3080101c90 0x7f308019a150 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:57.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 >> 172.21.15.39:0/629828871 conn(0x7f30800fd700 msgr2=0x7f3080105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:57.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 shutdown_connections 2024-09-10T22:01:57.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:57.418+0000 7f3087570640 1 -- 172.21.15.39:0/629828871 wait complete. 2024-09-10T22:01:57.958 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:57 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/629828871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:58.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T22:01:58.056 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:57 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/629828871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:58.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:57 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/629828871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:01:58.290 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:01:58.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- 172.21.15.39:0/2961811797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7681076a0 msgr2=0x7fb768107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/2961811797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7681076a0 0x7fb768107ae0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009ca0 tx=0x7fb75c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- 172.21.15.39:0/2961811797 shutdown_connections 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/2961811797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb768108020 0x7fb76810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/2961811797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7681076a0 0x7fb768107ae0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/2961811797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768101c90 0x7fb768102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- 172.21.15.39:0/2961811797 >> 172.21.15.39:0/2961811797 conn(0x7fb7680fd700 msgr2=0x7fb7680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- 172.21.15.39:0/2961811797 shutdown_connections 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- 172.21.15.39:0/2961811797 wait complete. 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 Processor -- start 2024-09-10T22:01:58.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.729+0000 7fb76ffb0640 1 -- start start 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7681076a0 0x7fb768199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768108020 0x7fb76819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb768111ca0 con 0x7fb768101c90 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb768111b20 con 0x7fb768108020 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76ffb0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb768111e20 con 0x7fb7681076a0 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41920/0 (socket says 172.21.15.39:41920) 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 -- 172.21.15.39:0/1903571139 learned_addr learned my addr 172.21.15.39:0/1903571139 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768108020 0x7fb76819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7681076a0 0x7fb768199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 -- 172.21.15.39:0/1903571139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7681076a0 msgr2=0x7fb768199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7681076a0 0x7fb768199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 -- 172.21.15.39:0/1903571139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768108020 msgr2=0x7fb76819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768108020 0x7fb76819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 -- 172.21.15.39:0/1903571139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76819f370 con 0x7fb768101c90 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.730+0000 7fb76dd4c640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb75800d950 tx=0x7fb75800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.731+0000 7fb766ffd640 1 -- 172.21.15.39:0/1903571139 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758017030 con 0x7fb768101c90 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.731+0000 7fb766ffd640 1 -- 172.21.15.39:0/1903571139 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb758004020 con 0x7fb768101c90 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.731+0000 7fb766ffd640 1 -- 172.21.15.39:0/1903571139 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580047a0 con 0x7fb768101c90 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.731+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76819f660 con 0x7fb768101c90 2024-09-10T22:01:58.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.731+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7681a5ef0 con 0x7fb768101c90 2024-09-10T22:01:58.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.733+0000 7fb772385740 1 Processor -- start 2024-09-10T22:01:58.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.733+0000 7fb772385740 1 -- start start 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb766ffd640 1 -- 172.21.15.39:0/1903571139 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb758009a30 con 0x7fb768101c90 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db91279460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db912799a0 0x55db9127bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55db911e3ea0 con 0x55db9126da10 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db911d32d0 con 0x55db9126d0f0 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb772385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55db911d70e0 con 0x55db912799a0 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76dd4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db91279460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34644/0 (socket says 172.21.15.39:34644) 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 -- 172.21.15.39:0/1191637356 learned_addr learned my addr 172.21.15.39:0/1191637356 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:58.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db912799a0 0x55db9127bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 -- 172.21.15.39:0/1191637356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db912799a0 msgr2=0x55db9127bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db912799a0 0x55db9127bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 -- 172.21.15.39:0/1191637356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 msgr2=0x55db91279460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db91279460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.734+0000 7fb76e54d640 1 -- 172.21.15.39:0/1191637356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db90f31650 con 0x55db9126d0f0 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b6b0 tx=0x7fb760004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e53d3aca9c540d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb74ffff640 1 -- 172.21.15.39:0/1191637356 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760003b20 con 0x55db9126d0f0 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb74ffff640 1 -- 172.21.15.39:0/1191637356 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb760015070 con 0x55db9126d0f0 2024-09-10T22:01:58.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb74ffff640 1 -- 172.21.15.39:0/1191637356 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760011640 con 0x55db9126d0f0 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb766ffd640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 0x7fb7500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb76dd4c640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 0x7fb7500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb766ffd640 1 -- 172.21.15.39:0/1903571139 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb7580e5570 con 0x7fb768101c90 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb76dd4c640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 0x7fb7500b7820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55db9126be00 tx=0x7fb7580eb0e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb772385740 1 -- 172.21.15.39:0/1191637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 msgr2=0x55db9126d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.735+0000 7fb772385740 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b6b0 tx=0x7fb760004610 comp rx=0 tx=0).stop 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 -- 172.21.15.39:0/1191637356 shutdown_connections 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db912799a0 0x55db9127bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db91279460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 --2- 172.21.15.39:0/1191637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db9126d4d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 -- 172.21.15.39:0/1191637356 >> 172.21.15.39:0/1191637356 conn(0x55db9126af20 msgr2=0x55db9126c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 -- 172.21.15.39:0/1191637356 shutdown_connections 2024-09-10T22:01:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 -- 172.21.15.39:0/1191637356 wait complete. 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 -- start start 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.736+0000 7fb772385740 1 Processor -- start 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db91279240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 0x55db91276690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db91276c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55db91034700 con 0x55db912799a0 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db9116e160 con 0x55db9126d0f0 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55db9127c620 con 0x55db9126da10 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb772385740 10 client.0 _ll_register_callbacks cb 0x55db911879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db91279240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db91279240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:34654/0 (socket says 172.21.15.39:34654) 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76e54d640 1 -- 172.21.15.39:0/4264768691 learned_addr learned my addr 172.21.15.39:0/4264768691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:58.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 0x55db91276690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76e54d640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db91276c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 -- 172.21.15.39:0/4264768691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 msgr2=0x55db91279240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db91279240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 -- 172.21.15.39:0/4264768691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 msgr2=0x55db91276c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db91276c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.737+0000 7fb76d54b640 1 -- 172.21.15.39:0/4264768691 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db9119bc90 con 0x55db9126da10 2024-09-10T22:01:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb76d54b640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 0x55db91276690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000f80 tx=0x7fb75c031450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3426f0a880688300 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb74d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c031810 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb75c003970 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb760015070 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb75c003b70 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb772385740 10 client.26575 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55db91287f40 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.738+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb760015070 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fb75c02f6f0 con 0x55db9126da10 2024-09-10T22:01:58.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 10 client.26575 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 10 client.26575 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 20 client.26575 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db91289410 0x55db9128b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 4 client.26575 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db911e5df0 con 0x55db91289410 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb76e54d640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db91289410 0x55db9128b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb74d7fa640 10 client.26575 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.739+0000 7fb76e54d640 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db91289410 0x55db9128b820 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9501c689fb1e6647 server_cookie=905ed108c062673c in_seq=0 out_seq=0 2024-09-10T22:01:58.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb74d7fa640 1 -- 172.21.15.39:0/4264768691 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db911e5df0 con 0x55db91289410 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb74d7fa640 10 client.26575 handle_command_reply: tid=0 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 client.26575 shutdown 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 msgr2=0x55db91276690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 0x55db91276690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000f80 tx=0x7fb75c031450 comp rx=0 tx=0).stop 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 shutdown_connections 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db91289410 0x55db9128b820 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db91276c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126da10 0x55db91276690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb74d7fa640 0 client.26575 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 --2- 172.21.15.39:0/4264768691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126d0f0 0x55db91279240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 >> 172.21.15.39:0/4264768691 conn(0x55db9126af20 msgr2=0x55db91270ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 shutdown_connections 2024-09-10T22:01:58.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 1 -- 172.21.15.39:0/4264768691 wait complete. 2024-09-10T22:01:58.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.740+0000 7fb772385740 20 client.26575 trim_cache size 0 max 16384 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.753+0000 7fb772385740 1 Processor -- start 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.753+0000 7fb772385740 1 -- start start 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db9126a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db912799a0 0x55db9127ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681ae380 con 0x55db9126da10 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681aff80 con 0x55db912799a0 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb772385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681aea80 con 0x55db9126d0f0 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db912799a0 0x55db9127ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41958/0 (socket says 172.21.15.39:41958) 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 -- 172.21.15.39:0/1253119287 learned_addr learned my addr 172.21.15.39:0/1253119287 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db9126a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 -- 172.21.15.39:0/1253119287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 msgr2=0x55db9126a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db9126a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 -- 172.21.15.39:0/1253119287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db912799a0 msgr2=0x55db9127ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db912799a0 0x55db9127ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 -- 172.21.15.39:0/1253119287 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db9126bc00 con 0x55db9126da10 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db9126a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.754+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009bf0 tx=0x7fb75c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391fb91a3ee4cf0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb74f7fe640 1 -- 172.21.15.39:0/1253119287 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c005bf0 con 0x55db9126da10 2024-09-10T22:01:58.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb74f7fe640 1 -- 172.21.15.39:0/1253119287 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb75c036050 con 0x55db9126da10 2024-09-10T22:01:58.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb74f7fe640 1 -- 172.21.15.39:0/1253119287 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c030a70 con 0x55db9126da10 2024-09-10T22:01:58.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 -- 172.21.15.39:0/1253119287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 msgr2=0x55db912783d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009bf0 tx=0x7fb75c005de0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 -- 172.21.15.39:0/1253119287 shutdown_connections 2024-09-10T22:01:58.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db912799a0 0x55db9127ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db9126da10 0x55db912783d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 --2- 172.21.15.39:0/1253119287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db9126a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 -- 172.21.15.39:0/1253119287 >> 172.21.15.39:0/1253119287 conn(0x55db9126af20 msgr2=0x55db91277cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 -- 172.21.15.39:0/1253119287 shutdown_connections 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.755+0000 7fb772385740 1 -- 172.21.15.39:0/1253119287 wait complete. 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 -- start start 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 Processor -- start 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db91281ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126da10 0x55db91282010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681af880 con 0x55db912799a0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681af180 con 0x55db9126da10 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7681ac360 con 0x55db9126d0f0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb772385740 10 client.0 _ll_register_callbacks cb 0x7fb75c02f3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb76e54d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41962/0 (socket says 172.21.15.39:41962) 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb76e54d640 1 -- 172.21.15.39:0/1722276335 learned_addr learned my addr 172.21.15.39:0/1722276335 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126da10 0x55db91282010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.756+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db91281ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 -- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 msgr2=0x55db91281ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db91281ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 -- 172.21.15.39:0/1722276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126da10 msgr2=0x55db91282010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126da10 0x55db91282010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 -- 172.21.15.39:0/1722276335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db9127cfe0 con 0x55db912799a0 2024-09-10T22:01:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb76e54d640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb7600045e0 tx=0x7fb760004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f973bb4c54501ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb74d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760023040 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fb76001a9d0 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb75c036050 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb760003920 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb772385740 10 client.17085 fetch_fsmap learned FSMap version 37 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55db912f6d30 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.757+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb75c036050 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fb760011c60 con 0x55db912799a0 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 10 client.17085 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:01:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 10 client.17085 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 20 client.17085 populate_metadata read hostname 'smithi039' 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db912f72c0 0x55db912f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 4 client.17085 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 --> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db911e18a0 con 0x55db912f72c0 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db912f72c0 0x55db912f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb76d54b640 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db912f72c0 0x55db912f96e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=445ca85c2cf10b50 server_cookie=21d960e4856b9592 in_seq=0 out_seq=0 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.758+0000 7fb74d7fa640 10 client.17085 ms_handle_connect on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb74d7fa640 1 -- 172.21.15.39:0/1722276335 <== mds.4 v2:172.21.15.173:6834/1204968390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db911e18a0 con 0x55db912f72c0 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb74d7fa640 10 client.17085 handle_command_reply: tid=0 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 client.17085 shutdown 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 msgr2=0x55db9127c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb7600045e0 tx=0x7fb760004610 comp rx=0 tx=0).stop 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 shutdown_connections 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:6834/1204968390,v1:172.21.15.173:6835/1204968390] conn(0x55db912f72c0 0x55db912f96e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db912799a0 0x55db9127c8a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db9126da10 0x55db91282010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 --2- 172.21.15.39:0/1722276335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db9126d0f0 0x55db91281ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb74d7fa640 0 client.17085 ms_handle_reset on v2:172.21.15.173:6834/1204968390 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 >> 172.21.15.39:0/1722276335 conn(0x55db9126af20 msgr2=0x55db912784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 shutdown_connections 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 1 -- 172.21.15.39:0/1722276335 wait complete. 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.759+0000 7fb772385740 20 client.17085 trim_cache size 0 max 16384 2024-09-10T22:01:58.766 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 msgr2=0x7fb7500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 0x7fb7500b7820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55db9126be00 tx=0x7fb7580eb0e0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 msgr2=0x7fb7681992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb75800d950 tx=0x7fb75800de10 comp rx=0 tx=0).stop 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 shutdown_connections 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb7500b5360 0x7fb7500b7820 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb768108020 0x7fb76819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7681076a0 0x7fb768199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 --2- 172.21.15.39:0/1903571139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb768101c90 0x7fb7681992c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:01:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 >> 172.21.15.39:0/1903571139 conn(0x7fb7680fd700 msgr2=0x7fb7681047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:01:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 shutdown_connections 2024-09-10T22:01:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:01:58.760+0000 7fb76ffb0640 1 -- 172.21.15.39:0/1903571139 wait complete. 2024-09-10T22:01:59.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:01:58 smithi070 ceph-mon[34909]: pgmap v550: 97 pgs: 97 active+clean; 130 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 531 op/s 2024-09-10T22:01:59.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:01:58 smithi039 ceph-mon[30872]: pgmap v550: 97 pgs: 97 active+clean; 130 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 531 op/s 2024-09-10T22:01:59.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:01:58 smithi173 ceph-mon[35294]: pgmap v550: 97 pgs: 97 active+clean; 130 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 531 op/s 2024-09-10T22:01:59.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T22:02:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 -- 172.21.15.39:0/2009939009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 msgr2=0x7fd990104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2009939009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990104080 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd984009900 tx=0x7fd98402a410 comp rx=0 tx=0).stop 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 -- 172.21.15.39:0/2009939009 shutdown_connections 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2009939009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd99010d100 0x7fd99010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2009939009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9901045c0 0x7fd99010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2009939009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990104080 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 -- 172.21.15.39:0/2009939009 >> 172.21.15.39:0/2009939009 conn(0x7fd9900fd700 msgr2=0x7fd9900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 -- 172.21.15.39:0/2009939009 shutdown_connections 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.498+0000 7fd996cb0640 1 -- 172.21.15.39:0/2009939009 wait complete. 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 Processor -- start 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 -- start start 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 0x7fd990101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99010d100 0x7fd9901023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd990112dc0 con 0x7fd990103ca0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd990112c40 con 0x7fd99010d100 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd996cb0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd990112f40 con 0x7fd9901045c0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35074/0 (socket says 172.21.15.39:35074) 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd98ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 0x7fd990101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd994a4c640 1 -- 172.21.15.39:0/2049083496 learned_addr learned my addr 172.21.15.39:0/2049083496 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.499+0000 7fd99524d640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99010d100 0x7fd9901023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 -- 172.21.15.39:0/2049083496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99010d100 msgr2=0x7fd9901023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99010d100 0x7fd9901023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 -- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 msgr2=0x7fd990101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 -- 172.21.15.39:0/2049083496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9901a76d0 con 0x7fd9901045c0 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98ffff640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 0x7fd990101e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00d650 tx=0x7fd97c00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98dffb640 1 -- 172.21.15.39:0/2049083496 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c017070 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98dffb640 1 -- 172.21.15.39:0/2049083496 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd97c009c70 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9901a79c0 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd98dffb640 1 -- 172.21.15.39:0/2049083496 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c003b30 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.500+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9901a7f00 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 Processor -- start 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 -- start start 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd98dffb640 1 -- 172.21.15.39:0/2049083496 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd97c003cd0 con 0x7fd9901045c0 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddae460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496ddae9a0 0x56496ddb0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56496dd18ea0 con 0x56496dda20f0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56496dd082d0 con 0x56496dda2a10 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd999085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56496dd0c0e0 con 0x56496ddae9a0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd99524d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd99524d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35086/0 (socket says 172.21.15.39:35086) 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd99524d640 1 -- 172.21.15.39:0/2224139711 learned_addr learned my addr 172.21.15.39:0/2224139711 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.504+0000 7fd98ffff640 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496ddae9a0 0x56496ddb0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 -- 172.21.15.39:0/2224139711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496ddae9a0 msgr2=0x56496ddb0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496ddae9a0 0x56496ddb0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 -- 172.21.15.39:0/2224139711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 msgr2=0x56496ddae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 -- 172.21.15.39:0/2224139711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496da66650 con 0x56496dda20f0 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd98dffb640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 0x7fd9800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd99524d640 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd988003970 tx=0x7fd988003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe15f126ace51fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 0x7fd9800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd98dffb640 1 -- 172.21.15.39:0/2049083496 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd97c0e5730 con 0x7fd9901045c0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd97affd640 1 -- 172.21.15.39:0/2224139711 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98801a470 con 0x56496dda20f0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd97affd640 1 -- 172.21.15.39:0/2224139711 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd988015070 con 0x56496dda20f0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.505+0000 7fd97affd640 1 -- 172.21.15.39:0/2224139711 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988011940 con 0x56496dda20f0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- 172.21.15.39:0/2224139711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 msgr2=0x56496dda24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 0x7fd9800b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x56496dda0e00 tx=0x7fd984005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd988003970 tx=0x7fd988003e30 comp rx=0 tx=0).stop 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- 172.21.15.39:0/2224139711 shutdown_connections 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496ddae9a0 0x56496ddb0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 --2- 172.21.15.39:0/2224139711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496dda24d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- 172.21.15.39:0/2224139711 >> 172.21.15.39:0/2224139711 conn(0x56496dd9ff20 msgr2=0x56496dda10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- 172.21.15.39:0/2224139711 shutdown_connections 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- 172.21.15.39:0/2224139711 wait complete. 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 -- start start 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.506+0000 7fd999085740 1 Processor -- start 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda20f0 0x56496ddae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56496db69700 con 0x56496ddae9a0 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56496dca3160 con 0x56496dda2a10 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56496ddb1620 con 0x56496dda20f0 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd999085740 10 client.0 _ll_register_callbacks cb 0x56496dcbc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35102/0 (socket says 172.21.15.39:35102) 2024-09-10T22:02:00.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 -- 172.21.15.39:0/1294596033 learned_addr learned my addr 172.21.15.39:0/1294596033 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd98ffff640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd994a4c640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda20f0 0x56496ddae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 -- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda20f0 msgr2=0x56496ddae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda20f0 0x56496ddae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 -- 172.21.15.39:0/1294596033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 msgr2=0x56496ddab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 -- 172.21.15.39:0/1294596033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496dcd0c90 con 0x56496ddae9a0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd98ffff640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd99524d640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd9880115e0 tx=0x7fd988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1510067949f262e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.507+0000 7fd96ffff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988027020 con 0x56496ddae9a0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd988015070 con 0x56496ddae9a0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd988011880 con 0x56496ddae9a0 2024-09-10T22:02:00.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd988004e40 con 0x56496ddae9a0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 10 client.17097 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56496ddbcfd0 con 0x56496ddae9a0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd988015070 con 0x56496ddae9a0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fd988005040 con 0x56496ddae9a0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 10 client.17097 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 10 client.17097 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 20 client.17097 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496ddbe320 0x56496ddc0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 4 client.17097 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.508+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56496dd1adf0 con 0x56496ddbe320 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.509+0000 7fd994a4c640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496ddbe320 0x56496ddc0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.509+0000 7fd994a4c640 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496ddbe320 0x56496ddc0710 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7f6ca854ef8df285 server_cookie=94c2546a71614a6b in_seq=0 out_seq=0 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.509+0000 7fd96ffff640 10 client.17097 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:02:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd96ffff640 1 -- 172.21.15.39:0/1294596033 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56496dd1adf0 con 0x56496ddbe320 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd96ffff640 10 client.17097 handle_command_reply: tid=0 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 client.17097 shutdown 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 msgr2=0x56496ddabde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd9880115e0 tx=0x7fd988004a40 comp rx=0 tx=0).stop 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 shutdown_connections 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496ddae9a0 0x56496ddabde0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496ddbe320 0x56496ddc0710 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496dda2a10 0x56496ddab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 --2- 172.21.15.39:0/1294596033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda20f0 0x56496ddae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 >> 172.21.15.39:0/1294596033 conn(0x56496dd9ff20 msgr2=0x56496dda5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd96ffff640 0 client.17097 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:02:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 shutdown_connections 2024-09-10T22:02:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 1 -- 172.21.15.39:0/1294596033 wait complete. 2024-09-10T22:02:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.510+0000 7fd999085740 20 client.17097 trim_cache size 0 max 16384 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 Processor -- start 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 -- start start 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496dd9ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901b0570 con 0x56496dda20f0 2024-09-10T22:02:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901b2170 con 0x56496ddae9a0 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd999085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901b0c70 con 0x56496dda2a10 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35118/0 (socket says 172.21.15.39:35118) 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd994a4c640 1 -- 172.21.15.39:0/2396948729 learned_addr learned my addr 172.21.15.39:0/2396948729 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd99524d640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496dd9ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.524+0000 7fd98ffff640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 -- 172.21.15.39:0/2396948729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 msgr2=0x56496ddba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 -- 172.21.15.39:0/2396948729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 msgr2=0x56496dd9ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496dd9ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 -- 172.21.15.39:0/2396948729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496dda9c60 con 0x56496dda20f0 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd99524d640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496dd9ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd994a4c640 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd984005ab0 tx=0x7fd984040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4319f0dfabeea12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd97a7fc640 1 -- 172.21.15.39:0/2396948729 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984035040 con 0x56496dda20f0 2024-09-10T22:02:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd97a7fc640 1 -- 172.21.15.39:0/2396948729 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd984031950 con 0x56496dda20f0 2024-09-10T22:02:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.525+0000 7fd97a7fc640 1 -- 172.21.15.39:0/2396948729 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9840548b0 con 0x56496dda20f0 2024-09-10T22:02:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- 172.21.15.39:0/2396948729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 msgr2=0x56496ddabd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd984005ab0 tx=0x7fd984040000 comp rx=0 tx=0).stop 2024-09-10T22:02:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- 172.21.15.39:0/2396948729 shutdown_connections 2024-09-10T22:02:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496dd9ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 --2- 172.21.15.39:0/2396948729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddabd30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- 172.21.15.39:0/2396948729 >> 172.21.15.39:0/2396948729 conn(0x56496dd9ff20 msgr2=0x56496dd9e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- 172.21.15.39:0/2396948729 shutdown_connections 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- 172.21.15.39:0/2396948729 wait complete. 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 -- start start 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.526+0000 7fd999085740 1 Processor -- start 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddc57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496ddc5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901b1a70 con 0x56496dda20f0 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901b1370 con 0x56496ddae9a0 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9901ae550 con 0x56496dda2a10 2024-09-10T22:02:00.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd999085740 10 client.0 _ll_register_callbacks cb 0x7fd984005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35130/0 (socket says 172.21.15.39:35130) 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 -- 172.21.15.39:0/3374416718 learned_addr learned my addr 172.21.15.39:0/3374416718 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd99524d640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496ddc5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd98ffff640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddc57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 -- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 msgr2=0x56496ddc57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddc57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 -- 172.21.15.39:0/3374416718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 msgr2=0x56496ddc5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496ddc5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 -- 172.21.15.39:0/3374416718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496ddc6410 con 0x56496dda20f0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd99524d640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496ddc5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd994a4c640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd984057040 tx=0x7fd984003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621a1b2ab77446a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.527+0000 7fd96ffff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98405e020 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd984031d00 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd984031950 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd984054530 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 10 client.17103 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56496de2aee0 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd984031950 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fd984044030 con 0x56496dda20f0 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 10 client.17103 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 10 client.17103 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 20 client.17103 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496de2b4d0 0x56496de2d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 4 client.17103 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:02:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 --> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56496dd168a0 con 0x56496de2b4d0 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.528+0000 7fd98ffff640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496de2b4d0 0x56496de2d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd98ffff640 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496de2b4d0 0x56496de2d8f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ff487085dccded server_cookie=747caf43f9bc3563 in_seq=0 out_seq=0 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd96ffff640 10 client.17103 ms_handle_connect on v2:172.21.15.173:6836/4244781378 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd96ffff640 1 -- 172.21.15.39:0/3374416718 <== mds.3 v2:172.21.15.173:6836/4244781378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56496dd168a0 con 0x56496de2b4d0 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd96ffff640 10 client.17103 handle_command_reply: tid=0 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 client.17103 shutdown 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 msgr2=0x56496ddb6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd984057040 tx=0x7fd984003f80 comp rx=0 tx=0).stop 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 shutdown_connections 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:6836/4244781378,v1:172.21.15.173:6837/4244781378] conn(0x56496de2b4d0 0x56496de2d8f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56496ddae9a0 0x56496ddc5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56496dda2a10 0x56496ddc57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 --2- 172.21.15.39:0/3374416718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56496dda20f0 0x56496ddb6f40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd96ffff640 0 client.17103 ms_handle_reset on v2:172.21.15.173:6836/4244781378 2024-09-10T22:02:00.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 >> 172.21.15.39:0/3374416718 conn(0x56496dd9ff20 msgr2=0x56496dd9ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 shutdown_connections 2024-09-10T22:02:00.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.529+0000 7fd999085740 1 -- 172.21.15.39:0/3374416718 wait complete. 2024-09-10T22:02:00.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd999085740 20 client.17103 trim_cache size 0 max 16384 2024-09-10T22:02:00.536 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 msgr2=0x7fd9800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 0x7fd9800b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x56496dda0e00 tx=0x7fd984005a20 comp rx=0 tx=0).stop 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 msgr2=0x7fd990101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 0x7fd990101e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00d650 tx=0x7fd97c00db10 comp rx=0 tx=0).stop 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 shutdown_connections 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fd9800b52e0 0x7fd9800b77a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99010d100 0x7fd9901023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9901045c0 0x7fd990101e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 --2- 172.21.15.39:0/2049083496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd990103ca0 0x7fd990101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 >> 172.21.15.39:0/2049083496 conn(0x7fd9900fd700 msgr2=0x7fd99010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 shutdown_connections 2024-09-10T22:02:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:00.530+0000 7fd996cb0640 1 -- 172.21.15.39:0/2049083496 wait complete. 2024-09-10T22:02:01.044 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:00 smithi173 ceph-mon[35294]: pgmap v551: 97 pgs: 97 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 548 op/s 2024-09-10T22:02:01.128 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:00 smithi039 ceph-mon[30872]: pgmap v551: 97 pgs: 97 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 548 op/s 2024-09-10T22:02:01.155 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:00 smithi070 ceph-mon[34909]: pgmap v551: 97 pgs: 97 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 548 op/s 2024-09-10T22:02:01.157 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:02:01.419 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 -- 172.21.15.39:0/1813002214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 msgr2=0x7fc6a810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1813002214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a810f560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009be0 tx=0x7fc6a002a6c0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 -- 172.21.15.39:0/1813002214 shutdown_connections 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1813002214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a810f560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1813002214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a81045c0 0x7fc6a810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1813002214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 -- 172.21.15.39:0/1813002214 >> 172.21.15.39:0/1813002214 conn(0x7fc6a80fd700 msgr2=0x7fc6a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.159+0000 7fc6b043a640 1 -- 172.21.15.39:0/1813002214 shutdown_connections 2024-09-10T22:02:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.160+0000 7fc6b043a640 1 -- 172.21.15.39:0/1813002214 wait complete. 2024-09-10T22:02:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.160+0000 7fc6b043a640 1 Processor -- start 2024-09-10T22:02:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 -- start start 2024-09-10T22:02:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a81129a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81020f0 con 0x7fc6a8103ca0 2024-09-10T22:02:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8101f70 con 0x7fc6a81045c0 2024-09-10T22:02:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6b043a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8102270 con 0x7fc6a810d100 2024-09-10T22:02:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6ae1d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53190/0 (socket says 172.21.15.39:53190) 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6ae1d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8115f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35158/0 (socket says 172.21.15.39:35158) 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.161+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1108416500 learned_addr learned my addr 172.21.15.39:0/1108416500 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a81129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1108416500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 msgr2=0x7fc6a81129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a81129a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 msgr2=0x7fc6a8115f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8115f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.162+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1108416500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a8113120 con 0x7fc6a81045c0 2024-09-10T22:02:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc69800e9c0 tx=0x7fc69800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc69f7fe640 1 -- 172.21.15.39:0/1108416500 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698004220 con 0x7fc6a81045c0 2024-09-10T22:02:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc69f7fe640 1 -- 172.21.15.39:0/1108416500 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6980043c0 con 0x7fc6a81045c0 2024-09-10T22:02:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc69f7fe640 1 -- 172.21.15.39:0/1108416500 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698010430 con 0x7fc6a81045c0 2024-09-10T22:02:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a81abde0 con 0x7fc6a81045c0 2024-09-10T22:02:02.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.163+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a81ac1b0 con 0x7fc6a81045c0 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.168+0000 7fc6b280f740 1 Processor -- start 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.169+0000 7fc69f7fe640 1 -- 172.21.15.39:0/1108416500 <== mon.2 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc69800c8b0 con 0x7fc6a81045c0 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.169+0000 7fc6b280f740 1 -- start start 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954ea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e995460ea0 con 0x55e9954f6d40 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9954502d0 con 0x55e9954eadb0 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6b280f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e9954540e0 con 0x55e9954ea490 2024-09-10T22:02:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6ae1d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35160/0 (socket says 172.21.15.39:35160) 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/2178845653 learned_addr learned my addr 172.21.15.39:0/2178845653 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.170+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/2178845653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 msgr2=0x55e9954ea870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954ea870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/2178845653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 msgr2=0x55e9954f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/2178845653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9951ae650 con 0x55e9954eadb0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f6800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009c30 tx=0x7fc6a4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b125d433921ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.171+0000 7fc69cde6640 1 -- 172.21.15.39:0/2178845653 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401e070 con 0x55e9954eadb0 2024-09-10T22:02:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.172+0000 7fc69cde6640 1 -- 172.21.15.39:0/2178845653 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6a40035f0 con 0x55e9954eadb0 2024-09-10T22:02:02.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.172+0000 7fc69cde6640 1 -- 172.21.15.39:0/2178845653 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4019690 con 0x55e9954eadb0 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 0x7fc6940b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 -- 172.21.15.39:0/2178845653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 msgr2=0x55e9954f6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f6800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009c30 tx=0x7fc6a4011810 comp rx=0 tx=0).stop 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 -- 172.21.15.39:0/2178845653 shutdown_connections 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f6800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 --2- 172.21.15.39:0/2178845653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954ea870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc69f7fe640 1 -- 172.21.15.39:0/1108416500 <== mon.2 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc6980e6210 con 0x7fc6a81045c0 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6b280f740 1 -- 172.21.15.39:0/2178845653 >> 172.21.15.39:0/2178845653 conn(0x55e9954e82c0 msgr2=0x55e9954e9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.173+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 0x7fc6940b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.174+0000 7fc6b280f740 1 -- 172.21.15.39:0/2178845653 shutdown_connections 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.174+0000 7fc6b280f740 1 -- 172.21.15.39:0/2178845653 wait complete. 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.174+0000 7fc6b280f740 1 -- start start 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.174+0000 7fc6b280f740 1 Processor -- start 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954eadb0 0x55e9954f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9952b1700 con 0x55e9954f6d40 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9953eb160 con 0x55e9954ea490 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e9954f9a60 con 0x55e9954eadb0 2024-09-10T22:02:02.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6b280f740 10 client.0 _ll_register_callbacks cb 0x55e9954049e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 0x7fc6940b79b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00095e0 tx=0x7fc6a0009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ae1d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ae1d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53208/0 (socket says 172.21.15.39:53208) 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/674809657 learned_addr learned my addr 172.21.15.39:0/674809657 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954eadb0 0x55e9954f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.175+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/674809657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954eadb0 msgr2=0x55e9954f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954eadb0 0x55e9954f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/674809657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 msgr2=0x55e9954f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 -- 172.21.15.39:0/674809657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e995418c90 con 0x55e9954ea490 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4004460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e493db313beb2bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401e050 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6a40035f0 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.176+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mon.2 v2:172.21.15.70:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc6a4005040 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc6a4005240 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 10 client.26732 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e995516390 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mon.2 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6a40035f0 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mon.2 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fc6a4004b70 con 0x55e9954ea490 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 10 client.26732 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 10 client.26732 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 20 client.26732 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e995517bf0 0x55e99551a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 4 client.26732 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:02:02.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e995462df0 con 0x55e995517bf0 2024-09-10T22:02:02.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.177+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e995517bf0 0x55e99551a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.178+0000 7fc691ffb640 10 client.26732 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:02:02.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.178+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e995517bf0 0x55e99551a030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eebe824fffc46227 server_cookie=cd84ba9f53e0f3e8 in_seq=0 out_seq=0 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc691ffb640 1 -- 172.21.15.39:0/674809657 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e995462df0 con 0x55e995517bf0 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc691ffb640 10 client.26732 handle_command_reply: tid=0 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 client.26732 shutdown 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 msgr2=0x55e9954f65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4004460 comp rx=0 tx=0).stop 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 shutdown_connections 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e995517bf0 0x55e99551a030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc691ffb640 0 client.26732 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954eadb0 0x55e9954f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 --2- 172.21.15.39:0/674809657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954ea490 0x55e9954f65e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.179+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 >> 172.21.15.39:0/674809657 conn(0x55e9954e82c0 msgr2=0x55e9954ede30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.180+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 shutdown_connections 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.180+0000 7fc6b280f740 1 -- 172.21.15.39:0/674809657 wait complete. 2024-09-10T22:02:02.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.180+0000 7fc6b280f740 20 client.26732 trim_cache size 0 max 16384 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.200+0000 7fc6b280f740 1 Processor -- start 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.200+0000 7fc6b280f740 1 -- start start 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.200+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6b280f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8075000 con 0x55e9954f6d40 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6b280f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81adcd0 con 0x55e9954eadb0 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6b280f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81ac7d0 con 0x55e9954ea490 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53214/0 (socket says 172.21.15.39:53214) 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/66548154 learned_addr learned my addr 172.21.15.39:0/66548154 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/66548154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 msgr2=0x55e9954e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954e7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/66548154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 msgr2=0x55e9954f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/66548154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9954f1f30 con 0x55e9954eadb0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.201+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6980e6540 tx=0x7fc69801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c1a174bf978050a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc693fff640 1 -- 172.21.15.39:0/66548154 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980a8820 con 0x55e9954eadb0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc693fff640 1 -- 172.21.15.39:0/66548154 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6980e5070 con 0x55e9954eadb0 2024-09-10T22:02:02.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc693fff640 1 -- 172.21.15.39:0/66548154 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980a80f0 con 0x55e9954eadb0 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 -- 172.21.15.39:0/66548154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 msgr2=0x55e9954f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6980e6540 tx=0x7fc69801a040 comp rx=0 tx=0).stop 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 -- 172.21.15.39:0/66548154 shutdown_connections 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954f6d40 0x55e9954f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954eadb0 0x55e9954f5770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 --2- 172.21.15.39:0/66548154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e9954e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 -- 172.21.15.39:0/66548154 >> 172.21.15.39:0/66548154 conn(0x55e9954e82c0 msgr2=0x55e9954f5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 -- 172.21.15.39:0/66548154 shutdown_connections 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.202+0000 7fc6b280f740 1 -- 172.21.15.39:0/66548154 wait complete. 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 -- start start 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 Processor -- start 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e995510370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 0x55e99550bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81ad5d0 con 0x55e9954eadb0 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a81aced0 con 0x55e9954f6d40 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8072fe0 con 0x55e9954ea490 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6b280f740 10 client.0 _ll_register_callbacks cb 0x7fc6a401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:02.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6ad9d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35192/0 (socket says 172.21.15.39:35192) 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1509076011 learned_addr learned my addr 172.21.15.39:0/1509076011 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 0x55e99550bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.203+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e995510370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1509076011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 msgr2=0x55e995510370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e995510370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 msgr2=0x55e99550bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 0x55e99550bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 -- 172.21.15.39:0/1509076011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99550c3c0 con 0x55e9954eadb0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ae9d7640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 0x55e99550bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6ad9d5640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc6980a8f50 tx=0x7fc6980a80f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143944ae26b33ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69800ce60 con 0x55e9954eadb0 2024-09-10T22:02:02.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6980e5070 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.204+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fc6980a8bf0 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.205+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc6980ac0f0 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.205+0000 7fc6b280f740 10 client.17121 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.205+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e9955849b0 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.205+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6980e5070 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fc6980b5a80 con 0x55e9954eadb0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 10 client.17121 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 10 client.17121 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 20 client.17121 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e9955850d0 0x55e9955874f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 4 client.17121 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 --> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e99545e8a0 con 0x55e9955850d0 2024-09-10T22:02:02.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e9955850d0 0x55e9955874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc6ae1d6640 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e9955850d0 0x55e9955874f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2e9438b9500ad88 server_cookie=17cd35a463c5091e in_seq=0 out_seq=0 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.206+0000 7fc691ffb640 10 client.17121 ms_handle_connect on v2:172.21.15.70:6836/3809137442 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc691ffb640 1 -- 172.21.15.39:0/1509076011 <== mds.2 v2:172.21.15.70:6836/3809137442 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e99545e8a0 con 0x55e9955850d0 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc691ffb640 10 client.17121 handle_command_reply: tid=0 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 client.17121 shutdown 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 msgr2=0x55e99550b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc6980a8f50 tx=0x7fc6980a80f0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 shutdown_connections 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:6836/3809137442,v1:172.21.15.70:6837/3809137442] conn(0x55e9955850d0 0x55e9955874f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9954f6d40 0x55e99550bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9954eadb0 0x55e99550b840 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 --2- 172.21.15.39:0/1509076011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9954ea490 0x55e995510370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 >> 172.21.15.39:0/1509076011 conn(0x55e9954e82c0 msgr2=0x55e9954f5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc691ffb640 0 client.17121 ms_handle_reset on v2:172.21.15.70:6836/3809137442 2024-09-10T22:02:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 shutdown_connections 2024-09-10T22:02:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 1 -- 172.21.15.39:0/1509076011 wait complete. 2024-09-10T22:02:02.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.207+0000 7fc6b280f740 20 client.17121 trim_cache size 0 max 16384 2024-09-10T22:02:02.214 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 msgr2=0x7fc6940b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 0x7fc6940b79b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00095e0 tx=0x7fc6a0009570 comp rx=0 tx=0).stop 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 msgr2=0x7fc6a8112460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc69800e9c0 tx=0x7fc69800edc0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 shutdown_connections 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc6940b54f0 0x7fc6940b79b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6a810d100 0x7fc6a81129a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6a81045c0 0x7fc6a8112460 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 --2- 172.21.15.39:0/1108416500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a8103ca0 0x7fc6a8115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 >> 172.21.15.39:0/1108416500 conn(0x7fc6a80fd700 msgr2=0x7fc6a810db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 shutdown_connections 2024-09-10T22:02:02.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:02.208+0000 7fc6b043a640 1 -- 172.21.15.39:0/1108416500 wait complete. 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 -- 172.21.15.39:0/1390565636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 msgr2=0x7f0014075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 --2- 172.21.15.39:0/1390565636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f0014075fa0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f000402a410 comp rx=0 tx=0).stop 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 -- 172.21.15.39:0/1390565636 shutdown_connections 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 --2- 172.21.15.39:0/1390565636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014106490 0x7f0014111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 --2- 172.21.15.39:0/1390565636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f0014075fa0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 --2- 172.21.15.39:0/1390565636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0014076f90 0x7f00140755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.250+0000 7f001c22a640 1 -- 172.21.15.39:0/1390565636 >> 172.21.15.39:0/1390565636 conn(0x7f00140fe240 msgr2=0x7f0014100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- 172.21.15.39:0/1390565636 shutdown_connections 2024-09-10T22:02:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- 172.21.15.39:0/1390565636 wait complete. 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 Processor -- start 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- start start 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014076f90 0x7f001419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 0x7f00141a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0014114c70 con 0x7f0014075b20 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0014114af0 con 0x7f0014076f90 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f001c22a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0014114df0 con 0x7f00141a0660 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f0019fc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f0019fc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35218/0 (socket says 172.21.15.39:35218) 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.251+0000 7f0019fc6640 1 -- 172.21.15.39:0/1958313214 learned_addr learned my addr 172.21.15.39:0/1958313214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f00197c5640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014076f90 0x7f001419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f001a7c7640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 0x7f00141a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 -- 172.21.15.39:0/1958313214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 msgr2=0x7f00141a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 0x7f00141a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 -- 172.21.15.39:0/1958313214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014076f90 msgr2=0x7f001419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014076f90 0x7f001419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 -- 172.21.15.39:0/1958313214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00141a1310 con 0x7f0014075b20 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f001a7c7640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 0x7f00141a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f0019fc6640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f001000d770 tx=0x7f001000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f000affd640 1 -- 172.21.15.39:0/1958313214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010017070 con 0x7f0014075b20 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f000affd640 1 -- 172.21.15.39:0/1958313214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00100054d0 con 0x7f0014075b20 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00141a7700 con 0x7f0014075b20 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f000affd640 1 -- 172.21.15.39:0/1958313214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010004c30 con 0x7f0014075b20 2024-09-10T22:02:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.252+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141a7ba0 con 0x7f0014075b20 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.255+0000 7f001eff7740 1 Processor -- start 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 -- start start 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f000affd640 1 -- 172.21.15.39:0/1958313214 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0010004e10 con 0x7f0014075b20 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e133580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e136090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55976e0a06f0 con 0x55976e133bd0 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55976e08fb20 con 0x55976e131190 2024-09-10T22:02:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001eff7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55976e093930 con 0x55976e12e860 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f00197c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52088/0 (socket says 172.21.15.39:52088) 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f00197c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e136090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35232/0 (socket says 172.21.15.39:35232) 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 -- 172.21.15.39:0/2047089606 learned_addr learned my addr 172.21.15.39:0/2047089606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f0019fc6640 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 -- 172.21.15.39:0/2047089606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 msgr2=0x55976e133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e133580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 -- 172.21.15.39:0/2047089606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 msgr2=0x55976e136090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e136090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.256+0000 7f001a7c7640 1 -- 172.21.15.39:0/2047089606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976e055530 con 0x55976e12e860 2024-09-10T22:02:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f000c009f60 tx=0x7f000c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fcf59d12ce84878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7efffffff640 1 -- 172.21.15.39:0/2047089606 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c011640 con 0x55976e12e860 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7f000affd640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7efffffff640 1 -- 172.21.15.39:0/2047089606 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f000c011c90 con 0x55976e12e860 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7efffffff640 1 -- 172.21.15.39:0/2047089606 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c010cd0 con 0x55976e12e860 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.257+0000 7f000affd640 1 -- 172.21.15.39:0/1958313214 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f00100e5660 con 0x7f0014075b20 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f0019fc6640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 -- 172.21.15.39:0/2047089606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 msgr2=0x55976e130c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f000c009f60 tx=0x7f000c009f90 comp rx=0 tx=0).stop 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 -- 172.21.15.39:0/2047089606 shutdown_connections 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e136090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e133580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 --2- 172.21.15.39:0/2047089606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e130c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 -- 172.21.15.39:0/2047089606 >> 172.21.15.39:0/2047089606 conn(0x55976e1299b0 msgr2=0x55976e12a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f0019fc6640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 0x7f00000b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f00100a90a0 tx=0x7f0010009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 -- 172.21.15.39:0/2047089606 shutdown_connections 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.258+0000 7f001eff7740 1 -- 172.21.15.39:0/2047089606 wait complete. 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 -- start start 2024-09-10T22:02:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 Processor -- start 2024-09-10T22:02:02.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e131190 0x55976e138500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e133bd0 0x55976e1390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55976dfc7ab0 con 0x55976e12e860 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55976e035730 con 0x55976e133bd0 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001eff7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55976e136bb0 con 0x55976e131190 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.259+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001eff7740 10 client.0 _ll_register_callbacks cb 0x55976e0896b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35242/0 (socket says 172.21.15.39:35242) 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 -- 172.21.15.39:0/2272577750 learned_addr learned my addr 172.21.15.39:0/2272577750 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f00197c5640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e131190 0x55976e138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e133bd0 0x55976e1390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 -- 172.21.15.39:0/2272577750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e131190 msgr2=0x55976e138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e131190 0x55976e138500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 -- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e133bd0 msgr2=0x55976e1390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e133bd0 0x55976e1390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 -- 172.21.15.39:0/2272577750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976ddf1790 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f000c010010 tx=0x7f000c0092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f53229a78f797c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7efffd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c010a10 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f000c010bb0 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f000c011c90 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f000c010db0 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001eff7740 10 client.17133 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.260+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55976de6a620 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f000c011c90 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f000c011960 con 0x55976e12e860 2024-09-10T22:02:02.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 10 client.17133 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 10 client.17133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 20 client.17133 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e143420 0x55976e145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 4 client.17133 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55976e0a2640 con 0x55976e143420 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.261+0000 7f00197c5640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e143420 0x55976e145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.262+0000 7efffd7fa640 10 client.17133 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.262+0000 7f00197c5640 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e143420 0x55976e145810 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375c95f1e17eea0a server_cookie=8d6e873f712af379 in_seq=0 out_seq=0 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.262+0000 7efffd7fa640 1 -- 172.21.15.39:0/2272577750 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55976e0a2640 con 0x55976e143420 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.262+0000 7efffd7fa640 10 client.17133 handle_command_reply: tid=0 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.262+0000 7f001eff7740 1 client.17133 shutdown 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 msgr2=0x55976e137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f000c010010 tx=0x7f000c0092f0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 shutdown_connections 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e143420 0x55976e145810 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e133bd0 0x55976e1390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e131190 0x55976e138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 --2- 172.21.15.39:0/2272577750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e12e860 0x55976e137e60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7efffd7fa640 0 client.17133 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 >> 172.21.15.39:0/2272577750 conn(0x55976e1299b0 msgr2=0x55976e128bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 shutdown_connections 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 1 -- 172.21.15.39:0/2272577750 wait complete. 2024-09-10T22:02:02.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.263+0000 7f001eff7740 20 client.17133 trim_cache size 0 max 16384 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 Processor -- start 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 -- start start 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 0x55976e133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e133bd0 0x55976e12dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b0570 con 0x55976e131190 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b2170 con 0x55976e12e860 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001eff7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b0c70 con 0x55976e133bd0 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f00197c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f00197c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35250/0 (socket says 172.21.15.39:35250) 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f00197c5640 1 -- 172.21.15.39:0/3057027085 learned_addr learned my addr 172.21.15.39:0/3057027085 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001a7c7640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 0x55976e133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.278+0000 7f001a7c7640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e133bd0 0x55976e12dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 -- 172.21.15.39:0/3057027085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e133bd0 msgr2=0x55976e12dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e133bd0 0x55976e12dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 -- 172.21.15.39:0/3057027085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 msgr2=0x55976e133fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 0x55976e133fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 -- 172.21.15.39:0/3057027085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976e145b80 con 0x55976e131190 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f001a7c7640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 0x55976e133fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f00197c5640 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0004000c00 tx=0x7f00040045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd74b94f7ecec88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7effff7fe640 1 -- 172.21.15.39:0/3057027085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004035040 con 0x55976e131190 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7effff7fe640 1 -- 172.21.15.39:0/3057027085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0004003ca0 con 0x55976e131190 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7effff7fe640 1 -- 172.21.15.39:0/3057027085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004031cb0 con 0x55976e131190 2024-09-10T22:02:02.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f001eff7740 1 -- 172.21.15.39:0/3057027085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 msgr2=0x55976e1344f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.279+0000 7f001eff7740 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0004000c00 tx=0x7f00040045f0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- 172.21.15.39:0/3057027085 shutdown_connections 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e133bd0 0x55976e12dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e131190 0x55976e1344f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- 172.21.15.39:0/3057027085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e12e860 0x55976e133fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- 172.21.15.39:0/3057027085 >> 172.21.15.39:0/3057027085 conn(0x55976e1299b0 msgr2=0x55976e137a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- 172.21.15.39:0/3057027085 shutdown_connections 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- 172.21.15.39:0/3057027085 wait complete. 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- start start 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 Processor -- start 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e13f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e13e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b1a70 con 0x55976e133bd0 2024-09-10T22:02:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b1370 con 0x55976e131190 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f00141ae550 con 0x55976e12e860 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001eff7740 10 client.0 _ll_register_callbacks cb 0x7f000c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.280+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35256/0 (socket says 172.21.15.39:35256) 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 -- 172.21.15.39:0/2022701357 learned_addr learned my addr 172.21.15.39:0/2022701357 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f00197c5640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e13e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 -- 172.21.15.39:0/2022701357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 msgr2=0x55976e13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e13f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 -- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 msgr2=0x55976e13e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e13e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 -- 172.21.15.39:0/2022701357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976e139440 con 0x55976e133bd0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001a7c7640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f000c004290 tx=0x7f000c012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78877f092d2e5920 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7efffd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c009e60 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f000c002030 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0004003ca0 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f000c004800 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001eff7740 10 client.17139 fetch_fsmap learned FSMap version 37 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.281+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55976e13ddc0 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0004003ca0 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f000c011440 con 0x55976e133bd0 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 10 client.17139 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 10 client.17139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 20 client.17139 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e1b0900 0x55976e1b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 4 client.17139 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:02:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55976e09e0f0 con 0x55976e1b0900 2024-09-10T22:02:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f00197c5640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e1b0900 0x55976e1b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7efffd7fa640 10 client.17139 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.282+0000 7f00197c5640 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e1b0900 0x55976e1b2d20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=795836c637892d98 server_cookie=2154843ee21adb0d in_seq=0 out_seq=0 2024-09-10T22:02:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7efffd7fa640 1 -- 172.21.15.39:0/2022701357 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55976e09e0f0 con 0x55976e1b0900 2024-09-10T22:02:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7efffd7fa640 10 client.17139 handle_command_reply: tid=0 2024-09-10T22:02:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 client.17139 shutdown 2024-09-10T22:02:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 msgr2=0x55976e13ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f000c004290 tx=0x7f000c012e50 comp rx=0 tx=0).stop 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 shutdown_connections 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55976e1b0900 0x55976e1b2d20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7efffd7fa640 0 client.17139 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976e133bd0 0x55976e13ea80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55976e131190 0x55976e13e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.512+0000 7f001eff7740 1 --2- 172.21.15.39:0/2022701357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55976e12e860 0x55976e13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 >> 172.21.15.39:0/2022701357 conn(0x55976e1299b0 msgr2=0x55976e133fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 shutdown_connections 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001eff7740 1 -- 172.21.15.39:0/2022701357 wait complete. 2024-09-10T22:02:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001eff7740 20 client.17139 trim_cache size 0 max 16384 2024-09-10T22:02:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-10T22:02:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-10T22:02:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-10T22:02:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 msgr2=0x7f00000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 0x7f00000b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f00100a90a0 tx=0x7f0010009f90 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 msgr2=0x7f001419f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f001000d770 tx=0x7f001000dc30 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 shutdown_connections 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00141a0660 0x7f00141a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0014076f90 0x7f001419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 --2- 172.21.15.39:0/1958313214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0014075b20 0x7f001419f3e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.513+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 >> 172.21.15.39:0/1958313214 conn(0x7f00140fe240 msgr2=0x7f00140fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.514+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 shutdown_connections 2024-09-10T22:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-10T22:02:02.514+0000 7f001c22a640 1 -- 172.21.15.39:0/1958313214 wait complete. 2024-09-10T22:02:02.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:02:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:02 smithi039 ceph-mon[30872]: pgmap v552: 97 pgs: 97 active+clean; 111 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 427 op/s 2024-09-10T22:02:03.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:02 smithi070 ceph-mon[34909]: pgmap v552: 97 pgs: 97 active+clean; 111 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 427 op/s 2024-09-10T22:02:03.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:03.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:03.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:02 smithi070 ceph-mds[63694]: -- 172.21.15.70:0/2976274925 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557b0167860 con 0x5557b0145000 2024-09-10T22:02:03.156 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: starting mds.e at 2024-09-10T22:02:03.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:02 smithi173 ceph-mon[35294]: pgmap v552: 97 pgs: 97 active+clean; 111 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 427 op/s 2024-09-10T22:02:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:03.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 -- 172.21.15.39:0/34687485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc1076a0 msgr2=0x7fe1cc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 --2- 172.21.15.39:0/34687485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc107ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009900 tx=0x7fe1bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 -- 172.21.15.39:0/34687485 shutdown_connections 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 --2- 172.21.15.39:0/34687485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc108020 0x7fe1cc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 --2- 172.21.15.39:0/34687485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc107ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 --2- 172.21.15.39:0/34687485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc101c90 0x7fe1cc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 -- 172.21.15.39:0/34687485 >> 172.21.15.39:0/34687485 conn(0x7fe1cc0fd700 msgr2=0x7fe1cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 -- 172.21.15.39:0/34687485 shutdown_connections 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.876+0000 7fe1d337c640 1 -- 172.21.15.39:0/34687485 wait complete. 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 Processor -- start 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 -- start start 2024-09-10T22:02:03.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc101c90 0x7fe1cc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 0x7fe1cc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111c70 con 0x7fe1cc1076a0 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111af0 con 0x7fe1cc108020 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d337c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc111df0 con 0x7fe1cc101c90 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d0917640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d0917640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35278/0 (socket says 172.21.15.39:35278) 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d0917640 1 -- 172.21.15.39:0/3701203449 learned_addr learned my addr 172.21.15.39:0/3701203449 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d1919640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 0x7fe1cc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.877+0000 7fe1d1118640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc101c90 0x7fe1cc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 -- 172.21.15.39:0/3701203449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc101c90 msgr2=0x7fe1cc19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc101c90 0x7fe1cc19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 -- 172.21.15.39:0/3701203449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 msgr2=0x7fe1cc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 0x7fe1cc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 -- 172.21.15.39:0/3701203449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc1a5460 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d1919640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 0x7fe1cc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d0917640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005940 tx=0x7fe1bc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1c27fc640 1 -- 172.21.15.39:0/3701203449 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc03f030 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1c27fc640 1 -- 172.21.15.39:0/3701203449 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1bc0044c0 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc1a56f0 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1c27fc640 1 -- 172.21.15.39:0/3701203449 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc035070 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.878+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc1a5bd0 con 0x7fe1cc1076a0 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 Processor -- start 2024-09-10T22:02:03.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 -- start start 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1c27fc640 1 -- 172.21.15.39:0/3701203449 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe1bc03ba20 con 0x7fe1cc1076a0 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5df5b70 0x5556b5df5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e06e40 0x5556b5e0f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5556b5d6eea0 con 0x5556b5e064c0 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556b5d5e2d0 con 0x5556b5e06e40 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d5751740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556b5d620e0 con 0x5556b5df5b70 2024-09-10T22:02:03.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35288/0 (socket says 172.21.15.39:35288) 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d1118640 1 -- 172.21.15.39:0/1847410889 learned_addr learned my addr 172.21.15.39:0/1847410889 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d0917640 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e06e40 0x5556b5e0f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.881+0000 7fe1d1919640 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5df5b70 0x5556b5df5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 -- 172.21.15.39:0/1847410889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5df5b70 msgr2=0x5556b5df5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5df5b70 0x5556b5df5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 -- 172.21.15.39:0/1847410889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e06e40 msgr2=0x5556b5e0f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e06e40 0x5556b5e0f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 -- 172.21.15.39:0/1847410889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556b5abc650 con 0x5556b5e064c0 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009cf0 tx=0x7fe1c8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04d751499501775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1c27fc640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 0x7fe1b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1b77fe640 1 -- 172.21.15.39:0/1847410889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c801e070 con 0x5556b5e064c0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1b77fe640 1 -- 172.21.15.39:0/1847410889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8019ae0 con 0x5556b5e064c0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1d1919640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 0x7fe1b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1b77fe640 1 -- 172.21.15.39:0/1847410889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800e970 con 0x5556b5e064c0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.882+0000 7fe1c27fc640 1 -- 172.21.15.39:0/3701203449 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe1bc105e70 con 0x7fe1cc1076a0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- 172.21.15.39:0/1847410889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 msgr2=0x5556b5e06900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009cf0 tx=0x7fe1c8011810 comp rx=0 tx=0).stop 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d1919640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 0x7fe1b80b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009fd0 tx=0x7fe1c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- 172.21.15.39:0/1847410889 shutdown_connections 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e06e40 0x5556b5e0f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e06900 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1847410889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5df5b70 0x5556b5df5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- 172.21.15.39:0/1847410889 >> 172.21.15.39:0/1847410889 conn(0x5556b5df8090 msgr2=0x5556b5df8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- 172.21.15.39:0/1847410889 shutdown_connections 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- 172.21.15.39:0/1847410889 wait complete. 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 -- start start 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.883+0000 7fe1d5751740 1 Processor -- start 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e0f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e0cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5556b5bbf700 con 0x5556b5e064c0 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556b5cf9160 con 0x5556b5df5b70 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556b5e0fef0 con 0x5556b5e06e40 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d5751740 10 client.0 _ll_register_callbacks cb 0x5556b5d129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35304/0 (socket says 172.21.15.39:35304) 2024-09-10T22:02:03.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 -- 172.21.15.39:0/1021828209 learned_addr learned my addr 172.21.15.39:0/1021828209 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e0f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d1919640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e0cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 -- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 msgr2=0x5556b5e0cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e0cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 -- 172.21.15.39:0/1021828209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 msgr2=0x5556b5e0f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e0f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 -- 172.21.15.39:0/1021828209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556b5d26c90 con 0x5556b5e064c0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1d0917640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0c9960 tx=0x7fe1bc0c8e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925510f2d445a0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.884+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc049040 con 0x5556b5e064c0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe1bc003cf0 con 0x5556b5e064c0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c8019ae0 con 0x5556b5e064c0 2024-09-10T22:02:03.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc0cc040 con 0x5556b5e064c0 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 10 client.17154 fetch_fsmap learned FSMap version 39 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5556b5e1b770 con 0x5556b5e064c0 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8019ae0 con 0x5556b5e064c0 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7fe1bc0c8960 con 0x5556b5e064c0 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 10 client.17154 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 10 client.17154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:02:03.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 20 client.17154 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e1cc00 0x5556b5e1f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 4 client.17154 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.885+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556b5d70df0 con 0x5556b5e1cc00 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.886+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e1cc00 0x5556b5e1f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.886+0000 7fe1b4ff9640 10 client.17154 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.886+0000 7fe1d1118640 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e1cc00 0x5556b5e1f070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c567bab424896f02 server_cookie=93afecf7b71fcab9 in_seq=0 out_seq=0 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/1021828209 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556b5d70df0 con 0x5556b5e1cc00 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1b4ff9640 10 client.17154 handle_command_reply: tid=0 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 client.17154 shutdown 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 msgr2=0x5556b5e0c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0c9960 tx=0x7fe1bc0c8e00 comp rx=0 tx=0).stop 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 shutdown_connections 2024-09-10T22:02:03.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e1cc00 0x5556b5e1f070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e0cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e064c0 0x5556b5e0c9e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 --2- 172.21.15.39:0/1021828209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e0f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 >> 172.21.15.39:0/1021828209 conn(0x5556b5df8090 msgr2=0x5556b5df7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1b4ff9640 0 client.17154 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 shutdown_connections 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 1 -- 172.21.15.39:0/1021828209 wait complete. 2024-09-10T22:02:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.887+0000 7fe1d5751740 20 client.17154 trim_cache size 0 max 16384 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 Processor -- start 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 -- start start 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e064c0 0x5556b5df10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 0x5556b5e0bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1ac0f0 con 0x5556b5e06e40 2024-09-10T22:02:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1adcc0 con 0x5556b5df5b70 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d5751740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1ac7f0 con 0x5556b5e064c0 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1919640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 0x5556b5e0bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.39:53336/0 (socket says 172.21.15.39:53336) 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 -- 172.21.15.39:0/3769561629 learned_addr learned my addr 172.21.15.39:0/3769561629 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d0917640 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e064c0 0x5556b5df10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 -- 172.21.15.39:0/3769561629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e064c0 msgr2=0x5556b5df10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e064c0 0x5556b5df10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 -- 172.21.15.39:0/3769561629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 msgr2=0x5556b5e0bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 0x5556b5e0bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1118640 1 -- 172.21.15.39:0/3769561629 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556b5df62c0 con 0x5556b5df5b70 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.901+0000 7fe1d1919640 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 0x5556b5e0bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.902+0000 7fe1d1118640 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80097e0 tx=0x7fe1c8009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d59aad9fe5927bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.902+0000 7fe1b6ffd640 1 -- 172.21.15.39:0/3769561629 <== mon.2 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8031070 con 0x5556b5df5b70 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.902+0000 7fe1b6ffd640 1 -- 172.21.15.39:0/3769561629 <== mon.2 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c801f040 con 0x5556b5df5b70 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.902+0000 7fe1b6ffd640 1 -- 172.21.15.39:0/3769561629 <== mon.2 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c801e040 con 0x5556b5df5b70 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- 172.21.15.39:0/3769561629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 msgr2=0x5556b5e19110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80097e0 tx=0x7fe1c8009f10 comp rx=0 tx=0).stop 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- 172.21.15.39:0/3769561629 shutdown_connections 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5e06e40 0x5556b5e0bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e064c0 0x5556b5df10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 --2- 172.21.15.39:0/3769561629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5df5b70 0x5556b5e19110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- 172.21.15.39:0/3769561629 >> 172.21.15.39:0/3769561629 conn(0x5556b5df8090 msgr2=0x5556b5df8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- 172.21.15.39:0/3769561629 shutdown_connections 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- 172.21.15.39:0/3769561629 wait complete. 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 -- start start 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 Processor -- start 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.903+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e064c0 0x5556b5e156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e08580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1ad5f0 con 0x5556b5df5b70 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1acef0 con 0x5556b5e064c0 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc1aa0d0 con 0x5556b5e06e40 2024-09-10T22:02:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 10 client.0 _ll_register_callbacks cb 0x7fe1bc109640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35314/0 (socket says 172.21.15.39:35314) 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 -- 172.21.15.39:0/4134640584 learned_addr learned my addr 172.21.15.39:0/4134640584 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d0917640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e064c0 0x5556b5e156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1919640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e08580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 -- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 msgr2=0x5556b5e08580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e08580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 -- 172.21.15.39:0/4134640584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e064c0 msgr2=0x5556b5e156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e064c0 0x5556b5e156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 -- 172.21.15.39:0/4134640584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556b5e15ca0 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1919640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e08580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d1118640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8011850 tx=0x7fe1c8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732e3ac5f3720da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8031030 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.904+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c801f040 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe1c8003800 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe1c801e040 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 10 client.17160 fetch_fsmap learned FSMap version 39 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5556b5e89f20 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c801f040 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7fe1c8026a10 con 0x5556b5df5b70 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 10 client.17160 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 10 client.17160 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:02:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 20 client.17160 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e8a420 0x5556b5e8c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 4 client.17160 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 --> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556b5d6c8a0 con 0x5556b5e8a420 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.905+0000 7fe1d0917640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e8a420 0x5556b5e8c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d0917640 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e8a420 0x5556b5e8c840 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76c35cec4d07a3ee server_cookie=ab939dfe228a767 in_seq=0 out_seq=0 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1b4ff9640 10 client.17160 ms_handle_connect on v2:172.21.15.173:6838/4266233306 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1b4ff9640 1 -- 172.21.15.39:0/4134640584 <== mds.1 v2:172.21.15.173:6838/4266233306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556b5d6c8a0 con 0x5556b5e8a420 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1b4ff9640 10 client.17160 handle_command_reply: tid=0 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 client.17160 shutdown 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 msgr2=0x5556b5e15170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8011850 tx=0x7fe1c8009560 comp rx=0 tx=0).stop 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 shutdown_connections 2024-09-10T22:02:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:6838/4266233306,v1:172.21.15.173:6839/4266233306] conn(0x5556b5e8a420 0x5556b5e8c840 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556b5e06e40 0x5556b5e08580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556b5e064c0 0x5556b5e156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1b4ff9640 0 client.17160 ms_handle_reset on v2:172.21.15.173:6838/4266233306 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 --2- 172.21.15.39:0/4134640584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5556b5df5b70 0x5556b5e15170 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 >> 172.21.15.39:0/4134640584 conn(0x5556b5df8090 msgr2=0x5556b5e1ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 shutdown_connections 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.906+0000 7fe1d5751740 1 -- 172.21.15.39:0/4134640584 wait complete. 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d5751740 20 client.17160 trim_cache size 0 max 16384 2024-09-10T22:02:03.917 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:02:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 msgr2=0x7fe1b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 0x7fe1b80b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009fd0 tx=0x7fe1c4009500 comp rx=0 tx=0).stop 2024-09-10T22:02:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 msgr2=0x7fe1cc19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005940 tx=0x7fe1bc0040c0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 shutdown_connections 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe1b80b52e0 0x7fe1b80b77a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1cc108020 0x7fe1cc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1076a0 0x7fe1cc19a5c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 --2- 172.21.15.39:0/3701203449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc101c90 0x7fe1cc19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 >> 172.21.15.39:0/3701203449 conn(0x7fe1cc0fd700 msgr2=0x7fe1cc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 shutdown_connections 2024-09-10T22:02:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:03.907+0000 7fe1d337c640 1 -- 172.21.15.39:0/3701203449 wait complete. 2024-09-10T22:02:04.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:03 smithi070 ceph-mon[34909]: daemon mds.e restarted 2024-09-10T22:02:04.176 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:03 smithi039 ceph-mon[30872]: daemon mds.e restarted 2024-09-10T22:02:04.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:03 smithi173 ceph-mon[35294]: daemon mds.e restarted 2024-09-10T22:02:04.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:02:04.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 589 op/s 2024-09-10T22:02:04.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:02:04.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6834/3437650543,v1:172.21.15.70:6835/3437650543] up:boot 2024-09-10T22:02:04.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T22:02:04.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:04.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:04 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:04.988 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 589 op/s 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6834/3437650543,v1:172.21.15.70:6835/3437650543] up:boot 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:05.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:04 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:05.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 589 op/s 2024-09-10T22:02:05.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:02:05.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6834/3437650543,v1:172.21.15.70:6835/3437650543] up:boot 2024-09-10T22:02:05.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T22:02:05.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:05.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:04 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:05.364 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-10T22:02:05.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 -- 172.21.15.39:0/2144084373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8101c90 msgr2=0x7f1bd8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/2144084373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8101c90 0x7f1bd8102070 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009900 tx=0x7f1bc802a3f0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 -- 172.21.15.39:0/2144084373 shutdown_connections 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/2144084373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd8108020 0x7f1bd810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/2144084373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd81076a0 0x7f1bd8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/2144084373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8101c90 0x7f1bd8102070 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 -- 172.21.15.39:0/2144084373 >> 172.21.15.39:0/2144084373 conn(0x7f1bd80fd700 msgr2=0x7f1bd80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 -- 172.21.15.39:0/2144084373 shutdown_connections 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.526+0000 7f1bde0d2640 1 -- 172.21.15.39:0/2144084373 wait complete. 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 Processor -- start 2024-09-10T22:02:05.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 -- start start 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 0x7f1bd81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd81076a0 0x7f1bd8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8111ce0 con 0x7f1bd8108020 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8111b60 con 0x7f1bd81076a0 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.527+0000 7f1bde0d2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8111e60 con 0x7f1bd8101c90 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35334/0 (socket says 172.21.15.39:35334) 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 -- 172.21.15.39:0/4118761077 learned_addr learned my addr 172.21.15.39:0/4118761077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bcffff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd81076a0 0x7f1bd8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 0x7f1bd81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 -- 172.21.15.39:0/4118761077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 msgr2=0x7f1bd81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 0x7f1bd81981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 -- 172.21.15.39:0/4118761077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd81076a0 msgr2=0x7f1bd8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd81076a0 0x7f1bd8198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 -- 172.21.15.39:0/4118761077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd819e2a0 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 0x7f1bd81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd7fff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000ebb0 tx=0x7f1bd0007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd57fa640 1 -- 172.21.15.39:0/4118761077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0007ca0 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd57fa640 1 -- 172.21.15.39:0/4118761077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0007e40 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd819e530 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bd57fa640 1 -- 172.21.15.39:0/4118761077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00057d0 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.528+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd806aab0 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 Processor -- start 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1bd57fa640 1 -- 172.21.15.39:0/4118761077 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1bd0004a40 con 0x7f1bd8108020 2024-09-10T22:02:05.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 -- start start 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1deb18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1dec0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ee1de27ea0 con 0x55ee1deb1df0 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ee1de172d0 con 0x55ee1deb14d0 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1be04a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ee1de1b0e0 con 0x55ee1debdd80 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35342/0 (socket says 172.21.15.39:35342) 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1bd77fe640 1 -- 172.21.15.39:0/3704916186 learned_addr learned my addr 172.21.15.39:0/3704916186 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.531+0000 7f1bcffff640 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1dec0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bcffff640 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1deb18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 -- 172.21.15.39:0/3704916186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 msgr2=0x55ee1dec0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1dec0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd57fa640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 0x7f1bc40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 -- 172.21.15.39:0/3704916186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 msgr2=0x55ee1deb18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1deb18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 -- 172.21.15.39:0/3704916186 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1db75650 con 0x55ee1deb1df0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd7fff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 0x7f1bc40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009900 tx=0x7f1bc8032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1468bf35805d883 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bd57fa640 1 -- 172.21.15.39:0/4118761077 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1bd00e70d0 con 0x7f1bd8108020 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bcdffb640 1 -- 172.21.15.39:0/3704916186 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc803f070 con 0x55ee1deb1df0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bcdffb640 1 -- 172.21.15.39:0/3704916186 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc8032e40 con 0x55ee1deb1df0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.532+0000 7f1bcdffb640 1 -- 172.21.15.39:0/3704916186 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8035070 con 0x55ee1deb1df0 2024-09-10T22:02:05.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 -- 172.21.15.39:0/3704916186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 msgr2=0x55ee1debd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009900 tx=0x7f1bc8032cd0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1bd7fff640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 0x7f1bc40b7820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0023e00 tx=0x7f1bd00a2150 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 -- 172.21.15.39:0/3704916186 shutdown_connections 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1dec0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debd840 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 --2- 172.21.15.39:0/3704916186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1deb18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 -- 172.21.15.39:0/3704916186 >> 172.21.15.39:0/3704916186 conn(0x55ee1deaf300 msgr2=0x55ee1deb04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 -- 172.21.15.39:0/3704916186 shutdown_connections 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.533+0000 7f1be04a7740 1 -- 172.21.15.39:0/3704916186 wait complete. 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 -- start start 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 Processor -- start 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1debd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1debb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ee1dc78700 con 0x55ee1deb1df0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ee1ddb2160 con 0x55ee1deb14d0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ee1dec09a0 con 0x55ee1debdd80 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1be04a7740 10 client.0 _ll_register_callbacks cb 0x55ee1ddcb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35348/0 (socket says 172.21.15.39:35348) 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2493889274 learned_addr learned my addr 172.21.15.39:0/2493889274 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1debd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.534+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1debb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2493889274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 msgr2=0x55ee1debb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1debb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 msgr2=0x55ee1debd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1debd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2493889274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1dddfc90 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1debd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8031440 tx=0x7f1bc80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af9bed5f8db05f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc803f040 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee1de29df0 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1bc8004230 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1bc8035040 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1be04a7740 10 client.17172 fetch_fsmap learned FSMap version 39 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ee1decc350 con 0x55ee1deb1df0 2024-09-10T22:02:05.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.535+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee1de29df0 con 0x55ee1deb1df0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f1bc80047e0 con 0x55ee1deb1df0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 10 client.17172 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 20 client.17172 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1decd6a0 0x55ee1decfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 4 client.17172 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee1de258a0 con 0x55ee1decd6a0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1decd6a0 0x55ee1decfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1bb6ffd640 10 client.17172 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.536+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1decd6a0 0x55ee1decfa90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fdfbba673b43d0a server_cookie=7c127ad6d2354ea9 in_seq=0 out_seq=0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/2493889274 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee1de258a0 con 0x55ee1decd6a0 2024-09-10T22:02:05.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1bb6ffd640 10 client.17172 handle_command_reply: tid=0 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 client.17172 shutdown 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 msgr2=0x55ee1debab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8031440 tx=0x7f1bc80316d0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 shutdown_connections 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1decd6a0 0x55ee1decfa90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1debdd80 0x55ee1debb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1debab30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2493889274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1debd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1bb6ffd640 0 client.17172 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 >> 172.21.15.39:0/2493889274 conn(0x55ee1deaf300 msgr2=0x55ee1deb4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 shutdown_connections 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 1 -- 172.21.15.39:0/2493889274 wait complete. 2024-09-10T22:02:05.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.537+0000 7f1be04a7740 20 client.17172 trim_cache size 0 max 16384 2024-09-10T22:02:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 Processor -- start 2024-09-10T22:02:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 -- start start 2024-09-10T22:02:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb14d0 0x55ee1deba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1debdd80 0x55ee1deb98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81ac0f0 con 0x55ee1deb1df0 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81adcc0 con 0x55ee1debdd80 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.551+0000 7f1be04a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81ac7f0 con 0x55ee1deb14d0 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35360/0 (socket says 172.21.15.39:35360) 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bcffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb14d0 0x55ee1deba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2805273517 learned_addr learned my addr 172.21.15.39:0/2805273517 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bcffff640 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1debdd80 0x55ee1deb98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2805273517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb14d0 msgr2=0x55ee1deba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb14d0 0x55ee1deba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2805273517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1debdd80 msgr2=0x55ee1deb98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1debdd80 0x55ee1deb98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 -- 172.21.15.39:0/2805273517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1deb9030 con 0x55ee1deb1df0 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1bc802a430 tx=0x7f1bc8005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12963e444184500 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bcd7fa640 1 -- 172.21.15.39:0/2805273517 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc803f040 con 0x55ee1deb1df0 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bcd7fa640 1 -- 172.21.15.39:0/2805273517 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc805b020 con 0x55ee1deb1df0 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.552+0000 7f1bcd7fa640 1 -- 172.21.15.39:0/2805273517 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc804c900 con 0x55ee1deb1df0 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 -- 172.21.15.39:0/2805273517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 msgr2=0x55ee1deb93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1bc802a430 tx=0x7f1bc8005930 comp rx=0 tx=0).stop 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 -- 172.21.15.39:0/2805273517 shutdown_connections 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1debdd80 0x55ee1deb98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1deb1df0 0x55ee1deb93b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 --2- 172.21.15.39:0/2805273517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb14d0 0x55ee1deba020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 -- 172.21.15.39:0/2805273517 >> 172.21.15.39:0/2805273517 conn(0x55ee1deaf300 msgr2=0x55ee1deb5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 -- 172.21.15.39:0/2805273517 shutdown_connections 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.553+0000 7f1be04a7740 1 -- 172.21.15.39:0/2805273517 wait complete. 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 -- start start 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 Processor -- start 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1ded3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb1df0 0x55ee1deb7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81ad5f0 con 0x55ee1debdd80 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81acef0 con 0x55ee1deb14d0 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81aa0d0 con 0x55ee1deb1df0 2024-09-10T22:02:05.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.554+0000 7f1be04a7740 10 client.0 _ll_register_callbacks cb 0x7f1bc000be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35374/0 (socket says 172.21.15.39:35374) 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 -- 172.21.15.39:0/695568220 learned_addr learned my addr 172.21.15.39:0/695568220 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb1df0 0x55ee1deb7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1ded3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 -- 172.21.15.39:0/695568220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb1df0 msgr2=0x55ee1deb7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb1df0 0x55ee1deb7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 -- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 msgr2=0x55ee1ded3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1ded3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 -- 172.21.15.39:0/695568220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1df39200 con 0x55ee1debdd80 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bcffff640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005d00 tx=0x7f1bc8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105b8bcb12ff9c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:05.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0004110 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1bc00042b0 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.555+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc805b020 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1bc003d050 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 10 client.17178 fetch_fsmap learned FSMap version 39 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ee1df3a4c0 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc805b020 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f1bc0020490 con 0x55ee1debdd80 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 10 client.17178 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 20 client.17178 populate_metadata read hostname 'smithi039' 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1df3ac50 0x55ee1df3d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:05.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 4 client.17178 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 --> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee1de22cd0 con 0x55ee1df3ac50 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.556+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1df3ac50 0x55ee1df3d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1bd77fe640 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1df3ac50 0x55ee1df3d070 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a310210e63a0ae7 server_cookie=556eaa755338c4b2 in_seq=0 out_seq=0 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1bb6ffd640 10 client.17178 ms_handle_connect on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1bb6ffd640 1 -- 172.21.15.39:0/695568220 <== mds.0 v2:172.21.15.70:6838/398684741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee1de22cd0 con 0x55ee1df3ac50 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1bb6ffd640 10 client.17178 handle_command_reply: tid=0 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 client.17178 shutdown 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 msgr2=0x55ee1deb8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005d00 tx=0x7f1bc8005780 comp rx=0 tx=0).stop 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 shutdown_connections 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:6838/398684741,v1:172.21.15.70:6839/398684741] conn(0x55ee1df3ac50 0x55ee1df3d070 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1bb6ffd640 0 client.17178 ms_handle_reset on v2:172.21.15.70:6838/398684741 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee1debdd80 0x55ee1deb8340 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee1deb1df0 0x55ee1deb7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 --2- 172.21.15.39:0/695568220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee1deb14d0 0x55ee1ded3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 >> 172.21.15.39:0/695568220 conn(0x55ee1deaf300 msgr2=0x55ee1deb0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 shutdown_connections 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.557+0000 7f1be04a7740 1 -- 172.21.15.39:0/695568220 wait complete. 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1be04a7740 20 client.17178 trim_cache size 0 max 16384 2024-09-10T22:02:05.570 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 msgr2=0x7f1bc40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 0x7f1bc40b7820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0023e00 tx=0x7f1bd00a2150 comp rx=0 tx=0).stop 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 msgr2=0x7f1bd819dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000ebb0 tx=0x7f1bd0007590 comp rx=0 tx=0).stop 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 shutdown_connections 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f1bc40b5360 0x7f1bc40b7820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd8108020 0x7f1bd819dad0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd81076a0 0x7f1bd8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 --2- 172.21.15.39:0/4118761077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8101c90 0x7f1bd81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:05.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 >> 172.21.15.39:0/4118761077 conn(0x7f1bd80fd700 msgr2=0x7f1bd80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:05.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 shutdown_connections 2024-09-10T22:02:05.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:05.558+0000 7f1bde0d2640 1 -- 172.21.15.39:0/4118761077 wait complete. 2024-09-10T22:02:05.703 DEBUG:teuthology.parallel:result is None 2024-09-10T22:02:05.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:02:05.738 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:02:05.738 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T22:02:05.749 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T22:02:05.787 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T22:02:05.795 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T22:02:06.403 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T22:02:06.404 INFO:tasks.fwd_scrub:done joining 2024-09-10T22:02:06.404 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T22:02:06.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:02:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.517+0000 7f3a14e2a640 1 -- 172.21.15.39:0/1379917281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 msgr2=0x7f3a10109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.517+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/1379917281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10109d40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009cd0 tx=0x7f3a0802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 -- 172.21.15.39:0/1379917281 shutdown_connections 2024-09-10T22:02:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/1379917281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10109d40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/1379917281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 0x7f3a10102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/1379917281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 -- 172.21.15.39:0/1379917281 >> 172.21.15.39:0/1379917281 conn(0x7f3a100fd190 msgr2=0x7f3a100ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 -- 172.21.15.39:0/1379917281 shutdown_connections 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 -- 172.21.15.39:0/1379917281 wait complete. 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 Processor -- start 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.518+0000 7f3a14e2a640 1 -- start start 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 0x7f3a10103ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10104410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1010d550 con 0x7f3a101033c0 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1010d3d0 con 0x7f3a10102a00 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a14e2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1010d6d0 con 0x7f3a101018b0 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.39:52224/0 (socket says 172.21.15.39:52224) 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 -- 172.21.15.39:0/2006764624 learned_addr learned my addr 172.21.15.39:0/2006764624 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0dd9b640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 0x7f3a10103ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 -- 172.21.15.39:0/2006764624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 msgr2=0x7f3a10103ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 0x7f3a10103ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 -- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 msgr2=0x7f3a10104410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10104410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 -- 172.21.15.39:0/2006764624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a10104c80 con 0x7f3a101018b0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0ed9d640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f3a0e59c640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000d950 tx=0x7f3a0000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.519+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00017030 con 0x7f3a101018b0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.520+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a00004020 con 0x7f3a101018b0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.520+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a101a2e30 con 0x7f3a101018b0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.520+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a000047a0 con 0x7f3a101018b0 2024-09-10T22:02:06.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.520+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a101a3290 con 0x7f3a101018b0 2024-09-10T22:02:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.520+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a101a3520 con 0x7f3a101018b0 2024-09-10T22:02:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.522+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3a00009a30 con 0x7f3a101018b0 2024-09-10T22:02:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.523+0000 7f39ff7fe640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 0x7f39f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.523+0000 7f3a0dd9b640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 0x7f39f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.523+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3a000e5c50 con 0x7f3a101018b0 2024-09-10T22:02:06.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.523+0000 7f3a0dd9b640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 0x7f39f80b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009b50 tx=0x7f3a04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:06.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.526+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a000acb20 con 0x7f3a101018b0 2024-09-10T22:02:06.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.711+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a101a38b0 con 0x7f3a101018b0 2024-09-10T22:02:06.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.713+0000 7f39ff7fe640 1 -- 172.21.15.39:0/2006764624 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22652 (secure 0 0 0) 0x7f3a000ac420 con 0x7f3a101018b0 2024-09-10T22:02:06.715 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:02:06.715 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":74,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T22:02:02.964186+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 msgr2=0x7f39f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 0x7f39f80b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009b50 tx=0x7f3a04005f90 comp rx=0 tx=0).stop 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 msgr2=0x7f3a10105670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000d950 tx=0x7f3a0000de10 comp rx=0 tx=0).stop 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 shutdown_connections 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f39f80b52e0 0x7f39f80b77a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a101033c0 0x7f3a10104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a10102a00 0x7f3a10103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 --2- 172.21.15.39:0/2006764624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a101018b0 0x7f3a10105670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.715+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 >> 172.21.15.39:0/2006764624 conn(0x7f3a100fd190 msgr2=0x7f3a100feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.716+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 shutdown_connections 2024-09-10T22:02:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.716+0000 7f3a14e2a640 1 -- 172.21.15.39:0/2006764624 wait complete. 2024-09-10T22:02:06.728 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:48:27.848097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T21:52:56.779900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T21:52:58.502820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:02:06.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:02:06.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.834+0000 7f2f03a40640 1 -- 172.21.15.39:0/1325022657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc108680 msgr2=0x7f2efc10ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.834+0000 7f2f03a40640 1 --2- 172.21.15.39:0/1325022657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc108680 0x7f2efc10ab40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009ca0 tx=0x7f2ef402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- 172.21.15.39:0/1325022657 shutdown_connections 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- 172.21.15.39:0/1325022657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc108680 0x7f2efc10ab40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- 172.21.15.39:0/1325022657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc105ad0 0x7f2efc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- 172.21.15.39:0/1325022657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 0x7f2efc105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- 172.21.15.39:0/1325022657 >> 172.21.15.39:0/1325022657 conn(0x7f2efc0fd110 msgr2=0x7f2efc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- 172.21.15.39:0/1325022657 shutdown_connections 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- 172.21.15.39:0/1325022657 wait complete. 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 Processor -- start 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- start start 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 0x7f2efc198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 0x7f2efc199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc10e5d0 con 0x7f2efc105ad0 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc10e450 con 0x7f2efc06ba60 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.835+0000 7f2f03a40640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc10e750 con 0x7f2efc108680 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35412/0 (socket says 172.21.15.39:35412) 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 -- 172.21.15.39:0/2318701433 learned_addr learned my addr 172.21.15.39:0/2318701433 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f01fdd640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 0x7f2efc199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f017dc640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 0x7f2efc198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 -- 172.21.15.39:0/2318701433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 msgr2=0x7f2efc199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 0x7f2efc199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 -- 172.21.15.39:0/2318701433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 msgr2=0x7f2efc198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 0x7f2efc198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 -- 172.21.15.39:0/2318701433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc19a7a0 con 0x7f2efc105ad0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f01fdd640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 0x7f2efc199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f00fdb640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9f0 tx=0x7f2eec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00cd80 con 0x7f2efc105ad0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0054d0 con 0x7f2efc105ad0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc19aa90 con 0x7f2efc105ad0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec010690 con 0x7f2efc105ad0 2024-09-10T22:02:06.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.836+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc1a1160 con 0x7f2efc105ad0 2024-09-10T22:02:06.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.837+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc105f30 con 0x7f2efc105ad0 2024-09-10T22:02:06.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.839+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2eec004e30 con 0x7f2efc105ad0 2024-09-10T22:02:06.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.839+0000 7f2ef27fc640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 0x7f2ee80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:06.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.840+0000 7f2f017dc640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 0x7f2ee80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:06.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.840+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2eec0e62f0 con 0x7f2efc105ad0 2024-09-10T22:02:06.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.840+0000 7f2f017dc640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 0x7f2ee80b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005e10 tx=0x7f2ef8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:06.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:06.842+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2eec056220 con 0x7f2efc105ad0 2024-09-10T22:02:07.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.059+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2efc02e5c0 con 0x7f2efc105ad0 2024-09-10T22:02:07.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.059+0000 7f2ef27fc640 1 -- 172.21.15.39:0/2318701433 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f2eec0ad1c0 con 0x7f2efc105ad0 2024-09-10T22:02:07.060 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-10T22:02:07.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 msgr2=0x7f2ee80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 0x7f2ee80b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005e10 tx=0x7f2ef8005da0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 msgr2=0x7f2efc1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9f0 tx=0x7f2eec00edf0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 shutdown_connections 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f2ee80b52e0 0x7f2ee80b77a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2efc108680 0x7f2efc199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2efc105ad0 0x7f2efc1992b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 --2- 172.21.15.39:0/2318701433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2efc06ba60 0x7f2efc198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 >> 172.21.15.39:0/2318701433 conn(0x7f2efc0fd110 msgr2=0x7f2efc103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 shutdown_connections 2024-09-10T22:02:07.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.061+0000 7f2f03a40640 1 -- 172.21.15.39:0/2318701433 wait complete. 2024-09-10T22:02:07.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:06 smithi039 ceph-mon[30872]: pgmap v555: 97 pgs: 97 active+clean; 67 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 516 op/s 2024-09-10T22:02:07.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:06 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2006764624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:07.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:02:07.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:06 smithi070 ceph-mon[34909]: pgmap v555: 97 pgs: 97 active+clean; 67 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 516 op/s 2024-09-10T22:02:07.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:06 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2006764624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 -- 172.21.15.39:0/3302522660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1029e0 msgr2=0x7f638c102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 --2- 172.21.15.39:0/3302522660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1029e0 0x7f638c102e60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6380009930 tx=0x7f638002a420 comp rx=0 tx=0).stop 2024-09-10T22:02:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 -- 172.21.15.39:0/3302522660 shutdown_connections 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 --2- 172.21.15.39:0/3302522660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1033a0 0x7f638c109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 --2- 172.21.15.39:0/3302522660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1029e0 0x7f638c102e60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 --2- 172.21.15.39:0/3302522660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 0x7f638c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 -- 172.21.15.39:0/3302522660 >> 172.21.15.39:0/3302522660 conn(0x7f638c0fd150 msgr2=0x7f638c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 -- 172.21.15.39:0/3302522660 shutdown_connections 2024-09-10T22:02:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.179+0000 7f6391b5d640 1 -- 172.21.15.39:0/3302522660 wait complete. 2024-09-10T22:02:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 Processor -- start 2024-09-10T22:02:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 -- start start 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 0x7f638c105650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1029e0 0x7f638c103eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10d4e0 con 0x7f638c1033a0 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10d360 con 0x7f638c101890 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f6391b5d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10d660 con 0x7f638c1029e0 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f638bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f638bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35422/0 (socket says 172.21.15.39:35422) 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f638bfff640 1 -- 172.21.15.39:0/2216345381 learned_addr learned my addr 172.21.15.39:0/2216345381 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f638b7fe640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 0x7f638c105650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.180+0000 7f638affd640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1029e0 0x7f638c103eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 -- 172.21.15.39:0/2216345381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1029e0 msgr2=0x7f638c103eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1029e0 0x7f638c103eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 -- 172.21.15.39:0/2216345381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 msgr2=0x7f638c105650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 0x7f638c105650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 -- 172.21.15.39:0/2216345381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c104c60 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f638bfff640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f638400cce0 tx=0x7f638400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638400f450 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f638400faa0 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c1a2e90 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384018b70 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.181+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c1a3350 con 0x7f638c1033a0 2024-09-10T22:02:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.182+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c1a35e0 con 0x7f638c1033a0 2024-09-10T22:02:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.183+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f638400f5f0 con 0x7f638c1033a0 2024-09-10T22:02:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.184+0000 7f6388ff9640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 0x7f63740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.184+0000 7f638b7fe640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 0x7f63740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.184+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63840e6250 con 0x7f638c1033a0 2024-09-10T22:02:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.185+0000 7f638b7fe640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 0x7f63740b7820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f637c009bd0 tx=0x7f637c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.187+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6384014030 con 0x7f638c1033a0 2024-09-10T22:02:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:06 smithi173 ceph-mon[35294]: pgmap v555: 97 pgs: 97 active+clean; 67 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 516 op/s 2024-09-10T22:02:07.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:06 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2006764624' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:07.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.373+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f638c1a3970 con 0x7f638c1033a0 2024-09-10T22:02:07.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.373+0000 7f6388ff9640 1 -- 172.21.15.39:0/2216345381 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f63840ad230 con 0x7f638c1033a0 2024-09-10T22:02:07.375 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-10T22:02:07.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 msgr2=0x7f63740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 0x7f63740b7820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f637c009bd0 tx=0x7f637c005f90 comp rx=0 tx=0).stop 2024-09-10T22:02:07.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 msgr2=0x7f638c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f638400cce0 tx=0x7f638400a620 comp rx=0 tx=0).stop 2024-09-10T22:02:07.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 shutdown_connections 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f63740b5360 0x7f63740b7820 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c1033a0 0x7f638c1043f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f638c1029e0 0x7f638c103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 --2- 172.21.15.39:0/2216345381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f638c101890 0x7f638c105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 >> 172.21.15.39:0/2216345381 conn(0x7f638c0fd150 msgr2=0x7f638c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 shutdown_connections 2024-09-10T22:02:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.375+0000 7f6391b5d640 1 -- 172.21.15.39:0/2216345381 wait complete. 2024-09-10T22:02:07.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:02:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/2911433784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 msgr2=0x7fcf8810ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/2911433784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf8810ae20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009cd0 tx=0x7fcf8002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/2911433784 shutdown_connections 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/2911433784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf8810ae20 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/2911433784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88103ae0 0x7fcf88103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/2911433784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88102990 0x7fcf88102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/2911433784 >> 172.21.15.39:0/2911433784 conn(0x7fcf880fe250 msgr2=0x7fcf88100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/2911433784 shutdown_connections 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.493+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/2911433784 wait complete. 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 Processor -- start 2024-09-10T22:02:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 -- start start 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 0x7fcf88198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 0x7fcf881993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8810e600 con 0x7fcf881044a0 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8810e480 con 0x7fcf88103ae0 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8d1c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8810e780 con 0x7fcf88102990 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35450/0 (socket says 172.21.15.39:35450) 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8759e640 1 -- 172.21.15.39:0/3978796618 learned_addr learned my addr 172.21.15.39:0/3978796618 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.494+0000 7fcf8659c640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 0x7fcf881993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf86d9d640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 0x7fcf88198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 -- 172.21.15.39:0/3978796618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 msgr2=0x7fcf88198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 0x7fcf88198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 -- 172.21.15.39:0/3978796618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 msgr2=0x7fcf881993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 0x7fcf881993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 -- 172.21.15.39:0/3978796618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8819a860 con 0x7fcf881044a0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf86d9d640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 0x7fcf88198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8659c640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 0x7fcf881993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8759e640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf80033040 tx=0x7fcf80003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80004240 con 0x7fcf881044a0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf800305a0 con 0x7fcf881044a0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8819aaf0 con 0x7fcf881044a0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf800466e0 con 0x7fcf881044a0 2024-09-10T22:02:07.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.495+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881a1220 con 0x7fcf881044a0 2024-09-10T22:02:07.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.496+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf88102d90 con 0x7fcf881044a0 2024-09-10T22:02:07.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.498+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcf8004e070 con 0x7fcf881044a0 2024-09-10T22:02:07.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.499+0000 7fcf6ffff640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.499+0000 7fcf86d9d640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.499+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcf8002e030 con 0x7fcf881044a0 2024-09-10T22:02:07.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.500+0000 7fcf86d9d640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 0x7fcf700b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009c30 tx=0x7fcf78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.502+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcf8004b060 con 0x7fcf881044a0 2024-09-10T22:02:07.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.688+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcf8802e5c0 con 0x7fcf881044a0 2024-09-10T22:02:07.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.688+0000 7fcf6ffff640 1 -- 172.21.15.39:0/3978796618 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7fcf800ce0f0 con 0x7fcf881044a0 2024-09-10T22:02:07.690 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 msgr2=0x7fcf700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 0x7fcf700b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009c30 tx=0x7fcf78005f90 comp rx=0 tx=0).stop 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 msgr2=0x7fcf88199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf80033040 tx=0x7fcf80003b80 comp rx=0 tx=0).stop 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 shutdown_connections 2024-09-10T22:02:07.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf881044a0 0x7fcf88199fa0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88103ae0 0x7fcf881993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 --2- 172.21.15.39:0/3978796618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88102990 0x7fcf88198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 >> 172.21.15.39:0/3978796618 conn(0x7fcf880fe250 msgr2=0x7fcf88106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 shutdown_connections 2024-09-10T22:02:07.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.691+0000 7fcf8d1c2640 1 -- 172.21.15.39:0/3978796618 wait complete. 2024-09-10T22:02:07.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 -- 172.21.15.39:0/942537423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641018a0 msgr2=0x7fb264101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/942537423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641018a0 0x7fb264101ca0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb258009930 tx=0x7fb25802a420 comp rx=0 tx=0).stop 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 -- 172.21.15.39:0/942537423 shutdown_connections 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/942537423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb264109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/942537423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641029f0 0x7fb264102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/942537423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641018a0 0x7fb264101ca0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.805+0000 7fb26b1b4640 1 -- 172.21.15.39:0/942537423 >> 172.21.15.39:0/942537423 conn(0x7fb2640fd180 msgr2=0x7fb2640ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- 172.21.15.39:0/942537423 shutdown_connections 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- 172.21.15.39:0/942537423 wait complete. 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 Processor -- start 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- start start 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 0x7fb264198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb26419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb26410e6a0 con 0x7fb2641029f0 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb26410e520 con 0x7fb2641018a0 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb26b1b4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb26410e820 con 0x7fb2641033b0 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb263fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb263fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35470/0 (socket says 172.21.15.39:35470) 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.806+0000 7fb263fff640 1 -- 172.21.15.39:0/877815545 learned_addr learned my addr 172.21.15.39:0/877815545 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb269751640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb26419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb268f50640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 0x7fb264198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 -- 172.21.15.39:0/877815545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 msgr2=0x7fb26419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb26419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 -- 172.21.15.39:0/877815545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 msgr2=0x7fb264198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 0x7fb264198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 -- 172.21.15.39:0/877815545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26419a8f0 con 0x7fb2641029f0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb268f50640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 0x7fb264198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb269751640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb26419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb263fff640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb25000e9f0 tx=0x7fb25000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25000cd80 con 0x7fb2641029f0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2500108e0 con 0x7fb2641029f0 2024-09-10T22:02:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250018980 con 0x7fb2641029f0 2024-09-10T22:02:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26419abe0 con 0x7fb2641029f0 2024-09-10T22:02:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.807+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2641a12b0 con 0x7fb2641029f0 2024-09-10T22:02:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.808+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb264108bb0 con 0x7fb2641029f0 2024-09-10T22:02:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.810+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb250010430 con 0x7fb2641029f0 2024-09-10T22:02:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.810+0000 7fb261ffb640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 0x7fb2540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.810+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb2500e6520 con 0x7fb2641029f0 2024-09-10T22:02:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.810+0000 7fb268f50640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 0x7fb2540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.811+0000 7fb268f50640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 0x7fb2540b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb258009930 tx=0x7fb258005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:07.813+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb2500ad3f0 con 0x7fb2641029f0 2024-09-10T22:02:08.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.048+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb264063d50 con 0x7fb2641029f0 2024-09-10T22:02:08.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.056+0000 7fb261ffb640 1 -- 172.21.15.39:0/877815545 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+827940 (secure 0 0 0) 0x7fb2500accf0 con 0x7fb2641029f0 2024-09-10T22:02:08.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:02:08.072 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:02:08.072 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 20, 2024-09-10T22:02:08.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.072 INFO:teuthology.orchestra.run.smithi039.stdout: "active_gid": 14150, 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "active_name": "x", 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addrs": { 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6800", 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 423421889 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6801", 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 423421889 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:08.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addr": "172.21.15.39:6801/423421889", 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "active_change": "2024-09-10T21:45:43.360780+0000", 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "available": true, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "standbys": [ 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24121, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "z", 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.074 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.076 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.077 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.078 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.079 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.081 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-10T22:02:08.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-10T22:02:08.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-10T22:02:08.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-10T22:02:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-10T22:02:08.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.091 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.094 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-10T22:02:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-10T22:02:08.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:02:08.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.100 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.101 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.103 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-10T22:02:08.106 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.107 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.109 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.112 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.113 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.118 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-10T22:02:08.119 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.121 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.122 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-10T22:02:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.126 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:02:08.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-10T22:02:08.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-10T22:02:08.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-10T22:02:08.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nginx": { 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nginx", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nginx container image", 2024-09-10T22:02:08.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-10T22:02:08.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.138 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:02:08.139 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:02:08.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba_metrics": { 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.142 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:02:08.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:02:08.145 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-10T22:02:08.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.152 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-10T22:02:08.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.155 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.161 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-10T22:02:08.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-10T22:02:08.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.168 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-10T22:02:08.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-10T22:02:08.170 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-10T22:02:08.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-10T22:02:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:02:08.173 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-10T22:02:08.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.178 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-10T22:02:08.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-10T22:02:08.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:02:08.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.182 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.184 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.185 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.186 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-10T22:02:08.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.189 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.191 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.193 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:02:08.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:02:08.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.220 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.221 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:02:08.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:02:08.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.225 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-10T22:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.233 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.234 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.237 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.239 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.244 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.245 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.246 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.247 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.248 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.249 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.252 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.256 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.261 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.269 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.272 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.274 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-10T22:02:08.280 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:02:08.283 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:02:08.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.285 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.288 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.289 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:02:08.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:08.296 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.297 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.300 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.304 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.306 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.307 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.310 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.318 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.322 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.323 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.329 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.331 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.335 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.341 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.343 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.345 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.348 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.353 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.355 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.358 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.359 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.360 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.365 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.366 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.369 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.375 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.378 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:08.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.380 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.383 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.384 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-10T22:02:08.387 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.390 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.391 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.394 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.396 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.400 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.401 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.402 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.404 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.405 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.410 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.413 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.416 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max_requests": { 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_requests", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.423 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.425 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.428 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.429 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.431 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.432 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.433 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.439 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.440 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.441 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.442 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.443 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.444 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.446 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.447 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.448 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.449 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.450 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.452 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.453 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.454 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.460 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.461 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "internal_store_backend": { 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "internal_store_backend", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.463 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-09-10T22:02:08.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.469 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:02:08.471 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.472 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.474 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.475 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.476 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.477 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-10T22:02:08.478 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.479 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.480 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.481 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.484 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.485 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.488 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.489 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.491 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.495 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.497 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.498 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-10T22:02:08.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-10T22:02:08.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.504 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.506 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.508 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-10T22:02:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.514 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.515 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.516 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.517 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.518 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.522 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.523 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.524 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.525 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.526 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.528 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.529 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.530 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.531 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.532 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-10T22:02:08.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-10T22:02:08.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.536 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.539 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.540 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.543 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.544 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.545 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.546 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.547 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.548 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-10T22:02:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.550 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.551 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24122, 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "y", 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.552 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.553 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.554 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.555 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.556 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.557 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.558 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.559 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.560 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.561 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.564 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.565 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.566 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.567 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.568 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-10T22:02:08.569 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.571 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.572 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.573 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-10T22:02:08.574 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-10T22:02:08.575 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.576 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.577 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.578 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.579 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.580 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.581 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.582 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.583 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.584 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.585 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.586 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.587 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.588 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.589 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.590 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.591 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-10T22:02:08.592 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-10T22:02:08.593 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.594 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.595 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.596 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:02:08.597 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.598 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-10T22:02:08.600 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-10T22:02:08.601 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.602 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.603 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.605 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.606 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.607 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.608 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:02:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.610 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.611 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nginx": { 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nginx", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.613 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nginx container image", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.614 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.615 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:02:08.616 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.617 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.619 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.620 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba_metrics": { 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.621 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.622 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.623 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.624 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.625 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-10T22:02:08.626 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-10T22:02:08.627 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.628 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.629 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.630 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.631 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.632 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.634 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.636 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.638 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.640 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.641 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.642 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:02:08.643 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.644 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:02:08.645 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:02:08.646 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-10T22:02:08.647 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-10T22:02:08.648 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.649 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.653 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.654 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.655 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.656 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.657 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-10T22:02:08.658 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-10T22:02:08.659 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-10T22:02:08.660 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.661 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.662 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:02:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:02:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:02:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:02:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:02:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:02:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:02:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:02:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:02:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:02:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.706 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.707 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.708 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.709 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.710 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.711 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-10T22:02:08.712 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-10T22:02:08.713 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.714 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.715 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.716 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.717 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:02:08.718 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.719 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:02:08.720 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:02:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-10T22:02:08.722 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-10T22:02:08.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-10T22:02:08.724 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-10T22:02:08.725 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:08.726 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.728 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.729 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.730 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.731 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.732 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.733 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.734 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.735 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.736 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.737 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.738 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:08.739 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.740 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.741 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.742 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.743 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.744 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.745 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.746 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.747 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.748 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.749 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-10T22:02:08.750 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-10T22:02:08.751 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.752 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.753 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.754 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.755 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.756 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.757 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.758 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.759 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.760 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.761 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.762 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.763 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.764 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.765 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.766 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.767 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.768 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.769 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.770 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.771 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.772 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.773 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.774 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.775 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.776 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.778 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.780 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.781 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.782 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.783 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.784 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.785 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.786 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.787 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.790 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.792 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.793 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.794 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.795 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.796 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.797 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.798 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.799 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.800 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.801 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.802 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.803 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.804 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.805 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.806 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.807 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.808 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.809 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.810 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.811 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.812 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.813 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.814 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:02:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.816 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.817 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.818 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.819 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.820 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.822 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.823 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.824 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.825 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.826 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.827 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.828 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.829 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.830 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.831 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.832 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.833 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.835 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.836 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.837 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.838 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.839 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.840 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:08.841 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.843 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.844 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.846 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.847 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.848 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.849 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.850 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.851 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.852 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.853 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.854 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.855 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.856 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.857 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.858 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.859 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.860 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.861 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.862 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.863 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.864 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.865 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.867 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.868 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.869 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-10T22:02:08.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.871 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.872 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.873 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.875 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.876 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.877 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.879 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.880 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.881 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-10T22:02:08.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-10T22:02:08.883 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.884 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.885 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.886 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.887 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.888 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.889 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.890 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.891 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.892 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.893 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.894 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.895 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-10T22:02:08.897 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.898 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.899 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.900 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.902 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.903 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.904 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.905 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:02:08.906 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-10T22:02:08.908 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.909 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.913 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.915 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.916 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max_requests": { 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_requests", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.917 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.918 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.919 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.920 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.921 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.922 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.923 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.924 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.925 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.926 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.927 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.928 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.929 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.930 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.931 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.932 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.933 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.935 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.936 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.937 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.938 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.939 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.940 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-10T22:02:08.941 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-10T22:02:08.942 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.945 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.946 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.947 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.948 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.949 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.951 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.953 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.954 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.955 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "internal_store_backend": { 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "internal_store_backend", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:02:08.956 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.957 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.958 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.959 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.960 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.962 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.963 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.964 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.965 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.966 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.967 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.968 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.969 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.970 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.971 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.972 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.973 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.974 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.978 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.979 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-10T22:02:08.980 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.981 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.982 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.983 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.984 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.985 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.986 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-10T22:02:08.987 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.988 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.989 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.990 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:08.991 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.992 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:08.993 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:08.994 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:08.995 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-10T22:02:08.996 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:02:08.997 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.998 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:08.999 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.000 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.002 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.004 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:09.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.006 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-10T22:02:09.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.008 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.011 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.013 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.018 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.019 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.021 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.024 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.025 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.027 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.028 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.029 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.031 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.032 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-10T22:02:09.033 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.035 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.036 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.038 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.041 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.042 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.045 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.046 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.047 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-10T22:02:09.048 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.049 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.050 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.051 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "modules": [ 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard", 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "iostat", 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "nfs", 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "restful" 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-10T22:02:09.052 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.053 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.056 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.057 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.060 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.061 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.064 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-10T22:02:09.065 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-10T22:02:09.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.067 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.068 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.069 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.070 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-10T22:02:09.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.072 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.074 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-10T22:02:09.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-10T22:02:09.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.077 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.078 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.080 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.082 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.085 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.090 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.091 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.094 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:09.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-10T22:02:09.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:02:09.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:02:09.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.106 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-10T22:02:09.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.109 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.111 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nginx": { 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nginx", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nginx container image", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.113 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.119 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba_metrics": { 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:02:09.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.124 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:02:09.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.137 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:02:09.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.145 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:02:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-10T22:02:09.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.157 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-10T22:02:09.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.159 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.160 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.162 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.164 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.165 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.167 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.168 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-10T22:02:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.170 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.171 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:02:09.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:02:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:02:09.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:02:09.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.178 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:02:09.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:02:09.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.181 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.182 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:02:09.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:02:09.191 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:02:09.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:02:09.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:02:09.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.195 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.204 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:02:09.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.220 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.224 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.226 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.229 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.239 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.244 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.245 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-10T22:02:09.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.261 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:02:09.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.268 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.273 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.274 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-10T22:02:09.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-10T22:02:09.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-10T22:02:09.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.279 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.281 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.282 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.283 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.284 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-10T22:02:09.286 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.287 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.292 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:02:09.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-10T22:02:09.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.295 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.296 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.297 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.299 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.301 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.303 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.305 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.313 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.315 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.318 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.322 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.331 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.334 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.335 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.336 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.339 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.340 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-10T22:02:09.341 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.344 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.345 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.351 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.354 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.356 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.357 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.360 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.361 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.364 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-10T22:02:09.365 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.368 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.370 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.371 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-10T22:02:09.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.375 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.376 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.378 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-10T22:02:09.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:02:09.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-10T22:02:09.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.387 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.391 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-10T22:02:09.392 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-10T22:02:09.394 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.395 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.397 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.398 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-10T22:02:09.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.401 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-10T22:02:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.407 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max_requests": { 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_requests", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.412 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.413 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.414 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.418 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.420 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.421 INFO:teuthology.orchestra.run.smithi039.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.423 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.424 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.426 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.427 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.429 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.432 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.433 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.434 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.435 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.436 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.438 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.440 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.443 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.444 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-10T22:02:09.445 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.446 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-10T22:02:09.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.448 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.449 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.450 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "internal_store_backend": { 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "internal_store_backend", 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.452 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.454 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.455 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.456 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.458 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-10T22:02:09.459 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.460 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.462 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.463 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.464 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.466 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.469 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.471 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.472 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.473 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.474 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.475 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.477 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.478 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.479 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.480 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-10T22:02:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.484 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.485 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.486 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.487 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.488 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-10T22:02:09.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-10T22:02:09.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.492 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.493 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.494 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.495 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.497 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.499 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-10T22:02:09.500 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-10T22:02:09.501 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.502 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.505 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.506 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.510 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.512 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.515 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.516 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.517 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.518 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.521 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.523 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.524 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-10T22:02:09.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-10T22:02:09.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:02:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.529 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.530 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.531 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-10T22:02:09.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.533 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.537 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-10T22:02:09.538 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-10T22:02:09.539 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:02:09.540 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-10T22:02:09.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-10T22:02:09.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-10T22:02:09.543 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.544 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "services": { 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard": "https://172.21.15.39:8443/" 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "always_on_modules": { 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "octopus": [ 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-10T22:02:09.545 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "pacific": [ 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-10T22:02:09.546 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "quincy": [ 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-10T22:02:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "reef": [ 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-10T22:02:09.548 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "squid": [ 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-10T22:02:09.549 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "force_disabled_modules": {}, 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "last_failure_osd_epoch": 3, 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "active_clients": [ 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3587255917 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "libcephsqlite", 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2509630594 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-10T22:02:09.551 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 673467528 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1568331400 2024-09-10T22:02:09.552 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.553 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.553 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:09.553 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-10T22:02:09.553 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 msgr2=0x7fb2540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 0x7fb2540b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb258009930 tx=0x7fb258005fd0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 msgr2=0x7fb264199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb25000e9f0 tx=0x7fb25000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 shutdown_connections 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb2540b52e0 0x7fb2540b77a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2641033b0 0x7fb26419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2641029f0 0x7fb264199400 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 --2- 172.21.15.39:0/877815545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2641018a0 0x7fb264198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.061+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 >> 172.21.15.39:0/877815545 conn(0x7fb2640fd180 msgr2=0x7fb264105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.062+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 shutdown_connections 2024-09-10T22:02:09.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:08.062+0000 7fb26b1b4640 1 -- 172.21.15.39:0/877815545 wait complete. 2024-09-10T22:02:09.555 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:07 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2318701433' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.555 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:07 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2216345381' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.555 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:07 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/3978796618' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.562 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T22:02:09.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T22:02:09.563 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:08 smithi039 ceph-mon[30872]: pgmap v556: 97 pgs: 97 active+clean; 51 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 514 op/s 2024-09-10T22:02:09.563 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:08 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/877815545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:02:09.564 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:07 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2318701433' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.564 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:07 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2216345381' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:07 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/3978796618' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:08 smithi173 ceph-mon[35294]: pgmap v556: 97 pgs: 97 active+clean; 51 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 514 op/s 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:08 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/877815545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:07 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2318701433' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:07 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2216345381' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:07 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/3978796618' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:08 smithi070 ceph-mon[34909]: pgmap v556: 97 pgs: 97 active+clean; 51 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 514 op/s 2024-09-10T22:02:09.565 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:08 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/877815545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:02:09.837 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1006, 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1006, 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4498643, 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 319085, 2024-09-10T22:02:10.285 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.108302332, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.041427385, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.027546892, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.031457477, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1005, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.046625782, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000046393 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.286 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 409, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 524, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3462704, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 418100, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:10.287 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.050727756, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.023517402, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.012307480, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.011050753, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 522, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.020678931, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000039614 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.288 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 288288 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 320, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 301, 2024-09-10T22:02:10.289 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 958728, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 139210, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.039562166, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.017638594, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.024348693, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.003596843, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 300, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.016492321, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000054974 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:10.290 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 924512, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 95008 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-10T22:02:10.291 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2677, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.064625945, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000024141 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-10T22:02:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 840, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 840, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 840, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:10.294 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-10T22:02:10.295 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:10.296 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:02:10.297 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:10.298 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:10.299 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_write_failed": 0 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-10T22:02:10.300 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 5478, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 7, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 11747828, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 11746690, 2024-09-10T22:02:10.301 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 5478 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 9, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 858, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 849, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 7, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 39, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 32, 2024-09-10T22:02:10.302 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 840, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 1577, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 737, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 52616, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 254668800 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-10T22:02:10.303 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:10.305 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.308 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-10T22:02:10.308 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.308 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.308 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.309 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.310 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.311 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.312 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.313 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-10T22:02:10.314 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.316 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 1, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 0, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 1501, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-10T22:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:10.318 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:10.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 198327, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 58, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:10.320 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:10.321 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 154, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-10T22:02:10.322 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 601176, 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 3444, 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-10T22:02:10.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 1549, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 1549, 2024-09-10T22:02:10.324 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1549, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.229977059, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000794045 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1549, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1550 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 1549, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 1549, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-10T22:02:10.325 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 904, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 643, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-10T22:02:10.327 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-10T22:02:10.328 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 74, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 3, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 6, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-10T22:02:10.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-10T22:02:10.330 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 1731, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 8752063, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 1731, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1731, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 8752063, 2024-09-10T22:02:10.331 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:10.332 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 1549, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 7553529, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1549, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 7553529, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:10.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 1549, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 1549, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1549, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1549, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.334 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-10T22:02:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x564f8798d040": { 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:10.336 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "trackedop": { 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-10T22:02:10.337 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:10.338 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:02:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:10 smithi070 ceph-mon[34909]: pgmap v557: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 456 op/s 2024-09-10T22:02:11.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:10 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:02:11.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:10 smithi039 ceph-mon[30872]: pgmap v557: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 456 op/s 2024-09-10T22:02:11.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:10 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:02:11.189 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T22:02:11.189 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T22:02:11.189 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-10T22:02:11.189 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T22:02:11.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T22:02:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:10 smithi173 ceph-mon[35294]: pgmap v557: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 456 op/s 2024-09-10T22:02:11.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:10 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:02:11.454 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:11.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: Unable to set osd_memory_target on smithi173 to 184594636: error parsing value: Value '184594636' is below minimum 939524096 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: Unable to set osd_memory_target on smithi070 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:02:11.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:02:11.908 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:11 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001304814, 2024-09-10T22:02:11.921 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000254231, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 120, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 101360, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.011443550, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.009005641, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001264174, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:11.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 118, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004764093, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000040373 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 101360 2024-09-10T22:02:11.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 168, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 161, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 818144, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 97296, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.031407485, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.012013239, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.025657010, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 161, 2024-09-10T22:02:11.925 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.015600243, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000096895 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 818144, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 97296 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.926 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:11.927 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:11.928 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 149024, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 31, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:11.929 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 968, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-10T22:02:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 165, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 791987, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 165, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:11.931 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 165, 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 791987, 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:11.932 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:02:12.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: Unable to set osd_memory_target on smithi173 to 184594636: error parsing value: Value '184594636' is below minimum 939524096 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: Unable to set osd_memory_target on smithi070 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:02:12.158 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:02:12.158 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:11 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:02:12.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: Unable to set osd_memory_target on smithi173 to 184594636: error parsing value: Value '184594636' is below minimum 939524096 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: Unable to set osd_memory_target on smithi070 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:02:12.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:02:12.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:02:12.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:11 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' 2024-09-10T22:02:12.656 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T22:02:12.656 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T22:02:12.656 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-10T22:02:12.657 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T22:02:12.657 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T22:02:12.917 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:12 smithi039 ceph-mon[30872]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-10T22:02:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:12 smithi039 ceph-mon[30872]: Unable to set osd_memory_target on smithi039 to 184583884: error parsing value: Value '184583884' is below minimum 939524096 2024-09-10T22:02:12.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:12 smithi039 ceph-mon[30872]: pgmap v558: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 436 op/s 2024-09-10T22:02:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:12 smithi070 ceph-mon[34909]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-10T22:02:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:12 smithi070 ceph-mon[34909]: Unable to set osd_memory_target on smithi039 to 184583884: error parsing value: Value '184583884' is below minimum 939524096 2024-09-10T22:02:13.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:12 smithi070 ceph-mon[34909]: pgmap v558: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 436 op/s 2024-09-10T22:02:13.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:12 smithi173 ceph-mon[35294]: Adjusting osd_memory_target on smithi039 to 176.0M 2024-09-10T22:02:13.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:12 smithi173 ceph-mon[35294]: Unable to set osd_memory_target on smithi039 to 184583884: error parsing value: Value '184583884' is below minimum 939524096 2024-09-10T22:02:13.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:12 smithi173 ceph-mon[35294]: pgmap v558: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 436 op/s 2024-09-10T22:02:13.363 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:02:13.363 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:13.363 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 723, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 704, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 1106496, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 268008, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.093908282, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.044745769, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.036084856, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.013446401, 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:13.364 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 703, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.031402085, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000044668 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 925056, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 96288 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1052, 2024-09-10T22:02:13.365 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1168, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 6519727, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 622739, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.089742028, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.037388898, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.023037776, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.023663254, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1166, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.038871790, 2024-09-10T22:02:13.366 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000033337 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 288464 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 8, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 8, 2024-09-10T22:02:13.367 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4621, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 1732, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.003697418, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000150868, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.003396921, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000084965, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.006684013, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000954859 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.368 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-10T22:02:13.369 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2712, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.060976380, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000022483 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.370 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-10T22:02:13.371 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 526, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 526, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 526, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-10T22:02:13.372 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:13.373 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:02:13.374 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-10T22:02:13.375 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:13.376 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_started": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "uninline_write_failed": 0 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-10T22:02:13.377 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 4400, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 6, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 10446621, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 10445483, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.378 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 4400 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 8, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 544, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 536, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 6, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 38, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 32, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 526, 2024-09-10T22:02:13.379 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 1386, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 860, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 51796, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 254603264 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-10T22:02:13.380 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.381 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.382 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.383 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.384 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.385 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-10T22:02:13.386 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.387 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.389 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.390 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.391 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 1, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 0, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2024-09-10T22:02:13.392 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 1502, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:13.393 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:13.394 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:13.395 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 197463, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 54, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 154, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:13.396 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 384112, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2177, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-10T22:02:13.397 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 1595, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 1595, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1595, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 2.055961667, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001289004 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1595, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1596 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 1595, 2024-09-10T22:02:13.398 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 1595, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 978, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 615, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-10T22:02:13.399 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-10T22:02:13.400 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-10T22:02:13.401 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 74, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 3, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 6, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-10T22:02:13.402 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-10T22:02:13.403 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 1779, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 7458408, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 1779, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:13.404 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1779, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 7458408, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:13.405 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 1595, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 6252322, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1595, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 6252322, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:13.406 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 1595, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 1595, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1595, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1595, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.407 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-10T22:02:13.408 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x56319a7a5040": { 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:13.409 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "trackedop": { 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:13.410 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:02:14.325 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T22:02:14.325 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T22:02:14.325 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-10T22:02:14.325 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T22:02:14.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T22:02:14.582 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:15.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:14 smithi039 ceph-mon[30872]: pgmap v559: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 467 KiB/s wr, 222 op/s 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4, 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 4, 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2992, 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 448, 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-10T22:02:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.003330149, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000046870, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.002370054, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004293231, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001431077 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 166, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 161, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 815696, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 98128, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.027766272, 2024-09-10T22:02:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.011258216, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.023419815, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 160, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.007434510, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000046465 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 815696, 2024-09-10T22:02:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 98128 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 121, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 101536, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.011272100, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.008326975, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001800241, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 119, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004551374, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000038246 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 101536 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-10T22:02:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-10T22:02:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148984, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 968, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-10T22:02:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 167, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 792247, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 167, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 167, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 792247, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-10T22:02:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-10T22:02:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-10T22:02:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-10T22:02:15.053 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-10T22:02:15.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:14 smithi070 ceph-mon[34909]: pgmap v559: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 467 KiB/s wr, 222 op/s 2024-09-10T22:02:15.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:14 smithi173 ceph-mon[35294]: pgmap v559: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 467 KiB/s wr, 222 op/s 2024-09-10T22:02:15.956 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T22:02:15.957 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T22:02:15.957 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-10T22:02:15.957 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T22:02:15.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T22:02:16.880 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:02:16.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:16 smithi070 ceph-mon[34909]: pgmap v560: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 395 KiB/s wr, 165 op/s 2024-09-10T22:02:17.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:16 smithi039 ceph-mon[30872]: pgmap v560: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 395 KiB/s wr, 165 op/s 2024-09-10T22:02:17.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:16 smithi173 ceph-mon[35294]: pgmap v560: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 395 KiB/s wr, 165 op/s 2024-09-10T22:02:19.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:18 smithi070 ceph-mon[34909]: pgmap v561: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 363 KiB/s wr, 141 op/s 2024-09-10T22:02:19.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:18 smithi039 ceph-mon[30872]: pgmap v561: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 363 KiB/s wr, 141 op/s 2024-09-10T22:02:19.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:18 smithi173 ceph-mon[35294]: pgmap v561: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 363 KiB/s wr, 141 op/s 2024-09-10T22:02:21.157 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:20 smithi070 ceph-mon[34909]: pgmap v562: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 86 KiB/s wr, 77 op/s 2024-09-10T22:02:21.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:20 smithi039 ceph-mon[30872]: pgmap v562: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 86 KiB/s wr, 77 op/s 2024-09-10T22:02:21.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:20 smithi173 ceph-mon[35294]: pgmap v562: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 86 KiB/s wr, 77 op/s 2024-09-10T22:02:22.369 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 616901, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 757307, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 236012527, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 568290434, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 51, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 37.138836883, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 22.001976278, 2024-09-10T22:02:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 51.828444818, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 1.709997892, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 757302, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 61.478408905, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000081180 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1008603, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.125260661, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000124 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 198841248, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 333885664 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 95983, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 96611, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 47057578, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 270366186, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 13, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 7.773243919, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 3.722498686, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 1.246944702, 2024-09-10T22:02:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 2.424231065, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 96612, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 65.609648213, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000679104 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4683, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000725311, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000154 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 300384 2024-09-10T22:02:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 51742, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 51609, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 22742960, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 165550889, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 101, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 7, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 4.755847557, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 2.519149600, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.888568872, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 1.198746599, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 51609, 2024-09-10T22:02:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 19.164922640, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000371348 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 13246, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.001782333, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000134 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1003488, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 116336 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-10T22:02:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 44818, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 244.545604637, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005456414 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 61269, 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 22.091645950, 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000360568 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 237605, 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 235337, 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-10T22:02:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 235337, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 11876.445514272, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.050465696 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 2268, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 5, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 2, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 8692, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 110, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 12, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 287, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 14, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 259, 2024-09-10T22:02:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 14, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 267, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 3483, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 3, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 3, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 6, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 501969, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 493155, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 2263, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 275, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 181, 2024-09-10T22:02:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 16, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 1803, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 58, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 127, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 92675, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 5, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 103589, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-10T22:02:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 92675, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 708, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 9, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 699, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 91967, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 19, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 193471, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 114797, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 6, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 285678, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 34845, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 3650, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 69345 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 4, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 275, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 29, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 2, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 33901, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 33899, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 9, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 16, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-10T22:02:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 123, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-10T22:02:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 242658, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 239165, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 239165, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 3493, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 16483, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 310, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 305, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 305, 2024-09-10T22:02:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 5, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 1, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 21, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 517699939, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 523414494, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 0, 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-10T22:02:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 26087, 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1044.802086897, 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.040050679 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 0 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 42, 2024-09-10T22:02:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 35123, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 35081, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 37, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 1112, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 1075, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 287, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 78231, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 77944, 2024-09-10T22:02:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 3, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 34996, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 34993, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 175136, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 491642880 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 254459, 2024-09-10T22:02:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 692, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 237605, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 32, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 5079, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 34657, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 895.734860568, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.025845712 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 131775, 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 8827.375890245, 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.066988244 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.391 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-10T22:02:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8310, 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 617.500711229, 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.074308148 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000260463, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000130231 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 141, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.020874760, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.028516842 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 5238, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 190.172324112, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.036306285 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 898, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 3.120042049, 2024-09-10T22:02:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003474434 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 34276, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1294.492803094, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.037766740 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 135, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 15.095683799, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.111819879 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-10T22:02:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 7, 2024-09-10T22:02:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.161682152, 2024-09-10T22:02:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.023097450 2024-09-10T22:02:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.022303474, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002787934 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.001780046, 2024-09-10T22:02:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000593348 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 19887, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 28.746298281, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001445481 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 3, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 2, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 46750, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 46750, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 456, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 319009, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 110, 2024-09-10T22:02:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 154, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 352382, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 3120, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 200243, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 607615854, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 32, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 200243, 2024-09-10T22:02:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 200243, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 7620.376590433, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.038055645 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 200243, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 290694 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 200243, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 93254, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 106989, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-10T22:02:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 7655, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 35143, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 563, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 26641, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 377, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 110, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 35588, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 92691, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 70286, 2024-09-10T22:02:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 6, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-10T22:02:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 74, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 3, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 12, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 12, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 17644, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 14, 2024-09-10T22:02:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 3976 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 1, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 14, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 6, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 34763, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 33899, 2024-09-10T22:02:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 764622, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 210601123, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 764622, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 764622, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 210601123, 2024-09-10T22:02:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 200243, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 611040429, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 200243, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 611040429, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 200243, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 200243, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 200243, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 200243, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 33899, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 3424663, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 33899, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 554, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 3424663, 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55d863ae8dc0": { 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 242658, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 519220190, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 242658, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 26087, 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 519220190, 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 18182 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:22.426 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T22:02:23.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:22 smithi070 ceph-mon[34909]: pgmap v563: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T22:02:23.174 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:22 smithi039 ceph-mon[30872]: pgmap v563: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T22:02:23.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:22 smithi173 ceph-mon[35294]: pgmap v563: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T22:02:23.664 INFO:tasks.check_counter:Daemon mds.b mds.exported=16 2024-09-10T22:02:23.664 INFO:tasks.check_counter:Daemon mds.b mds.imported=58 2024-09-10T22:02:23.664 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=110 2024-09-10T22:02:23.664 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T22:02:23.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T22:02:23.931 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 71, 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 70, 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3511490, 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 22988, 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-09-10T22:02:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.010732832, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.002893397, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.007610650, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.001050370, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 69, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004459089, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000064624 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 175088, 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 6448 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 21, 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 28, 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2403857, 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 105953, 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.006227069, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.001197211, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.004381948, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000402128, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 26, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.002476149, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000095236 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 99536 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 9, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 9, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 4914, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 2054, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.009724302, 2024-09-10T22:02:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000145790, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.012627023, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000083186, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.018362990, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002295373 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:02:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 118, 2024-09-10T22:02:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.002768393, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000023460 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-10T22:02:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 1342, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 1342, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 1342, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 2, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-10T22:02:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 5, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 103589, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-10T22:02:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 3493, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 5, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 1, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 517699939, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 523414494, 2024-09-10T22:02:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 523412473, 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 3493 2024-09-10T22:02:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 16, 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 1092, 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 1076, 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 14, 2024-09-10T22:02:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 71, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 57, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 1342, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 2418, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 1076, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-10T22:02:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 49348, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 253788160 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-10T22:02:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-10T22:02:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 1, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 0, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1821, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-10T22:02:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 204713, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 56, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 154, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 965831, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 5491, 2024-09-10T22:02:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 77, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 26, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 4, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 77, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 77, 2024-09-10T22:02:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.050998484, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000662317 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 77, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 78 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 77, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 77, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-10T22:02:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 42, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 32, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 2, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-10T22:02:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-10T22:02:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 7, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 7, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-10T22:02:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 97, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 5907584, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 97, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 97, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 5907584, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 77, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 5714565, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 77, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 5714565, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 77, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 77, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 77, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 77, 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5557b1138c80": { 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-10T22:02:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-10T22:02:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:24.517 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T22:02:24.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:24 smithi070 ceph-mon[34909]: pgmap v564: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 15 op/s 2024-09-10T22:02:25.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:24 smithi039 ceph-mon[30872]: pgmap v564: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 15 op/s 2024-09-10T22:02:25.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:24 smithi173 ceph-mon[35294]: pgmap v564: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 15 op/s 2024-09-10T22:02:25.244 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T22:02:25.244 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T22:02:25.244 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-10T22:02:25.244 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T22:02:25.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T22:02:25.493 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 13891, 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 16094, 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 5343411, 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 13303136, 2024-09-10T22:02:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 32, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.948759896, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.542438133, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.721869617, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.026125010, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 16092, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.509298258, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000031649 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 23815, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004164200, 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000174 2024-09-10T22:02:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 4990336, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 8473984 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1711, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1829, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 557364, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 4595294, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 8, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.134252803, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.062774644, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.028647834, 2024-09-10T22:02:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.033788776, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1828, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.074161109, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000040569 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 297280 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 3846, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 3310, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2550796, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1357055, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 7, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.280979676, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.143946217, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.145764640, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.020414007, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3309, 2024-09-10T22:02:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.089218155, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000026962 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4726, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000788652, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000166 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 949376, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 111744 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1435, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 3.532505427, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002461676 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1944, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.096516168, 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000049648 2024-09-10T22:02:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 5850, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 5845, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 5845, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 33.741803727, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005772763 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 5, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 11, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 16, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 2, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 1, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 13, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 13, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 55, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 3, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 12419, 2024-09-10T22:02:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 8699, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 5, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 12, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 7, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 10, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 21, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 10, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 653, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 1826, 2024-09-10T22:02:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 1594, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 27420227, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 1826, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 1826, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 42, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 2146, 2024-09-10T22:02:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 2998, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 5895, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 1005, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 135, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 3502 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 6, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 4, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 9, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 1, 2024-09-10T22:02:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 1005, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 1005, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 10, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 5512, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-10T22:02:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 5512, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 8, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 8, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 12720093, 2024-09-10T22:02:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 0, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 638, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 18.457595747, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.028930400 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 0 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 20, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 1038, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 1018, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 19, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 60, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 41, 2024-09-10T22:02:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 16, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 1851, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 1835, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 1702, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 1702, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 61992, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 272490496 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 5974, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 29, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 5850, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 5, 2024-09-10T22:02:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 84, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 703, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.049403712, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001492750 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 32, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.390290113, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.043446566 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3904, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 28.404532922, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.007275751 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-10T22:02:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 119, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.466953408, 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003923978 2024-09-10T22:02:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 10, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.009822239, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000982223 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 704, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.974704157, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002804977 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 373, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.446097176, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001195970 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 1, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 1076, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 1076, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1823, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 294279, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 127, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 880, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 10, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-10T22:02:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 154, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 81869, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 363, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 3715, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 8778624, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 33, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 3715, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3715, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 21.380359695, 2024-09-10T22:02:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005755143 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3715, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 3819 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 3715, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 1870, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 1845, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 0, 2024-09-10T22:02:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 10, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 44, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 682, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 53, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 1019, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1826, 2024-09-10T22:02:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 20, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-10T22:02:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-10T22:02:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 74, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 3, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 12, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 12, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 129, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 0, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 36 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 1, 2024-09-10T22:02:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 6, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 1005, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 1005, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 19444, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 6042317, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 19444, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 19444, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 6042317, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 3715, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 8880129, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 3715, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 8880129, 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 3715, 2024-09-10T22:02:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 3715, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 3715, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 3715, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1005, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 101505, 2024-09-10T22:02:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1005, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 44, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 101505, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55ece44e0dc0": { 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 5512, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 8525789, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 5512, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 638, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 8525789, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-10T22:02:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-10T22:02:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:26.033 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T22:02:26.878 INFO:tasks.check_counter:Daemon mds.h mds.exported=10 2024-09-10T22:02:26.878 INFO:tasks.check_counter:Daemon mds.h mds.imported=10 2024-09-10T22:02:26.878 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-10T22:02:26.878 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T22:02:26.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T22:02:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:02:27.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:26 smithi070 ceph-mon[34909]: pgmap v565: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:27.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:26 smithi039 ceph-mon[30872]: pgmap v565: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:27.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:26 smithi173 ceph-mon[35294]: pgmap v565: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 317, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 317, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 4279573, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 100046, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.034575429, 2024-09-10T22:02:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.014232907, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.010774286, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.006699204, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 316, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.013934909, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000044097 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 627, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 608, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 5233576, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 240383, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-10T22:02:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.062806415, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.025253146, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.035278283, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.008623210, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 607, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.019903213, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000032789 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 927504, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 102048 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 825, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 948, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 390289, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 556672, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.086502086, 2024-09-10T22:02:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.042099810, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.016674723, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.020917768, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 946, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.032073837, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000033904 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 294640 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2720, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.061814337, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000022725 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 1012, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 1012, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 1012, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-09-10T22:02:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-10T22:02:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-10T22:02:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-10T22:02:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-10T22:02:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 5512, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 8, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 12720093, 2024-09-10T22:02:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 12718955, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 5512 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 10, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 1033, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 1023, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 8, 2024-09-10T22:02:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 43, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 35, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 1012, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 1823, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 811, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 50424, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 252436480 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-10T22:02:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-10T22:02:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-10T22:02:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 1, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-10T22:02:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1821, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 198287, 2024-09-10T22:02:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 57, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 154, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 721680, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 4143, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-10T22:02:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 1572, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 1572, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1572, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.818915556, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001793203 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-10T22:02:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1572, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1573 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 1572, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 1572, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 937, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 633, 2024-09-10T22:02:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-10T22:02:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-10T22:02:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 74, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 3, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-10T22:02:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:02:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1765, 2024-09-10T22:02:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 9731794, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1765, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1765, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 9731794, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1572, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 8525794, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1572, 2024-09-10T22:02:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 8525794, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1572, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 1572, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1572, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1572, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-10T22:02:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5604812a7040": { 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-10T22:02:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T22:02:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-10T22:02:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-10T22:02:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T22:02:27.716 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T22:02:28.504 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T22:02:28.504 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T22:02:28.504 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-10T22:02:28.504 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T22:02:28.505 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T22:02:28.765 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:02:29.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:28 smithi070 ceph-mon[34909]: pgmap v566: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T22:02:29.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:28 smithi039 ceph-mon[30872]: pgmap v566: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T22:02:29.192 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:28 smithi173 ceph-mon[35294]: pgmap v566: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T22:02:29.297 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-10T22:02:29.297 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:29.297 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 21796, 2024-09-10T22:02:29.297 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 24899, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 8480777, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 16769095, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 31, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 8, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 1.576811288, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.922937258, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 1.191250989, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.041241153, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 24898, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.148738966, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000046137 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.298 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 33529, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.004989604, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000148 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 7904464, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 11599872 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1946, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2067, 2024-09-10T22:02:29.299 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 621779, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 4535876, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.221274888, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.128649673, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.035172918, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.045055014, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2065, 2024-09-10T22:02:29.300 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.191242329, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000092611 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 296896 2024-09-10T22:02:29.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 25928, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 28594, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 6914772, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 8498755, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 1.532473977, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.765975482, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.942683106, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.023271936, 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:29.302 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28593, 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.536458173, 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000018761 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 50890, 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007979285, 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000156 2024-09-10T22:02:29.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 944448, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 111744 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2566, 2024-09-10T22:02:29.304 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4.060568628, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001582450 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1794, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.158575211, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000088391 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-10T22:02:29.305 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 4693, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 4691, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4691, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 95.167260859, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.020287201 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 2, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 28, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 2, 2024-09-10T22:02:29.306 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 17, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 2, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 2, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 13, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 13, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 96, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 3, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 11030, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 10185, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 2, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 4, 2024-09-10T22:02:29.307 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 230, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 16, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 41, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 2, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 416, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 2103, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1594, 2024-09-10T22:02:29.308 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 27420227, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 2103, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 2103, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 421, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 7605, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 7123, 2024-09-10T22:02:29.309 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 14040, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 735, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 138, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 2916 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 6, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 4, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 8, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 258, 2024-09-10T22:02:29.310 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 834, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 834, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:29.311 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 16, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 2, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_started": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_write_failed": 0 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 5478, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-10T22:02:29.312 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 5478, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 7, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 7, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 11747828, 2024-09-10T22:02:29.313 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1254, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.428723014, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.010708710 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 21, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 864, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 843, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 20, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 66, 2024-09-10T22:02:29.314 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 46, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 17, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1591, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1574, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 1162, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 1162, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 62312, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 271441920 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 6551, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 3861, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 4693, 2024-09-10T22:02:29.315 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 6, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 8289, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 600, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 10.345002925, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.017241671 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 63, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3.140584320, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.049850544 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2631, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 38.348186225, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.014575517 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.317 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.319 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 405, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.323434995, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000798604 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 16, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.021101491, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001318843 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 601, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 41.365462685, 2024-09-10T22:02:29.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.068827724 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.323 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-10T22:02:29.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 375, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.623488218, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004329301 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.327 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 1775, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 1775, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1822, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:29.328 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:29.329 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 286583, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 131, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 792, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 9, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:29.331 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 154, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 86909, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 420, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-10T22:02:29.332 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 4631, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 8034549, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 32, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 4631, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4631, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 16.134638882, 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003484050 2024-09-10T22:02:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4631, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4824 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 4631, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 2195, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 2436, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 92, 2024-09-10T22:02:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1346, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 83, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 2, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 847, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 2103, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:29.335 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-10T22:02:29.336 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-10T22:02:29.337 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 74, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 257, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 64 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-10T22:02:29.338 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 834, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 834, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:29.339 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 49666, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 10531280, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 49666, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 49666, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 10531280, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.340 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4631, 2024-09-10T22:02:29.341 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 8118783, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4631, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8118783, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:29.342 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4631, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 4631, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4631, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 4631, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.343 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 834, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 84234, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 834, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 92, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 84234, 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:29.344 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55ea1fec0dc0": { 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 5478, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 7553524, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 5478, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:29.345 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1254, 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 7553524, 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "trackedop": { 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 1 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:29.346 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-10T22:02:30.084 INFO:tasks.check_counter:Daemon mds.c mds.exported=16 2024-09-10T22:02:30.084 INFO:tasks.check_counter:Daemon mds.c mds.imported=2 2024-09-10T22:02:30.084 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=2 2024-09-10T22:02:30.084 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T22:02:30.085 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T22:02:30.341 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:02:30.846 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-10T22:02:30.846 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:30.846 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 21916, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 20829, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 8233933, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 16943280, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 26, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 1.138600484, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.638986220, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 2.243161143, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.035042342, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 20825, 2024-09-10T22:02:30.847 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.925723876, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000044452 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 33672, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.005091395, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000151 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 7763216, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 11965472 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3794, 2024-09-10T22:02:30.848 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 4428, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1265929, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1789136, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 10, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.314129565, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.159085228, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.166156227, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.015087829, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4428, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.220120347, 2024-09-10T22:02:30.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000049711 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6563, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001352937, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000206 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 296912 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1247, 2024-09-10T22:02:30.850 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1226, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1206212, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 2844507, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 11, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.130765140, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.062771483, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.046639026, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.024615764, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1226, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.106056513, 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000086506 2024-09-10T22:02:30.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000920, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000102 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 940176, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 110672 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.852 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1866, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.530909424, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001356328 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1104, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.071133984, 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000064432 2024-09-10T22:02:30.853 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 8049, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 8048, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8048, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 113.320948309, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.014080634 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 1, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:30.854 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 29, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 2, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 11, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 1, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 10, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 10, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 110, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-10T22:02:30.855 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 16575, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 14594, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 4, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 30, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 16, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 57, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 2, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 421, 2024-09-10T22:02:30.856 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 1469, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 1, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1594, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 27420227, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 1469, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:30.857 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 1469, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 68, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 3492, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 3664, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 9997, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 521, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 34, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 1934 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 6, 2024-09-10T22:02:30.858 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 4, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 8, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 10, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 521, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 521, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-10T22:02:30.859 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 16, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 2, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_started": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_write_failed": 0 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.860 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 4400, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 4400, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 6, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 6, 2024-09-10T22:02:30.861 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 10446621, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1014, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 26.348798784, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.025985008 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.862 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 15, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 550, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 535, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 13, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 62, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 49, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 11, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1434, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1423, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 964, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 964, 2024-09-10T22:02:30.863 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 64760, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 275636224 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 8362, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 99, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 8049, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 7, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 252, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 320, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3.461974571, 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.010818670 2024-09-10T22:02:30.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 54, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.637337006, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.048839574 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.865 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6521, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 102.758884797, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.015758148 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-10T22:02:30.866 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.867 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:30.868 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.868 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 378, 2024-09-10T22:02:30.870 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.087569706, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002877168 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 32, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.029147911, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000910872 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 321, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.810433577, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.008755244 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.871 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-10T22:02:30.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.874 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 422, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.535600741, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001269196 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.876 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 2151, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 2151, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 456, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:30.877 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:30.878 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:30.879 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 278327, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 121, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 880, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 10, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:30.880 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 154, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 60008, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 287, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.881 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 3272, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 6728831, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 33, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 3272, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3272, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 28.456361808, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.008696932 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-10T22:02:30.882 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3272, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3412 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 3272, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1510, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 1762, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 41, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1055, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 49, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-10T22:02:30.883 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 2, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 534, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1469, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-10T22:02:30.884 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-10T22:02:30.885 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 74, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-10T22:02:30.886 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 192, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 40 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-10T22:02:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 521, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 521, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 26953, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 7249062, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 26953, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 26953, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 7249062, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3272, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6781452, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3272, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6781452, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3272, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 3272, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3272, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 3272, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 521, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 52621, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 521, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 41, 2024-09-10T22:02:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 52621, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x5598417ccdc0": { 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 4400, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 6252317, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 4400, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1014, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6252317, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "trackedop": { 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:30.894 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-10T22:02:31.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:30 smithi173 ceph-mon[35294]: pgmap v567: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T22:02:31.189 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:30 smithi039 ceph-mon[30872]: pgmap v567: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T22:02:31.189 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:30 smithi070 ceph-mon[34909]: pgmap v567: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T22:02:31.594 INFO:tasks.check_counter:Daemon mds.f mds.exported=16 2024-09-10T22:02:31.594 INFO:tasks.check_counter:Daemon mds.f mds.imported=2 2024-09-10T22:02:31.594 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=2 2024-09-10T22:02:31.595 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T22:02:31.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T22:02:31.843 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:02:32.375 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-10T22:02:32.375 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:32.375 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 26770, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 26546, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10833826, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 23865356, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 14, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 1.494903633, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.860670404, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 2.397353035, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.053453253, 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:32.376 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 26544, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.232635505, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000046437 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 40351, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.005114052, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000126 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 10194256, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 15160416 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.377 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 4643, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 4270, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1531098, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1730841, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 11, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.315198575, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.150054632, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.165804562, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.025531611, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4270, 2024-09-10T22:02:32.378 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.209784504, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000049129 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6527, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001024147, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000156 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 296656 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1166, 2024-09-10T22:02:32.379 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1168, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 450699, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 807533, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 26, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 8, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.118543359, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.057558296, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.028390615, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.024238910, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1166, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.106185787, 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000091068 2024-09-10T22:02:32.380 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 23, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000002210, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000096 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.381 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2807, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3.879687476, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001382147 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1038, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.059721833, 2024-09-10T22:02:32.382 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000057535 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 9778, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 9773, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9773, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 148.680189451, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.015213362 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 5, 2024-09-10T22:02:32.383 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 27, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 2, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 17, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 1, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 6, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 10, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 14, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 32, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 1, 2024-09-10T22:02:32.384 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 1, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 3, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 20626, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 19850, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 2, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 5, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 99, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 16, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 8, 2024-09-10T22:02:32.385 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 2, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 313, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 1994, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1594, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 27420227, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 1994, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:32.386 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 1994, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 16, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 5296, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 4830, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 12051, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 504, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 38, 2024-09-10T22:02:32.387 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 1970 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 3, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 3, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 2, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 7, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 9, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 506, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 506, 2024-09-10T22:02:32.388 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 16, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 2, 2024-09-10T22:02:32.389 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_started": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_write_failed": 0 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 5624, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 5624, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-10T22:02:32.390 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 7, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 7, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 12089344, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1752, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 44.153127881, 2024-09-10T22:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.025201557 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 21, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 535, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 514, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 20, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 65, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 45, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 17, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1373, 2024-09-10T22:02:32.392 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1356, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 1, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 677, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 676, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 64656, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 274587648 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 10042, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 251, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 9778, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 15, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 547, 2024-09-10T22:02:32.393 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 353, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.791857281, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005076082 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 20, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.362568815, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.068128440 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.394 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8314, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 143.933303570, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.017312160 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.395 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.396 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.397 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-10T22:02:32.398 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.399 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 320, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.534238759, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001669496 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 16, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.010423656, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000651478 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-10T22:02:32.400 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 353, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.661415014, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001873696 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:32.402 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-10T22:02:32.404 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 397, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.386382356, 2024-09-10T22:02:32.405 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000973255 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-10T22:02:32.406 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 1278, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 1278, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 467, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:32.408 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:32.409 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 310343, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 137, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 880, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 10, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:32.410 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 154, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 86509, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 392, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:32.411 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 4493, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 8198597, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 28, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 4493, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4493, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 40.069102420, 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.008918117 2024-09-10T22:02:32.412 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4493, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4612 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 4493, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 2026, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 2467, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 32, 2024-09-10T22:02:32.413 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1784, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 46, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 2, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 519, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1994, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-10T22:02:32.414 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-10T22:02:32.415 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-10T22:02:32.416 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 74, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 177, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 28 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-10T22:02:32.417 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 506, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 506, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 32575, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 8650827, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 32575, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 32575, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8650827, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.419 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:32.420 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4493, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 8249703, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4493, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8249703, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-10T22:02:32.421 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4493, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 4493, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4493, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 4493, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 506, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 51106, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 506, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 32, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 51106, 2024-09-10T22:02:32.423 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55b2417eadc0": { 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 5624, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 7895040, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:32.424 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 5624, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1752, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 7895040, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "trackedop": { 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:32.425 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-10T22:02:32.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:32 smithi173 ceph-mon[35294]: pgmap v568: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:33.148 INFO:tasks.check_counter:Daemon mds.i mds.exported=16 2024-09-10T22:02:33.148 INFO:tasks.check_counter:Daemon mds.i mds.imported=2 2024-09-10T22:02:33.148 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=2 2024-09-10T22:02:33.148 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T22:02:33.148 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T22:02:33.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:32 smithi070 ceph-mon[34909]: pgmap v568: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:33.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:32 smithi039 ceph-mon[30872]: pgmap v568: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T22:02:33.393 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1674, 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1676, 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 8367093, 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 532339, 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-09-10T22:02:33.949 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.152743117, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.067883455, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.034812635, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.039922720, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1674, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.060344825, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000036048 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 200, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 179, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 931596, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 104474, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 3, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.034736080, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.014029007, 2024-09-10T22:02:33.951 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.030845827, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000056837, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 179, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.014737422, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000082331 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 931040, 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 103776 2024-09-10T22:02:33.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2, 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 127, 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 428, 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 296958, 2024-09-10T22:02:33.953 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.009194555, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.006728606, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001290142, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000024977, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 125, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007667711, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000061341 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.954 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 296640 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-10T22:02:33.955 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2874, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.067253305, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000023400 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-09-10T22:02:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 512, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 512, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 512, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 1, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-10T22:02:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-09-10T22:02:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:02:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-10T22:02:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:02:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_started": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_succeeded": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "uninline_write_failed": 0 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-10T22:02:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 5624, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 7, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 12089344, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 12088206, 2024-09-10T22:02:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 5624 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 9, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 530, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 521, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 7, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 39, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 32, 2024-09-10T22:02:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 512, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1321, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 809, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 52124, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 253550592 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-10T22:02:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-10T22:02:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.975 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.976 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.977 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:02:33.978 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 2, 2024-09-10T22:02:33.979 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 3188, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:02:33.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:02:33.981 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:02:33.982 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 181343, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 47, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:02:33.983 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7496, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 154, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 378136, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2132, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-10T22:02:33.984 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 1677, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 1677, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1677, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.200950855, 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001312433 2024-09-10T22:02:33.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1677, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1678 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 1677, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1677, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 1029, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 646, 2024-09-10T22:02:33.986 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-10T22:02:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-10T22:02:33.988 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 74, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 4, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 4, 2024-09-10T22:02:33.989 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-10T22:02:33.990 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1872, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 9117739, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:33.991 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1872, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1872, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 9117739, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:33.992 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1677, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 7895045, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1677, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 7895045, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.993 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1677, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 1677, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1677, 2024-09-10T22:02:33.994 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1677, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:33.995 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55e687547040": { 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-10T22:02:33.996 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-10T22:02:33.998 INFO:teuthology.orchestra.run.smithi173.stdout: "trackedop": { 2024-09-10T22:02:33.998 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-10T22:02:33.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-10T22:02:33.998 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-10T22:02:34.918 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-10T22:02:34.919 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-10T22:02:34.919 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-10T22:02:34.919 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T22:02:34.928 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T22:02:34.928 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T22:02:34.929 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:02:34.951 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-10T22:02:34.951 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:02:35.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T22:02:35.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:34 smithi070 ceph-mon[34909]: pgmap v569: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-10T22:02:35.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:34 smithi039 ceph-mon[30872]: pgmap v569: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-10T22:02:35.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:34 smithi173 ceph-mon[35294]: pgmap v569: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-10T22:02:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 -- 172.21.15.39:0/3092538928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0981087a0 msgr2=0x7fb098108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/3092538928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0981087a0 0x7fb098108be0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb080009900 tx=0x7fb08002a410 comp rx=0 tx=0).stop 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 -- 172.21.15.39:0/3092538928 shutdown_connections 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/3092538928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 0x7fb09810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/3092538928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0981087a0 0x7fb098108be0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/3092538928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb098102d90 0x7fb098103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 -- 172.21.15.39:0/3092538928 >> 172.21.15.39:0/3092538928 conn(0x7fb0980fe820 msgr2=0x7fb098100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 -- 172.21.15.39:0/3092538928 shutdown_connections 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.793+0000 7fb09e7f1640 1 -- 172.21.15.39:0/3092538928 wait complete. 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 Processor -- start 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 -- start start 2024-09-10T22:02:35.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0981087a0 0x7fb098199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 0x7fb09819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb098112de0 con 0x7fb098102d90 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb098112c60 con 0x7fb098109120 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09e7f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb098112f60 con 0x7fb0981087a0 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43672/0 (socket says 172.21.15.39:43672) 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 -- 172.21.15.39:0/136468016 learned_addr learned my addr 172.21.15.39:0/136468016 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb09cd8e640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 0x7fb09819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb08ffff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0981087a0 0x7fb098199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 -- 172.21.15.39:0/136468016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0981087a0 msgr2=0x7fb098199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0981087a0 0x7fb098199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 -- 172.21.15.39:0/136468016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 msgr2=0x7fb09819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:35.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 0x7fb09819ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.794+0000 7fb097fff640 1 -- 172.21.15.39:0/136468016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09819f3a0 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb097fff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb08800c890 tx=0x7fb08800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088004220 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0880043c0 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09819f690 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088004a00 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.795+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0981a5f20 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.796+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb098103170 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.797+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb0880079b0 con 0x7fb098102d90 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.798+0000 7fb095ffb640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 0x7fb0840b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.798+0000 7fb08ffff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 0x7fb0840b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.798+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb0880e5c80 con 0x7fb098102d90 2024-09-10T22:02:35.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.799+0000 7fb08ffff640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 0x7fb0840b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb080006010 tx=0x7fb080000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:35.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:35.802+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb088014030 con 0x7fb098102d90 2024-09-10T22:02:36.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.004+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb09819a420 con 0x7fb098102d90 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.004+0000 7fb095ffb640 1 -- 172.21.15.39:0/136468016 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v74) ==== 81+0+590 (secure 0 0 0) 0x7fb0880acbd0 con 0x7fb098102d90 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2182482631 2024-09-11T21:45:43.360662+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1818411713 2024-09-11T21:45:43.360662+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/1744585389 2024-09-11T21:45:43.360662+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1854014949 2024-09-11T21:45:18.572537+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2652652450 2024-09-11T21:45:18.572537+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/1744585389 2024-09-11T21:45:43.360662+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/189886877 2024-09-11T21:45:18.572537+0000 2024-09-10T22:02:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2133570636 2024-09-11T21:45:43.360662+0000 2024-09-10T22:02:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/189886877 2024-09-11T21:45:18.572537+0000 2024-09-10T22:02:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1872994819 2024-09-11T21:45:18.572537+0000 2024-09-10T22:02:36.007 INFO:teuthology.orchestra.run.smithi039.stderr:listed 10 entries 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 msgr2=0x7fb0840b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 0x7fb0840b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb080006010 tx=0x7fb080000bc0 comp rx=0 tx=0).stop 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 msgr2=0x7fb0981992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb08800c890 tx=0x7fb08800cd50 comp rx=0 tx=0).stop 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 shutdown_connections 2024-09-10T22:02:36.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb0840b5360 0x7fb0840b7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb098109120 0x7fb09819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0981087a0 0x7fb098199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 --2- 172.21.15.39:0/136468016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb098102d90 0x7fb0981992f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 >> 172.21.15.39:0/136468016 conn(0x7fb0980fe820 msgr2=0x7fb098100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 shutdown_connections 2024-09-10T22:02:36.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:36.007+0000 7fb09e7f1640 1 -- 172.21.15.39:0/136468016 wait complete. 2024-09-10T22:02:36.727 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T22:02:36.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:02:36.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T22:02:36.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T22:02:36.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:02:36.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:02:36.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:02:36.937 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-10T22:02:37.021 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:02:37.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:02:37.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:02:37.114 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:36 smithi039 ceph-mon[30872]: pgmap v570: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T22:02:37.115 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:36 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/136468016' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:02:37.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:02:37.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-10T22:02:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:36 smithi070 ceph-mon[34909]: pgmap v570: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T22:02:37.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:36 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/136468016' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:02:37.183 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T22:02:37.193 INFO:tasks.cephadm:Teardown begin 2024-09-10T22:02:37.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:02:37.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:02:37.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:36 smithi173 ceph-mon[35294]: pgmap v570: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T22:02:37.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:36 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/136468016' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:02:37.453 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:37.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 -- 172.21.15.39:0/2295176323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c1087d0 msgr2=0x7f614c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 --2- 172.21.15.39:0/2295176323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c1087d0 0x7f614c108c10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6140009900 tx=0x7f614002a410 comp rx=0 tx=0).stop 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 -- 172.21.15.39:0/2295176323 shutdown_connections 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 --2- 172.21.15.39:0/2295176323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c109150 0x7f614c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 --2- 172.21.15.39:0/2295176323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c1087d0 0x7f614c108c10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 --2- 172.21.15.39:0/2295176323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c102dc0 0x7f614c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 -- 172.21.15.39:0/2295176323 >> 172.21.15.39:0/2295176323 conn(0x7f614c0fe830 msgr2=0x7f614c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.918+0000 7f61521b7640 1 -- 172.21.15.39:0/2295176323 shutdown_connections 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.919+0000 7f61521b7640 1 -- 172.21.15.39:0/2295176323 wait complete. 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.919+0000 7f61521b7640 1 Processor -- start 2024-09-10T22:02:37.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.919+0000 7f61521b7640 1 -- start start 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c102dc0 0x7f614c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c1087d0 0x7f614c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f614c112e10 con 0x7f614c109150 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f614c112c90 con 0x7f614c102dc0 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f61521b7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f614c112f90 con 0x7f614c1087d0 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43688/0 (socket says 172.21.15.39:43688) 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 -- 172.21.15.39:0/4267097311 learned_addr learned my addr 172.21.15.39:0/4267097311 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614b7fe640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c102dc0 0x7f614c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:37.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614affd640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c1087d0 0x7f614c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 -- 172.21.15.39:0/4267097311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c1087d0 msgr2=0x7f614c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c1087d0 0x7f614c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 -- 172.21.15.39:0/4267097311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c102dc0 msgr2=0x7f614c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c102dc0 0x7f614c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.920+0000 7f614bfff640 1 -- 172.21.15.39:0/4267097311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c19f390 con 0x7f614c109150 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f614bfff640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f614400cce0 tx=0x7f614400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614400f450 con 0x7f614c109150 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614400faa0 con 0x7f614c109150 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c19f680 con 0x7f614c109150 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144018a80 con 0x7f614c109150 2024-09-10T22:02:37.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.921+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1a5dc0 con 0x7f614c109150 2024-09-10T22:02:37.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.922+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c104070 con 0x7f614c109150 2024-09-10T22:02:37.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.923+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6144020030 con 0x7f614c109150 2024-09-10T22:02:37.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.924+0000 7f6148ff9640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 0x7f61340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:37.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.924+0000 7f614b7fe640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 0x7f61340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:37.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.924+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61440e5dd0 con 0x7f614c109150 2024-09-10T22:02:37.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.925+0000 7f614b7fe640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 0x7f61340b7820 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f613c009990 tx=0x7f613c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:37.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:37.927+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6144056220 con 0x7f614c109150 2024-09-10T22:02:38.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.149+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f614c1031a0 con 0x7f614c109150 2024-09-10T22:02:38.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:37 smithi039 ceph-mon[30872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:38.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.149+0000 7f6148ff9640 1 -- 172.21.15.39:0/4267097311 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11977 (secure 0 0 0) 0x7f614c1031a0 con 0x7f614c109150 2024-09-10T22:02:38.152 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:02:38.152 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"btime":"2024-09-10T22:02:36:869111+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T22:02:36.032013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26638":{"gid":26638,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/3437650543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3437650543},{"type":"v1","addr":"172.21.15.70:6835","nonce":3437650543}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T22:02:38.153 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-09-10T22:02:38.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 msgr2=0x7f61340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:38.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 0x7f61340b7820 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f613c009990 tx=0x7f613c009110 comp rx=0 tx=0).stop 2024-09-10T22:02:38.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 msgr2=0x7f614c19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:38.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f614400cce0 tx=0x7f614400a620 comp rx=0 tx=0).stop 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 shutdown_connections 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f61340b5360 0x7f61340b7820 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f614c109150 0x7f614c19ebc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f614c1087d0 0x7f614c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 --2- 172.21.15.39:0/4267097311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f614c102dc0 0x7f614c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 >> 172.21.15.39:0/4267097311 conn(0x7f614c0fe830 msgr2=0x7f614c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 shutdown_connections 2024-09-10T22:02:38.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:38.152+0000 7f61521b7640 1 -- 172.21.15.39:0/4267097311 wait complete. 2024-09-10T22:02:38.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:37 smithi070 ceph-mon[34909]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:38.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:37 smithi173 ceph-mon[35294]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T22:02:38.866 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:02:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:38 smithi070 ceph-mon[34909]: pgmap v571: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T22:02:39.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:38 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/4267097311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:39.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:38 smithi039 ceph-mon[30872]: pgmap v571: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T22:02:39.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:38 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/4267097311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:39.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:38 smithi173 ceph-mon[35294]: pgmap v571: 97 pgs: 97 active+clean; 40 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-10T22:02:39.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:38 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/4267097311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- 172.21.15.39:0/30946756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab41076a0 msgr2=0x7f0ab4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 --2- 172.21.15.39:0/30946756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab41076a0 0x7f0ab4107ae0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009900 tx=0x7f0a9c02a410 comp rx=0 tx=0).stop 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- 172.21.15.39:0/30946756 shutdown_connections 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 --2- 172.21.15.39:0/30946756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 0x7f0ab410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 --2- 172.21.15.39:0/30946756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab41076a0 0x7f0ab4107ae0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 --2- 172.21.15.39:0/30946756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab4101c90 0x7f0ab4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- 172.21.15.39:0/30946756 >> 172.21.15.39:0/30946756 conn(0x7f0ab40fd700 msgr2=0x7f0ab40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- 172.21.15.39:0/30946756 shutdown_connections 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- 172.21.15.39:0/30946756 wait complete. 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 Processor -- start 2024-09-10T22:02:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.611+0000 7f0aba95d640 1 -- start start 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab41076a0 0x7f0ab4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 0x7f0ab419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4111ce0 con 0x7f0ab4101c90 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4111b60 con 0x7f0ab4108020 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aba95d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4111e60 con 0x7f0ab41076a0 2024-09-10T22:02:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43706/0 (socket says 172.21.15.39:43706) 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 -- 172.21.15.39:0/2227267575 learned_addr learned my addr 172.21.15.39:0/2227267575 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0aabfff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab41076a0 0x7f0ab4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab8efa640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 0x7f0ab419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 -- 172.21.15.39:0/2227267575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab41076a0 msgr2=0x7f0ab4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab41076a0 0x7f0ab4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 -- 172.21.15.39:0/2227267575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 msgr2=0x7f0ab419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 0x7f0ab419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 -- 172.21.15.39:0/2227267575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab419f3f0 con 0x7f0ab4101c90 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab3fff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400b4a0 tx=0x7f0aa400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.612+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4014070 con 0x7f0ab4101c90 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.613+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab419f6e0 con 0x7f0ab4101c90 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.613+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa4010ac0 con 0x7f0ab4101c90 2024-09-10T22:02:39.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.613+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4017c30 con 0x7f0ab4101c90 2024-09-10T22:02:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.613+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab41a5da0 con 0x7f0ab4101c90 2024-09-10T22:02:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.614+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab4102070 con 0x7f0ab4101c90 2024-09-10T22:02:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.616+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0aa4010610 con 0x7f0ab4101c90 2024-09-10T22:02:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.617+0000 7f0ab1ffb640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 0x7f0aa00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.617+0000 7f0aabfff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 0x7f0aa00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.617+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0aa40e5470 con 0x7f0ab4101c90 2024-09-10T22:02:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.617+0000 7f0aabfff640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 0x7f0aa00b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c031440 tx=0x7f0a9c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.620+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0aa40abcf0 con 0x7f0ab4101c90 2024-09-10T22:02:39.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.842+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ab41a60f0 con 0x7f0ab4101c90 2024-09-10T22:02:39.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.843+0000 7f0ab1ffb640 1 -- 172.21.15.39:0/2227267575 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11977 (secure 0 0 0) 0x7f0aa40b0720 con 0x7f0ab4101c90 2024-09-10T22:02:39.846 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:02:39.846 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"btime":"2024-09-10T22:02:36:869111+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14646,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2261493823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2261493823},{"type":"v1","addr":"172.21.15.39:6835","nonce":2261493823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14658,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1193570849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1193570849},{"type":"v1","addr":"172.21.15.39:6837","nonce":1193570849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:53:00.566007+0000","modified":"2024-09-10T22:02:36.032013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24583,"mds_2":24563,"mds_3":24562,"mds_4":24550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6839/4288267736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":4288267736},{"type":"v1","addr":"172.21.15.39:6839","nonce":4288267736}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2073917136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2073917136},{"type":"v1","addr":"172.21.15.39:6841","nonce":2073917136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/4205749592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4205749592},{"type":"v1","addr":"172.21.15.70:6833","nonce":4205749592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/4284402847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":4284402847},{"type":"v1","addr":"172.21.15.173:6833","nonce":4284402847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/1204968390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1204968390},{"type":"v1","addr":"172.21.15.173:6835","nonce":1204968390}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/4244781378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":4244781378},{"type":"v1","addr":"172.21.15.173:6837","nonce":4244781378}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.70:6837/3809137442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3809137442},{"type":"v1","addr":"172.21.15.70:6837","nonce":3809137442}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/4266233306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":4266233306},{"type":"v1","addr":"172.21.15.173:6839","nonce":4266233306}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.70:6839/398684741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":398684741},{"type":"v1","addr":"172.21.15.70:6839","nonce":398684741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26638":{"gid":26638,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6835/3437650543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3437650543},{"type":"v1","addr":"172.21.15.70:6835","nonce":3437650543}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24590,"qdb_cluster":[24590,24583,24562,24563,24550]},"id":1}]} 2024-09-10T22:02:39.846 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 40 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 msgr2=0x7f0aa00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 0x7f0aa00b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c031440 tx=0x7f0a9c005b50 comp rx=0 tx=0).stop 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 msgr2=0x7f0ab4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400b4a0 tx=0x7f0aa400b960 comp rx=0 tx=0).stop 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 shutdown_connections 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0aa00b52e0 0x7f0aa00b77a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ab4108020 0x7f0ab419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ab41076a0 0x7f0ab4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 --2- 172.21.15.39:0/2227267575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ab4101c90 0x7f0ab4199340 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.845+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 >> 172.21.15.39:0/2227267575 conn(0x7f0ab40fd700 msgr2=0x7f0ab406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.846+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 shutdown_connections 2024-09-10T22:02:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:39.846+0000 7f0aba95d640 1 -- 172.21.15.39:0/2227267575 wait complete. 2024-09-10T22:02:40.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:39 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/2227267575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:40.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:39 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/2227267575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:40.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:39 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/2227267575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:02:40.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:02:40.791 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:41.156 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:40 smithi070 ceph-mon[34909]: pgmap v572: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T22:02:41.173 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:40 smithi039 ceph-mon[30872]: pgmap v572: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T22:02:41.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:40 smithi173 ceph-mon[35294]: pgmap v572: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 -- 172.21.15.39:0/1703789331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49881087d0 msgr2=0x7f4988108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 --2- 172.21.15.39:0/1703789331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49881087d0 0x7f4988108c10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4984009900 tx=0x7f498402a410 comp rx=0 tx=0).stop 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 -- 172.21.15.39:0/1703789331 shutdown_connections 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 --2- 172.21.15.39:0/1703789331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4988109150 0x7f498810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 --2- 172.21.15.39:0/1703789331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49881087d0 0x7f4988108c10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 --2- 172.21.15.39:0/1703789331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 0x7f49881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 -- 172.21.15.39:0/1703789331 >> 172.21.15.39:0/1703789331 conn(0x7f49880fe830 msgr2=0x7f4988100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 -- 172.21.15.39:0/1703789331 shutdown_connections 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.227+0000 7f498fb97640 1 -- 172.21.15.39:0/1703789331 wait complete. 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 Processor -- start 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 -- start start 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 0x7f4988199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 0x7f4988199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4988112e50 con 0x7f4988109150 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4988112cd0 con 0x7f4988102dc0 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498fb97640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4988112fd0 con 0x7f49881087d0 2024-09-10T22:02:41.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498e134640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498e134640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46558/0 (socket says 172.21.15.39:46558) 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498e134640 1 -- 172.21.15.39:0/1770043230 learned_addr learned my addr 172.21.15.39:0/1770043230 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498d933640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 0x7f4988199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.228+0000 7f498d132640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 0x7f4988199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 -- 172.21.15.39:0/1770043230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 msgr2=0x7f4988199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 0x7f4988199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 -- 172.21.15.39:0/1770043230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 msgr2=0x7f4988199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 0x7f4988199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 -- 172.21.15.39:0/1770043230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498819f4f0 con 0x7f4988109150 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498d132640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 0x7f4988199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498e134640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f498000b970 tx=0x7f498000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:41.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980019070 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4980014440 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498819f7e0 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49800075d0 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.229+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49881a5f20 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.230+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4988103220 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.231+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f49800145f0 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.232+0000 7f497affd640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 0x7f49740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.232+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f49800e5770 con 0x7f4988109150 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.232+0000 7f498d933640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 0x7f49740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.233+0000 7f498d933640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 0x7f49740b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f497c009990 tx=0x7f497c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:41.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.235+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49800ac640 con 0x7f4988109150 2024-09-10T22:02:41.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.421+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f498819a570 con 0x7f4988109150 2024-09-10T22:02:41.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.423+0000 7f497affd640 1 -- 172.21.15.39:0/1770043230 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22652 (secure 0 0 0) 0x7f498819a570 con 0x7f4988109150 2024-09-10T22:02:41.425 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-10T22:02:41.426 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":74,"fsid":"c8786c20-6fbd-11ef-bcea-c7b262605968","created":"2024-09-10T21:44:49.364474+0000","modified":"2024-09-10T22:02:02.964186+0000","last_up_change":"2024-09-10T21:52:12.530945+0000","last_in_change":"2024-09-10T21:51:48.066343+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:48:27.848097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:52:56.779900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:52:58.502820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"56332c27-ff44-404f-888f-2afe3c4a79e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6803","nonce":3224124863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6805","nonce":3224124863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6809","nonce":3224124863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":3224124863},{"type":"v1","addr":"172.21.15.39:6807","nonce":3224124863}]},"public_addr":"172.21.15.39:6803/3224124863","cluster_addr":"172.21.15.39:6805/3224124863","heartbeat_back_addr":"172.21.15.39:6809/3224124863","heartbeat_front_addr":"172.21.15.39:6807/3224124863","state":["exists","up"]},{"osd":1,"uuid":"9c072d34-38e6-475a-b178-5482d9d1cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6801","nonce":2437314157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6803","nonce":2437314157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6807","nonce":2437314157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2437314157},{"type":"v1","addr":"172.21.15.70:6805","nonce":2437314157}]},"public_addr":"172.21.15.70:6801/2437314157","cluster_addr":"172.21.15.70:6803/2437314157","heartbeat_back_addr":"172.21.15.70:6807/2437314157","heartbeat_front_addr":"172.21.15.70:6805/2437314157","state":["exists","up"]},{"osd":2,"uuid":"1368958a-2ba8-4150-a83e-34fe758cc97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6801","nonce":2216129379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6803","nonce":2216129379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6807","nonce":2216129379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2216129379},{"type":"v1","addr":"172.21.15.173:6805","nonce":2216129379}]},"public_addr":"172.21.15.173:6801/2216129379","cluster_addr":"172.21.15.173:6803/2216129379","heartbeat_back_addr":"172.21.15.173:6807/2216129379","heartbeat_front_addr":"172.21.15.173:6805/2216129379","state":["exists","up"]},{"osd":3,"uuid":"1e1d4a1d-b631-4b70-91f0-ac23984ab2c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6811","nonce":924157830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6813","nonce":924157830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6817","nonce":924157830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":924157830},{"type":"v1","addr":"172.21.15.39:6815","nonce":924157830}]},"public_addr":"172.21.15.39:6811/924157830","cluster_addr":"172.21.15.39:6813/924157830","heartbeat_back_addr":"172.21.15.39:6817/924157830","heartbeat_front_addr":"172.21.15.39:6815/924157830","state":["exists","up"]},{"osd":4,"uuid":"28463f55-3ef4-40b9-8ee0-2ce24d86681e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6809","nonce":345717748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6811","nonce":345717748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6815","nonce":345717748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":345717748},{"type":"v1","addr":"172.21.15.70:6813","nonce":345717748}]},"public_addr":"172.21.15.70:6809/345717748","cluster_addr":"172.21.15.70:6811/345717748","heartbeat_back_addr":"172.21.15.70:6815/345717748","heartbeat_front_addr":"172.21.15.70:6813/345717748","state":["exists","up"]},{"osd":5,"uuid":"b164260c-3662-492f-82c1-9514e6eaddc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6809","nonce":1964049526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6811","nonce":1964049526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6815","nonce":1964049526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1964049526},{"type":"v1","addr":"172.21.15.173:6813","nonce":1964049526}]},"public_addr":"172.21.15.173:6809/1964049526","cluster_addr":"172.21.15.173:6811/1964049526","heartbeat_back_addr":"172.21.15.173:6815/1964049526","heartbeat_front_addr":"172.21.15.173:6813/1964049526","state":["exists","up"]},{"osd":6,"uuid":"2699e689-3038-4851-b19e-c1d2db643248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6819","nonce":52541614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6821","nonce":52541614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6825","nonce":52541614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":52541614},{"type":"v1","addr":"172.21.15.39:6823","nonce":52541614}]},"public_addr":"172.21.15.39:6819/52541614","cluster_addr":"172.21.15.39:6821/52541614","heartbeat_back_addr":"172.21.15.39:6825/52541614","heartbeat_front_addr":"172.21.15.39:6823/52541614","state":["exists","up"]},{"osd":7,"uuid":"a67c0aa9-e82c-4eef-bfa2-c7fb2abdba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6817","nonce":2255770710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6819","nonce":2255770710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6823","nonce":2255770710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2255770710},{"type":"v1","addr":"172.21.15.70:6821","nonce":2255770710}]},"public_addr":"172.21.15.70:6817/2255770710","cluster_addr":"172.21.15.70:6819/2255770710","heartbeat_back_addr":"172.21.15.70:6823/2255770710","heartbeat_front_addr":"172.21.15.70:6821/2255770710","state":["exists","up"]},{"osd":8,"uuid":"92a3c209-2026-4723-8b0c-b0e780c4cdf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6817","nonce":1670675498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6819","nonce":1670675498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6823","nonce":1670675498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1670675498},{"type":"v1","addr":"172.21.15.173:6821","nonce":1670675498}]},"public_addr":"172.21.15.173:6817/1670675498","cluster_addr":"172.21.15.173:6819/1670675498","heartbeat_back_addr":"172.21.15.173:6823/1670675498","heartbeat_front_addr":"172.21.15.173:6821/1670675498","state":["exists","up"]},{"osd":9,"uuid":"44086006-8ec9-46fd-bf78-c82043bdb546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6827","nonce":4072421182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6829","nonce":4072421182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6833","nonce":4072421182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":4072421182},{"type":"v1","addr":"172.21.15.39:6831","nonce":4072421182}]},"public_addr":"172.21.15.39:6827/4072421182","cluster_addr":"172.21.15.39:6829/4072421182","heartbeat_back_addr":"172.21.15.39:6833/4072421182","heartbeat_front_addr":"172.21.15.39:6831/4072421182","state":["exists","up"]},{"osd":10,"uuid":"c9ca0ca6-7ace-4069-b3c2-d5630dca41fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6825","nonce":1015386076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6827","nonce":1015386076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6831","nonce":1015386076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1015386076},{"type":"v1","addr":"172.21.15.70:6829","nonce":1015386076}]},"public_addr":"172.21.15.70:6825/1015386076","cluster_addr":"172.21.15.70:6827/1015386076","heartbeat_back_addr":"172.21.15.70:6831/1015386076","heartbeat_front_addr":"172.21.15.70:6829/1015386076","state":["exists","up"]},{"osd":11,"uuid":"a925b267-e78c-4cd2-b4c3-a236abc4ce1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6825","nonce":921760262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6827","nonce":921760262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6831","nonce":921760262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":921760262},{"type":"v1","addr":"172.21.15.173:6829","nonce":921760262}]},"public_addr":"172.21.15.173:6825/921760262","cluster_addr":"172.21.15.173:6827/921760262","heartbeat_back_addr":"172.21.15.173:6831/921760262","heartbeat_front_addr":"172.21.15.173:6829/921760262","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:34.573388+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:47:59.686468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:24.860961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:48:49.950407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:15.240226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:49:41.160414+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:07.361897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:30.990543+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:50:55.828489+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:21.070373+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:51:44.730071+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:52:09.982015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2182482631":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1818411713":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:0/1854014949":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2652652450":"2024-09-11T21:45:18.572537+0000","172.21.15.39:6800/1744585389":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6801/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/2133570636":"2024-09-11T21:45:43.360662+0000","172.21.15.39:6800/189886877":"2024-09-11T21:45:18.572537+0000","172.21.15.39:0/1872994819":"2024-09-11T21:45:18.572537+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:02:41.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 msgr2=0x7f49740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:41.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 0x7f49740b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f497c009990 tx=0x7f497c009110 comp rx=0 tx=0).stop 2024-09-10T22:02:41.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 msgr2=0x7f498819ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:41.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f498000b970 tx=0x7f498000bd70 comp rx=0 tx=0).stop 2024-09-10T22:02:41.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 shutdown_connections 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f49740b52e0 0x7f49740b77a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4988109150 0x7f498819ed20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49881087d0 0x7f4988199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 --2- 172.21.15.39:0/1770043230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4988102dc0 0x7f4988199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 >> 172.21.15.39:0/1770043230 conn(0x7f49880fe830 msgr2=0x7f4988100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 shutdown_connections 2024-09-10T22:02:41.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:41.425+0000 7f498fb97640 1 -- 172.21.15.39:0/1770043230 wait complete. 2024-09-10T22:02:42.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:41 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1770043230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:42.160 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:41 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1770043230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:42.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T22:02:42.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:41 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1770043230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:02:42.426 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.855+0000 7f0f735e2640 1 -- 172.21.15.39:0/3116956035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c1087d0 msgr2=0x7f0f6c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.855+0000 7f0f735e2640 1 --2- 172.21.15.39:0/3116956035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c108c10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009900 tx=0x7f0f5c02a410 comp rx=0 tx=0).stop 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 -- 172.21.15.39:0/3116956035 shutdown_connections 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 --2- 172.21.15.39:0/3116956035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c109150 0x7f0f6c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 --2- 172.21.15.39:0/3116956035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c108c10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 --2- 172.21.15.39:0/3116956035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 -- 172.21.15.39:0/3116956035 >> 172.21.15.39:0/3116956035 conn(0x7f0f6c0fe830 msgr2=0x7f0f6c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 -- 172.21.15.39:0/3116956035 shutdown_connections 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 -- 172.21.15.39:0/3116956035 wait complete. 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.856+0000 7f0f735e2640 1 Processor -- start 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 -- start start 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:42.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c112e10 con 0x7f0f6c109150 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c112c90 con 0x7f0f6c102dc0 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f735e2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c112f90 con 0x7f0f6c1087d0 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46584/0 (socket says 172.21.15.39:46584) 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 -- 172.21.15.39:0/1728060796 learned_addr learned my addr 172.21.15.39:0/1728060796 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f70b7d640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f7137e640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 -- 172.21.15.39:0/1728060796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c1087d0 msgr2=0x7f0f6c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 -- 172.21.15.39:0/1728060796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 msgr2=0x7f0f6c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f71b7f640 1 -- 172.21.15.39:0/1728060796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c19f2b0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.857+0000 7f0f7137e640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f71b7f640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cce0 tx=0x7f0f6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400f450 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6400faa0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c19f5a0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64018b70 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.858+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c1a5c60 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.859+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c1031a0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.860+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0f6400f5f0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.861+0000 7f0f627fc640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 0x7f0f580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.861+0000 7f0f7137e640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 0x7f0f580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.861+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0f640e63d0 con 0x7f0f6c109150 2024-09-10T22:02:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.861+0000 7f0f7137e640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 0x7f0f580b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f680058c0 tx=0x7f0f68005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:42.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:42.865+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f64014030 con 0x7f0f6c109150 2024-09-10T22:02:43.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.091+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0f6c1a5f20 con 0x7f0f6c109150 2024-09-10T22:02:43.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.093+0000 7f0f627fc640 1 -- 172.21.15.39:0/1728060796 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f0f640ad330 con 0x7f0f6c109150 2024-09-10T22:02:43.095 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.096+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 msgr2=0x7f0f580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.096+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 0x7f0f580b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f680058c0 tx=0x7f0f68005ec0 comp rx=0 tx=0).stop 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.096+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 msgr2=0x7f0f6c19eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.096+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cce0 tx=0x7f0f6400a620 comp rx=0 tx=0).stop 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.096+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 shutdown_connections 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7f0f580b52e0 0x7f0f580b77a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f6c109150 0x7f0f6c19eae0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:43.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f6c1087d0 0x7f0f6c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:43.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 --2- 172.21.15.39:0/1728060796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f6c102dc0 0x7f0f6c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:43.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 >> 172.21.15.39:0/1728060796 conn(0x7f0f6c0fe830 msgr2=0x7f0f6c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:43.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 shutdown_connections 2024-09-10T22:02:43.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:43.097+0000 7f0f735e2640 1 -- 172.21.15.39:0/1728060796 wait complete. 2024-09-10T22:02:43.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:42 smithi039 ceph-mon[30872]: pgmap v573: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-10T22:02:43.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a[30868]: 2024-09-10T22:02:43.091+0000 7f4ea6ce1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:02:43.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:42 smithi173 ceph-mon[35294]: pgmap v573: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mds[65207]: -- 172.21.15.173:0/3952733823 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1c2db9c20 con 0x55a1c2d97400 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: starting mds.f at 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mds[65816]: -- 172.21.15.173:0/1963722074 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560729115c20 con 0x5607290f3000 2024-09-10T22:02:43.243 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: starting mds.i at 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mds[65511]: -- 172.21.15.173:0/1170742356 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c191ab1860 con 0x55c191a8f400 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: starting mds.c at 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mds[64902]: -- 172.21.15.173:0/521851425 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563723aad860 con 0x563723a8b400 2024-09-10T22:02:43.244 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: starting mds.l at 2024-09-10T22:02:43.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:42 smithi070 ceph-mon[34909]: pgmap v573: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-10T22:02:43.406 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mds[63994]: -- 172.21.15.70:0/2600920995 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56138f81b860 con 0x56138f7f9400 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: starting mds.h at 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mds[63694]: -- 172.21.15.70:0/2558943470 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562848dddc20 con 0x562848dbb000 2024-09-10T22:02:43.407 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: starting mds.e at 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mds[64291]: -- 172.21.15.70:0/926586030 <== mon.2 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bed62d1860 con 0x55bed62af000 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: starting mds.b at 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.408 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.409 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mds[63381]: -- 172.21.15.70:0/1421307160 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e18d79c20 con 0x559e18d56800 2024-09-10T22:02:43.409 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: starting mds.k at 2024-09-10T22:02:43.419 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.419 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.419 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mds[74758]: -- 172.21.15.39:0/3571024376 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616f792f860 con 0x5616f790d000 2024-09-10T22:02:43.420 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: starting mds.a at 2024-09-10T22:02:43.420 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: ignoring --setuser ceph since I am not root 2024-09-10T22:02:43.420 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: ignoring --setgroup ceph since I am not root 2024-09-10T22:02:43.420 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mds[74356]: -- 172.21.15.39:0/3826668627 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590d10ef860 con 0x5590d10cd000 2024-09-10T22:02:43.421 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: starting mds.g at 2024-09-10T22:02:43.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:02:43.923 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:02:43.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:02:43.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:02:43.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:02:43.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:02:43.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:43 smithi039 ceph-mon[30872]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T22:02:43.938 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:02:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:02:44.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:02:44.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:02:44.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:02:44.243 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:43 smithi173 ceph-mon[35294]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T22:02:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:02:44.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:02:44.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:02:44.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1728060796' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:02:44.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:02:44.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:43 smithi070 ceph-mon[34909]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T22:02:44.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 -- 172.21.15.39:0/203266930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe42010d120 msgr2=0x7fe42010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 --2- 172.21.15.39:0/203266930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe42010d120 0x7fe42010f590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe418009ca0 tx=0x7fe41802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 -- 172.21.15.39:0/203266930 shutdown_connections 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 --2- 172.21.15.39:0/203266930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe42010d120 0x7fe42010f590 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 --2- 172.21.15.39:0/203266930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 0x7fe42010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 --2- 172.21.15.39:0/203266930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe420103b70 0x7fe420103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 -- 172.21.15.39:0/203266930 >> 172.21.15.39:0/203266930 conn(0x7fe4200fd700 msgr2=0x7fe4200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 -- 172.21.15.39:0/203266930 shutdown_connections 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.406+0000 7fe4284ea640 1 -- 172.21.15.39:0/203266930 wait complete. 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 Processor -- start 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 -- start start 2024-09-10T22:02:44.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 0x7fe420199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 0x7fe42019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe420112da0 con 0x7fe420103b70 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe420112c20 con 0x7fe42010d120 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe4284ea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe420112f20 con 0x7fe420104570 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe426286640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe426286640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46634/0 (socket says 172.21.15.39:46634) 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.407+0000 7fe426286640 1 -- 172.21.15.39:0/1337956662 learned_addr learned my addr 172.21.15.39:0/1337956662 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:44.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe425a85640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 0x7fe420199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426a87640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 0x7fe42019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 -- 172.21.15.39:0/1337956662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 msgr2=0x7fe420199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 0x7fe420199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 -- 172.21.15.39:0/1337956662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 msgr2=0x7fe42019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 0x7fe42019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 -- 172.21.15.39:0/1337956662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019f2a0 con 0x7fe420103b70 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426a87640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 0x7fe42019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe426286640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00e9f0 tx=0x7fe41c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00cd80 con 0x7fe420103b70 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41c0108e0 con 0x7fe420103b70 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019f590 con 0x7fe420103b70 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c018980 con 0x7fe420103b70 2024-09-10T22:02:44.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.408+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a5e20 con 0x7fe420103b70 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.409+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe420103f50 con 0x7fe420103b70 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.411+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe41c010430 con 0x7fe420103b70 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.411+0000 7fe4137fe640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 0x7fe40c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.411+0000 7fe425a85640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 0x7fe40c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.412+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8641+0+0 (secure 0 0 0) 0x7fe41c0e60e0 con 0x7fe420103b70 2024-09-10T22:02:44.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.412+0000 7fe425a85640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 0x7fe40c0b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe42010f6b0 tx=0x7fe41400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:44.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.416+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe41c0acda0 con 0x7fe420103b70 2024-09-10T22:02:44.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:44.642+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe4201a60c0 con 0x7fe420103b70 2024-09-10T22:02:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.111+0000 7fe4137fe640 1 -- 172.21.15.39:0/1337956662 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fe41c0ac6a0 con 0x7fe420103b70 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 msgr2=0x7fe40c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 0x7fe40c0b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe42010f6b0 tx=0x7fe41400b390 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 msgr2=0x7fe4201991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00e9f0 tx=0x7fe41c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 shutdown_connections 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fe40c0b5360 0x7fe40c0b7820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010d120 0x7fe42019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe420104570 0x7fe420199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 --2- 172.21.15.39:0/1337956662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe420103b70 0x7fe4201991f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:45.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 >> 172.21.15.39:0/1337956662 conn(0x7fe4200fd700 msgr2=0x7fe4200fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:45.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 shutdown_connections 2024-09-10T22:02:45.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:45.113+0000 7fe4284ea640 1 -- 172.21.15.39:0/1337956662 wait complete. 2024-09-10T22:02:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: pgmap v575: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-10T22:02:45.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6838/3993713240,v1:172.21.15.39:6840/3993713240] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.39:6839/3325857690,v1:172.21.15.39:6841/3325857690] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6832/2565742823,v1:172.21.15.173:6834/2565742823] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6833/2887809013,v1:172.21.15.173:6835/2887809013] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6832/345942907,v1:172.21.15.70:6833/345942907] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6836/1804423999,v1:172.21.15.173:6837/1804423999] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6834/2225385149,v1:172.21.15.70:6836/2225385149] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6835/732541572,v1:172.21.15.70:6837/732541572] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.173:6838/3890932378,v1:172.21.15.173:6839/3890932378] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: mds.? [v2:172.21.15.70:6838/1885786467,v1:172.21.15.70:6839/1885786467] up:boot 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:02:45.407 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:45.408 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:45 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:02:45.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: pgmap v575: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-10T22:02:45.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6838/3993713240,v1:172.21.15.39:6840/3993713240] up:boot 2024-09-10T22:02:45.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.39:6839/3325857690,v1:172.21.15.39:6841/3325857690] up:boot 2024-09-10T22:02:45.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6832/2565742823,v1:172.21.15.173:6834/2565742823] up:boot 2024-09-10T22:02:45.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6833/2887809013,v1:172.21.15.173:6835/2887809013] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6832/345942907,v1:172.21.15.70:6833/345942907] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6836/1804423999,v1:172.21.15.173:6837/1804423999] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6834/2225385149,v1:172.21.15.70:6836/2225385149] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6835/732541572,v1:172.21.15.70:6837/732541572] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.173:6838/3890932378,v1:172.21.15.173:6839/3890932378] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: mds.? [v2:172.21.15.70:6838/1885786467,v1:172.21.15.70:6839/1885786467] up:boot 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:02:45.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:02:45.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:02:45.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:02:45.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:45.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:45 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:02:45.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: pgmap v575: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6838/3993713240,v1:172.21.15.39:6840/3993713240] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.39:6839/3325857690,v1:172.21.15.39:6841/3325857690] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6832/2565742823,v1:172.21.15.173:6834/2565742823] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6833/2887809013,v1:172.21.15.173:6835/2887809013] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6832/345942907,v1:172.21.15.70:6833/345942907] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6836/1804423999,v1:172.21.15.173:6837/1804423999] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6834/2225385149,v1:172.21.15.70:6836/2225385149] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6835/732541572,v1:172.21.15.70:6837/732541572] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.173:6838/3890932378,v1:172.21.15.173:6839/3890932378] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: mds.? [v2:172.21.15.70:6838/1885786467,v1:172.21.15.70:6839/1885786467] up:boot 2024-09-10T22:02:45.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='mgr.14150 172.21.15.39:0/1800734724' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:02:45.494 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:45 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:02:45.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:02:46.038 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:46.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:46 smithi070 ceph-mon[34909]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:02:46.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:46 smithi070 ceph-mon[34909]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:02:46.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:46 smithi070 ceph-mon[34909]: Cluster is now healthy 2024-09-10T22:02:46.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:46 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:02:46.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:46 smithi070 ceph-mon[34909]: fsmap 12 up:standby 2024-09-10T22:02:46.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:46 smithi039 ceph-mon[30872]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:02:46.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:46 smithi039 ceph-mon[30872]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:02:46.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:46 smithi039 ceph-mon[30872]: Cluster is now healthy 2024-09-10T22:02:46.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:46 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:02:46.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:46 smithi039 ceph-mon[30872]: fsmap 12 up:standby 2024-09-10T22:02:46.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:46 smithi173 ceph-mon[35294]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:02:46.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:46 smithi173 ceph-mon[35294]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:02:46.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:46 smithi173 ceph-mon[35294]: Cluster is now healthy 2024-09-10T22:02:46.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:46 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/1337956662' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:02:46.493 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:46 smithi173 ceph-mon[35294]: fsmap 12 up:standby 2024-09-10T22:02:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 -- 172.21.15.39:0/3905212905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc104101cd0 msgr2=0x7fc1041020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/3905212905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc104101cd0 0x7fc1041020b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc100009900 tx=0x7fc10002a410 comp rx=0 tx=0).stop 2024-09-10T22:02:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 -- 172.21.15.39:0/3905212905 shutdown_connections 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/3905212905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104108060 0x7fc10410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/3905212905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1041076e0 0x7fc104107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/3905212905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc104101cd0 0x7fc1041020b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 -- 172.21.15.39:0/3905212905 >> 172.21.15.39:0/3905212905 conn(0x7fc1040fd700 msgr2=0x7fc1040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 -- 172.21.15.39:0/3905212905 shutdown_connections 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.491+0000 7fc10b8cd640 1 -- 172.21.15.39:0/3905212905 wait complete. 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 Processor -- start 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 -- start start 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc104101cd0 0x7fc10419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104108060 0x7fc10419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc104111d20 con 0x7fc1041076e0 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc104111ba0 con 0x7fc104101cd0 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc10b8cd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc104111ea0 con 0x7fc104108060 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc108e68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc108e68640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46648/0 (socket says 172.21.15.39:46648) 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.492+0000 7fc108e68640 1 -- 172.21.15.39:0/23768655 learned_addr learned my addr 172.21.15.39:0/23768655 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc109669640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc104101cd0 0x7fc10419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 -- 172.21.15.39:0/23768655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104108060 msgr2=0x7fc10419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104108060 0x7fc10419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 -- 172.21.15.39:0/23768655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc104101cd0 msgr2=0x7fc10419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc104101cd0 0x7fc10419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 -- 172.21.15.39:0/23768655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1041a5460 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc108e68640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c920 tx=0x7fc0f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4007c70 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0f4007e10 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1041a5750 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4018820 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.493+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1041a5d60 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.494+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1041020b0 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.495+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc0f400f450 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.496+0000 7fc0fa7fc640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 0x7fc0f00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.496+0000 7fc109669640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 0x7fc0f00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.496+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8641+0+0 (secure 0 0 0) 0x7fc0f40e6160 con 0x7fc1041076e0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.497+0000 7fc109669640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 0x7fc0f00b7820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc100006010 tx=0x7fc100000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.499+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0f4014030 con 0x7fc1041076e0 2024-09-10T22:02:46.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:46.688+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc10406b8a0 con 0x7fc1041076e0 2024-09-10T22:02:47.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.126+0000 7fc0fa7fc640 1 -- 172.21.15.39:0/23768655 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7fc10406b8a0 con 0x7fc1041076e0 2024-09-10T22:02:47.129 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:02:47.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 msgr2=0x7fc0f00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:47.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 0x7fc0f00b7820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc100006010 tx=0x7fc100000bc0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 msgr2=0x7fc10419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c920 tx=0x7fc0f400cde0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 shutdown_connections 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fc0f00b5360 0x7fc0f00b7820 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104108060 0x7fc10419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1041076e0 0x7fc10419a5c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 --2- 172.21.15.39:0/23768655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc104101cd0 0x7fc10419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 >> 172.21.15.39:0/23768655 conn(0x7fc1040fd700 msgr2=0x7fc1040ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 shutdown_connections 2024-09-10T22:02:47.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:47.129+0000 7fc10b8cd640 1 -- 172.21.15.39:0/23768655 wait complete. 2024-09-10T22:02:47.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:47 smithi070 ceph-mon[34909]: pgmap v576: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-10T22:02:47.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:47 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:47 smithi039 ceph-mon[30872]: pgmap v576: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-10T22:02:47.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:47 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:47 smithi173 ceph-mon[35294]: pgmap v576: 97 pgs: 97 active+clean; 40 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-10T22:02:47.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:47 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:47.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:02:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:02:48.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:48 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:48.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:48 smithi039 ceph-mon[30872]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:02:48.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:48 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:48.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:48 smithi070 ceph-mon[34909]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:02:48.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:48 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/23768655' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:48.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:48 smithi173 ceph-mon[35294]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 -- 172.21.15.39:0/339180983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1076c0 msgr2=0x7fb84c107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 --2- 172.21.15.39:0/339180983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1076c0 0x7fb84c107b00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb838009900 tx=0x7fb83802a410 comp rx=0 tx=0).stop 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 -- 172.21.15.39:0/339180983 shutdown_connections 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 --2- 172.21.15.39:0/339180983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 0x7fb84c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 --2- 172.21.15.39:0/339180983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1076c0 0x7fb84c107b00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 --2- 172.21.15.39:0/339180983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c101cb0 0x7fb84c102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 -- 172.21.15.39:0/339180983 >> 172.21.15.39:0/339180983 conn(0x7fb84c0fd700 msgr2=0x7fb84c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 -- 172.21.15.39:0/339180983 shutdown_connections 2024-09-10T22:02:48.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.585+0000 7fb852dca640 1 -- 172.21.15.39:0/339180983 wait complete. 2024-09-10T22:02:48.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 Processor -- start 2024-09-10T22:02:48.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 -- start start 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c1076c0 0x7fb84c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 0x7fb84c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c112e20 con 0x7fb84c101cb0 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c112ca0 con 0x7fb84c108040 2024-09-10T22:02:48.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb852dca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c112fa0 con 0x7fb84c1076c0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb850b66640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb850b66640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46666/0 (socket says 172.21.15.39:46666) 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb850b66640 1 -- 172.21.15.39:0/780972336 learned_addr learned my addr 172.21.15.39:0/780972336 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb851367640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 0x7fb84c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.586+0000 7fb84bfff640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c1076c0 0x7fb84c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 -- 172.21.15.39:0/780972336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c1076c0 msgr2=0x7fb84c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c1076c0 0x7fb84c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 -- 172.21.15.39:0/780972336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 msgr2=0x7fb84c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 0x7fb84c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 -- 172.21.15.39:0/780972336 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c19f330 con 0x7fb84c101cb0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb850b66640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb84000d770 tx=0x7fb84000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840017070 con 0x7fb84c101cb0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c19f620 con 0x7fb84c101cb0 2024-09-10T22:02:48.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8400054d0 con 0x7fb84c101cb0 2024-09-10T22:02:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840004c30 con 0x7fb84c101cb0 2024-09-10T22:02:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.587+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c1a5ce0 con 0x7fb84c101cb0 2024-09-10T22:02:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.588+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c102090 con 0x7fb84c101cb0 2024-09-10T22:02:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.589+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb840004e10 con 0x7fb84c101cb0 2024-09-10T22:02:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.590+0000 7fb849ffb640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 0x7fb83c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:02:48.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.590+0000 7fb84bfff640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 0x7fb83c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:02:48.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.590+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8116+0+0 (secure 0 0 0) 0x7fb8400e5560 con 0x7fb84c101cb0 2024-09-10T22:02:48.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.591+0000 7fb84bfff640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 0x7fb83c0b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb838031440 tx=0x7fb838005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:02:48.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.594+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8400abe90 con 0x7fb84c101cb0 2024-09-10T22:02:48.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:48.781+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb84c02e5c0 con 0x7fb84c101cb0 2024-09-10T22:02:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.135+0000 7fb849ffb640 1 -- 172.21.15.39:0/780972336 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7fb8400b08c0 con 0x7fb84c101cb0 2024-09-10T22:02:49.138 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-09-10T22:02:49.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 msgr2=0x7fb83c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:49.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 0x7fb83c0b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb838031440 tx=0x7fb838005b50 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 msgr2=0x7fb84c199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb84000d770 tx=0x7fb84000dc30 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 shutdown_connections 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:6800/423421889,v1:172.21.15.39:6801/423421889] conn(0x7fb83c0b52e0 0x7fb83c0b77a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb84c108040 0x7fb84c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb84c1076c0 0x7fb84c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 --2- 172.21.15.39:0/780972336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c101cb0 0x7fb84c199280 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.138+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 >> 172.21.15.39:0/780972336 conn(0x7fb84c0fd700 msgr2=0x7fb84c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:02:49.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.139+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 shutdown_connections 2024-09-10T22:02:49.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-10T22:02:49.140+0000 7fb852dca640 1 -- 172.21.15.39:0/780972336 wait complete. 2024-09-10T22:02:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:49 smithi070 ceph-mon[34909]: pgmap v578: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:02:49.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:49 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:49.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:49 smithi039 ceph-mon[30872]: pgmap v578: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:02:49.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:49 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:49 smithi173 ceph-mon[35294]: pgmap v578: 65 pgs: 65 active+clean; 577 KiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:02:49.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:49 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:02:49.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:02:49.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:02:49.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:02:49.832 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T22:02:49.832 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:02:49.848 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:02:49.867 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:02:49.890 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T22:02:49.890 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T22:02:49.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a 2024-09-10T22:02:50.148 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:49 smithi039 systemd[1]: Stopping Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:50.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:50 smithi070 ceph-mon[34909]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:50.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:50 smithi070 ceph-mon[34909]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:02:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 ceph-mon[30872]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 ceph-mon[30872]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:02:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a[30868]: 2024-09-10T22:02:50.215+0000 7f4eac4ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:02:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a[30868]: 2024-09-10T22:02:50.215+0000 7f4eac4ec640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T22:02:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:50 smithi173 ceph-mon[35294]: from='client.? 172.21.15.39:0/780972336' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:02:50.492 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:50 smithi173 ceph-mon[35294]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:02:50.673 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 podman[105103]: 2024-09-10 22:02:50.410919724 +0000 UTC m=+0.316590722 container died 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:02:50.935 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 podman[105103]: 2024-09-10 22:02:50.757913842 +0000 UTC m=+0.663584829 container cleanup 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T22:02:50.935 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 bash[105103]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a 2024-09-10T22:02:51.167 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T22:02:51.190 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:50 smithi039 podman[105115]: 2024-09-10 22:02:50.934825209 +0000 UTC m=+0.516327711 container remove 17ce4ff0c63cbc54836336f8d6cdd32cbf9453e3010a8d30e5d5c3d8e0836580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T22:02:51.191 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:51 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T22:02:51.191 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:51 smithi039 systemd[1]: Stopped Ceph mon.a for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:02:51.191 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 10 22:02:51 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.a.service: Consumed 16.479s CPU time. 2024-09-10T22:02:51.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:51.228 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T22:02:51.228 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T22:02:51.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.b 2024-09-10T22:02:51.594 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:51 smithi070 systemd[1]: Stopping Ceph mon.b for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:51.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-b[34905]: 2024-09-10T22:02:51.592+0000 7f786bd5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:02:51.906 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-b[34905]: 2024-09-10T22:02:51.592+0000 7f786bd5b640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:02:51.907 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:51 smithi070 podman[68125]: 2024-09-10 22:02:51.756196227 +0000 UTC m=+0.282643664 container died 1e1fc8e6cc957fe64485611654cb0c1bbd2276a281b0c67ff24e0f07a3ff53a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T22:02:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:52 smithi070 podman[68125]: 2024-09-10 22:02:52.141784025 +0000 UTC m=+0.668231461 container cleanup 1e1fc8e6cc957fe64485611654cb0c1bbd2276a281b0c67ff24e0f07a3ff53a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T22:02:52.406 INFO:journalctl@ceph.mon.b.smithi070.stdout:Sep 10 22:02:52 smithi070 bash[68125]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-b 2024-09-10T22:02:52.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T22:02:52.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:52.621 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T22:02:52.621 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T22:02:52.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.c 2024-09-10T22:02:52.992 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:52 smithi173 systemd[1]: Stopping Ceph mon.c for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:53.433 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c[35290]: 2024-09-10T22:02:53.022+0000 7f7e9b3b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:02:53.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c[35290]: 2024-09-10T22:02:53.022+0000 7f7e9b3b7640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:02:53.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:53 smithi173 podman[69253]: 2024-09-10 22:02:53.125297818 +0000 UTC m=+0.302128867 container died c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T22:02:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:53 smithi173 podman[69253]: 2024-09-10 22:02:53.523606653 +0000 UTC m=+0.700437697 container cleanup c0c4baeb24da7ee87d799357a4fed1b5fcdf12350687bc075dabb17585d65ab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T22:02:53.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 10 22:02:53 smithi173 bash[69253]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mon-c 2024-09-10T22:02:53.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T22:02:53.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:53.940 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T22:02:53.940 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T22:02:53.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x 2024-09-10T22:02:54.264 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 22:02:53 smithi039 systemd[1]: Stopping Ceph mgr.x for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:54.573 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 22:02:54 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x[31100]: 2024-09-10T22:02:54.262+0000 7f6e382cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:02:54.573 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 22:02:54 smithi039 podman[105223]: 2024-09-10 22:02:54.293735992 +0000 UTC m=+0.154573065 container died b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T22:02:54.923 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 22:02:54 smithi039 podman[105223]: 2024-09-10 22:02:54.746887039 +0000 UTC m=+0.607724109 container cleanup b3670a4e59843936c89a99d6d91b7cf10d7b838b7c5a3a95e60e9bd3674df48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-09-10T22:02:54.924 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 10 22:02:54 smithi039 bash[105223]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-x 2024-09-10T22:02:55.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T22:02:55.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:55.271 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T22:02:55.272 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T22:02:55.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.y 2024-09-10T22:02:55.656 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 22:02:55 smithi070 systemd[1]: Stopping Ceph mgr.y for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:55.981 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 22:02:55 smithi070 podman[68250]: 2024-09-10 22:02:55.697883969 +0000 UTC m=+0.235372633 container died 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:02:56.365 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 22:02:56 smithi070 podman[68250]: 2024-09-10 22:02:56.092858036 +0000 UTC m=+0.630346698 container cleanup 29c82c1056a645d89ab3e6b176bd90ab2cc4abd3a82e3be1efc78e77df465e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:02:56.365 INFO:journalctl@ceph.mgr.y.smithi070.stdout:Sep 10 22:02:56 smithi070 bash[68250]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-y 2024-09-10T22:02:56.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T22:02:56.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:56.554 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T22:02:56.554 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T22:02:56.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z 2024-09-10T22:02:56.875 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:56 smithi173 systemd[1]: Stopping Ceph mgr.z for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:57.171 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:56 smithi173 podman[69378]: 2024-09-10 22:02:56.874660681 +0000 UTC m=+0.125324273 container died a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:02:57.473 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 podman[69378]: 2024-09-10 22:02:57.279250048 +0000 UTC m=+0.529913633 container cleanup a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T22:02:57.473 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 bash[69378]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z 2024-09-10T22:02:57.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T22:02:57.726 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 podman[69389]: 2024-09-10 22:02:57.472495035 +0000 UTC m=+0.591854455 container remove a8544c72c370779ecb44fa8622f94fa66c7394def82498b4b1201bf61aec20a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:02:57.726 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-10T22:02:57.726 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-10T22:02:57.726 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 systemd[1]: Stopped Ceph mgr.z for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:02:57.726 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 10 22:02:57 smithi173 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mgr.z.service: Consumed 6.824s CPU time. 2024-09-10T22:02:57.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:02:57.739 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T22:02:57.739 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T22:02:57.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.0 2024-09-10T22:02:58.036 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:02:57 smithi039 systemd[1]: Stopping Ceph osd.0 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:02:58.424 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:02:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T22:02:58.034+0000 7f2f89b16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:02:58.424 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:02:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T22:02:58.034+0000 7f2f89b16640 -1 osd.0 77 *** Got signal Terminated *** 2024-09-10T22:02:58.424 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:02:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0[47509]: 2024-09-10T22:02:58.034+0000 7f2f89b16640 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:03.846 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:03 smithi039 podman[105343]: 2024-09-10 22:03:03.58007776 +0000 UTC m=+5.640075454 container died 155baa1002df5bba65c039b58ee09934fc516ec7874f7465d816a69f4866a1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:03:04.174 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:04 smithi039 podman[105343]: 2024-09-10 22:03:04.027481977 +0000 UTC m=+6.087479670 container cleanup 155baa1002df5bba65c039b58ee09934fc516ec7874f7465d816a69f4866a1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T22:03:04.174 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:04 smithi039 bash[105343]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0 2024-09-10T22:03:04.673 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:04 smithi039 podman[105359]: 2024-09-10 22:03:04.296381746 +0000 UTC m=+0.712564768 container remove 155baa1002df5bba65c039b58ee09934fc516ec7874f7465d816a69f4866a1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T22:03:05.135 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:04 smithi039 podman[105455]: 2024-09-10 22:03:04.789089624 +0000 UTC m=+0.098336630 container create c37452510a541fdc6a325f4b08057eba3f2620f3870fb17ec5ab74f9bd26a168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T22:03:05.135 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:04 smithi039 podman[105455]: 2024-09-10 22:03:04.707898869 +0000 UTC m=+0.017145886 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:05.135 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:05 smithi039 podman[105455]: 2024-09-10 22:03:05.017171439 +0000 UTC m=+0.326418454 container init c37452510a541fdc6a325f4b08057eba3f2620f3870fb17ec5ab74f9bd26a168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:03:05.135 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:05 smithi039 podman[105455]: 2024-09-10 22:03:05.020782304 +0000 UTC m=+0.330029309 container start c37452510a541fdc6a325f4b08057eba3f2620f3870fb17ec5ab74f9bd26a168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T22:03:05.135 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:05 smithi039 podman[105455]: 2024-09-10 22:03:05.134078248 +0000 UTC m=+0.443325275 container attach c37452510a541fdc6a325f4b08057eba3f2620f3870fb17ec5ab74f9bd26a168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T22:03:05.412 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 10 22:03:05 smithi039 podman[105455]: 2024-09-10 22:03:05.217974493 +0000 UTC m=+0.527221505 container died c37452510a541fdc6a325f4b08057eba3f2620f3870fb17ec5ab74f9bd26a168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T22:03:05.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T22:03:05.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:05.836 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T22:03:05.836 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T22:03:05.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.1 2024-09-10T22:03:06.070 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:05 smithi070 systemd[1]: Stopping Ceph osd.1 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:06.406 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T22:03:06.174+0000 7f58f3ebc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:06.406 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T22:03:06.174+0000 7f58f3ebc640 -1 osd.1 77 *** Got signal Terminated *** 2024-09-10T22:03:06.406 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1[39404]: 2024-09-10T22:03:06.174+0000 7f58f3ebc640 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:11.801 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:11 smithi070 podman[68376]: 2024-09-10 22:03:11.536878094 +0000 UTC m=+5.487461046 container died 58923c5cdfd3f9135542466d63e93fad36067be49291d54143c52953d59eaf30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:03:12.156 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:11 smithi070 podman[68376]: 2024-09-10 22:03:11.908421541 +0000 UTC m=+5.859004491 container cleanup 58923c5cdfd3f9135542466d63e93fad36067be49291d54143c52953d59eaf30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T22:03:12.156 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:11 smithi070 bash[68376]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1 2024-09-10T22:03:12.569 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68402]: 2024-09-10 22:03:12.20895002 +0000 UTC m=+0.666592203 container remove 58923c5cdfd3f9135542466d63e93fad36067be49291d54143c52953d59eaf30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T22:03:12.838 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68492]: 2024-09-10 22:03:12.471144206 +0000 UTC m=+0.016258067 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:12.838 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68492]: 2024-09-10 22:03:12.601461095 +0000 UTC m=+0.146574983 container create 613deadff15f6238e29f27e074a527b77c5fb4f5bbefb3a2be9095a639d97684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T22:03:12.838 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68492]: 2024-09-10 22:03:12.837003995 +0000 UTC m=+0.382117847 container init 613deadff15f6238e29f27e074a527b77c5fb4f5bbefb3a2be9095a639d97684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T22:03:13.126 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68492]: 2024-09-10 22:03:12.840643226 +0000 UTC m=+0.385757073 container start 613deadff15f6238e29f27e074a527b77c5fb4f5bbefb3a2be9095a639d97684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T22:03:13.126 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:12 smithi070 podman[68492]: 2024-09-10 22:03:12.928629624 +0000 UTC m=+0.473743485 container attach 613deadff15f6238e29f27e074a527b77c5fb4f5bbefb3a2be9095a639d97684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:03:13.406 INFO:journalctl@ceph.osd.1.smithi070.stdout:Sep 10 22:03:13 smithi070 podman[68492]: 2024-09-10 22:03:13.125129558 +0000 UTC m=+0.670243411 container died 613deadff15f6238e29f27e074a527b77c5fb4f5bbefb3a2be9095a639d97684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:13.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T22:03:13.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:13.761 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T22:03:13.761 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T22:03:13.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.2 2024-09-10T22:03:14.077 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:13 smithi173 systemd[1]: Stopping Ceph osd.2 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:14.492 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T22:03:14.074+0000 7f01a76d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:14.493 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T22:03:14.074+0000 7f01a76d2640 -1 osd.2 77 *** Got signal Terminated *** 2024-09-10T22:03:14.493 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2[40296]: 2024-09-10T22:03:14.074+0000 7f01a76d2640 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:19.728 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:19 smithi173 podman[69515]: 2024-09-10 22:03:19.417004493 +0000 UTC m=+5.458141719 container died 39b9ec5c127520f5ec6fd8cf1d1c670d7402ab5b6bc06b25e08ca2b76cde921b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T22:03:19.992 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:19 smithi173 podman[69515]: 2024-09-10 22:03:19.809406554 +0000 UTC m=+5.850543779 container cleanup 39b9ec5c127520f5ec6fd8cf1d1c670d7402ab5b6bc06b25e08ca2b76cde921b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T22:03:19.992 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:19 smithi173 bash[69515]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2 2024-09-10T22:03:20.376 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69530]: 2024-09-10 22:03:20.044103087 +0000 UTC m=+0.625944514 container remove 39b9ec5c127520f5ec6fd8cf1d1c670d7402ab5b6bc06b25e08ca2b76cde921b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:03:20.626 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.277796401 +0000 UTC m=+0.015609549 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:20.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.40343893 +0000 UTC m=+0.141252071 container create d852ec4668bf8aff1984e3ea201917c7cb73b49914d61ea4576f58ef9f197dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:03:20.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.62257463 +0000 UTC m=+0.360387781 container init d852ec4668bf8aff1984e3ea201917c7cb73b49914d61ea4576f58ef9f197dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T22:03:20.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.625877643 +0000 UTC m=+0.363690794 container start d852ec4668bf8aff1984e3ea201917c7cb73b49914d61ea4576f58ef9f197dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-10T22:03:20.993 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.731565211 +0000 UTC m=+0.469378364 container attach d852ec4668bf8aff1984e3ea201917c7cb73b49914d61ea4576f58ef9f197dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:03:20.993 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 10 22:03:20 smithi173 podman[69617]: 2024-09-10 22:03:20.813474365 +0000 UTC m=+0.551287512 container died d852ec4668bf8aff1984e3ea201917c7cb73b49914d61ea4576f58ef9f197dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:21.463 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T22:03:21.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:21.506 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T22:03:21.507 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T22:03:21.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.3 2024-09-10T22:03:21.834 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:21 smithi039 systemd[1]: Stopping Ceph osd.3 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:22.174 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:21 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T22:03:21.832+0000 7f2e084d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:22.174 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:21 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T22:03:21.832+0000 7f2e084d8640 -1 osd.3 77 *** Got signal Terminated *** 2024-09-10T22:03:22.174 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:21 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3[54380]: 2024-09-10T22:03:21.832+0000 7f2e084d8640 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:24.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:24 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:24.247+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:24.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:24.697+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:25.173 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:24 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:24.688+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:25.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:25 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:25.239+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:25.661 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:25.251+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:25.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:25.660+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:26.173 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:25 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:25.724+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:26.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:26.221+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:26.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:26 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:26.263+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:26.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:26.692+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:27.174 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:26 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:26.711+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:27.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:27.201+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:27.640 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:27 smithi039 podman[105569]: 2024-09-10 22:03:27.358399285 +0000 UTC m=+5.649771202 container died a015b28ffe393a7dcbac66086555304d3b35d456144d21a9e2585e1baaf42d3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:03:27.640 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:27 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:27.232+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:27.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:27 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:27.285+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:27.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:27 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:27.671+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:27.924 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:27 smithi039 podman[105569]: 2024-09-10 22:03:27.732929258 +0000 UTC m=+6.024301175 container cleanup a015b28ffe393a7dcbac66086555304d3b35d456144d21a9e2585e1baaf42d3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T22:03:27.924 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:27 smithi039 bash[105569]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3 2024-09-10T22:03:27.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:27.646+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:28.344 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105599]: 2024-09-10 22:03:28.000885869 +0000 UTC m=+0.636385099 container remove a015b28ffe393a7dcbac66086555304d3b35d456144d21a9e2585e1baaf42d3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T22:03:28.344 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:28 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:28.190+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:28.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:28.224+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:28.230+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:28.639 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.343616063 +0000 UTC m=+0.095986732 container create cfb329adaad038aae3ea935d49f88d75addc9aed34c195bc76c3cd4fb482227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T22:03:28.640 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.264192438 +0000 UTC m=+0.016563077 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:28.640 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.546495533 +0000 UTC m=+0.298866160 container init cfb329adaad038aae3ea935d49f88d75addc9aed34c195bc76c3cd4fb482227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:03:28.640 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.549916579 +0000 UTC m=+0.302287208 container start cfb329adaad038aae3ea935d49f88d75addc9aed34c195bc76c3cd4fb482227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:28.640 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.638280149 +0000 UTC m=+0.390650790 container attach cfb329adaad038aae3ea935d49f88d75addc9aed34c195bc76c3cd4fb482227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:03:28.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:28 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:28.301+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:28.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:28 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:28.720+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:28.924 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 10 22:03:28 smithi039 podman[105687]: 2024-09-10 22:03:28.744559603 +0000 UTC m=+0.496930230 container died cfb329adaad038aae3ea935d49f88d75addc9aed34c195bc76c3cd4fb482227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:03:28.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:28.604+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:29.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:29 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:29.148+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:29.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T22:03:29.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:29.279+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:29.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:29.235+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:29.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:29.502 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T22:03:29.502 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T22:03:29.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.4 2024-09-10T22:03:29.530 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:29 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:29.268+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:29.809 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:29 smithi070 systemd[1]: Stopping Ceph osd.4 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:29.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:29 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:29.674+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:29.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:29.583+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:30.156 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:29 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T22:03:29.807+0000 7f76d7834640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:30.156 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:29 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T22:03:29.807+0000 7f76d7834640 -1 osd.4 77 *** Got signal Terminated *** 2024-09-10T22:03:30.156 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:29 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T22:03:29.807+0000 7f76d7834640 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:30.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:30 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:30.163+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:30.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:30 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:30.231+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:30.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:30 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:30.278+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:30.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:30 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:30.236+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:30.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:30 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:30.619+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:31.151 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:30 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:30.692+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:31.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:31 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:31.150+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:31.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:31 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:31.277+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:31.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:31 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:31.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:31.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:31 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:31.249+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:31.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:31 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:31.651+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:32.161 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:31 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:31.699+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:32.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:32 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:32.159+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:32.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:32 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:32.270+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:32.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:32 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:32.198+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:32.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:32 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:32.198+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:32.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:32 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:32.292+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:32.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:32 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:32.657+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:32.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:32 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:32.689+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:33.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:33 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:33.148+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:33.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:33 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:33.148+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:33.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:33 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:33.275+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:33.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:33 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:33.149+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:33.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:33 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:33.149+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:33.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:33 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:33.300+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:33.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:33 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:33.626+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:33.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:33 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:33.658+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:34.276 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:34 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:34.021+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:34.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:34 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:34.137+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:34.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:34 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:34.137+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:34.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:34 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:34.273+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:34.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:34 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:34.103+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:34.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:34 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:34.103+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:34.656 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:34 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4[45891]: 2024-09-10T22:03:34.420+0000 7f76d3e49640 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.196780+0000 front 2024-09-10T22:03:10.196812+0000 (oldest deadline 2024-09-10T22:03:34.197685+0000) 2024-09-10T22:03:34.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:34 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:34.274+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:34.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:34 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:34.274+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:34.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:34 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:34.643+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:34.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:34 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:34.643+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:34.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:34 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:34.619+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:35.296 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:35 smithi070 podman[68597]: 2024-09-10 22:03:35.190852186 +0000 UTC m=+5.495383008 container died 79d719b4d1fc8038525bff610a5a088538132ab65de1211fdce530e2f7c26891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:03:35.297 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:35 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:35.039+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:35.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:35 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:35.138+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:35.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:35 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:35.138+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:35.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:35 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:35.237+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:35.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:35 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:35.120+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:35.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:35 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:35.120+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:35.558 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:35 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:35.294+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:35.558 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:35 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:35.294+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:35.859 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:35 smithi070 podman[68597]: 2024-09-10 22:03:35.557166327 +0000 UTC m=+5.861697163 container cleanup 79d719b4d1fc8038525bff610a5a088538132ab65de1211fdce530e2f7c26891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:03:35.859 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:35 smithi070 bash[68597]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4 2024-09-10T22:03:35.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:35 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:35.617+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:35.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:35 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:35.617+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:35.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:35 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:35.612+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:36.156 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:36 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:36.023+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:36.156 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:35 smithi070 podman[68614]: 2024-09-10 22:03:35.858422826 +0000 UTC m=+0.661036508 container remove 79d719b4d1fc8038525bff610a5a088538132ab65de1211fdce530e2f7c26891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T22:03:36.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:36.102+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:36.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:36.102+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:36.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:36 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:36.244+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:36.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:36 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:36.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:36.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:36 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:36.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.068697408 +0000 UTC m=+0.015529720 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.167404309 +0000 UTC m=+0.114236611 container create 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.411626381 +0000 UTC m=+0.358458683 container init 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.414904213 +0000 UTC m=+0.361736516 container start 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.511606859 +0000 UTC m=+0.458439161 container attach 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:36 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:36.274+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:36.513 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:36 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:36.274+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:36.906 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:36 smithi070 podman[68703]: 2024-09-10 22:03:36.603535739 +0000 UTC m=+0.550368054 container died 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T22:03:36.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:36.598+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:36.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:36.598+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:36.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:36 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:36.622+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:36.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:36 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:36.622+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:37.199 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:36 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:36.989+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:37.224 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:37 smithi070 podman[68726]: 2024-09-10 22:03:37.198170412 +0000 UTC m=+0.588565499 container remove 477018f31844d785c3ed681eb18c9c9b3eb0dc9d00c80c9be82f4ae7932e4569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T22:03:37.224 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:37 smithi070 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-10T22:03:37.224 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:37 smithi070 systemd[1]: Stopped Ceph osd.4 for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:03:37.224 INFO:journalctl@ceph.osd.4.smithi070.stdout:Sep 10 22:03:37 smithi070 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.4.service: Consumed 50.796s CPU time. 2024-09-10T22:03:37.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T22:03:37.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:37.307 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T22:03:37.307 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T22:03:37.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.5 2024-09-10T22:03:37.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:37 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:37.133+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:37.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:37 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:37.133+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:37.492 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 systemd[1]: Stopping Ceph osd.5 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:37.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:37.293+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:37.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:37.112+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:37.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:37.112+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:37.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:37 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:37.276+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:37.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:37 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:37.276+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:37.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:37 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:37.612+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:37.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:37 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:37.612+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:37.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:37.620+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:37.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:37.620+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:37.993 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:37.630+0000 7f34e26ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:37.993 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:37.630+0000 7f34e26ba640 -1 osd.5 77 *** Got signal Terminated *** 2024-09-10T22:03:37.993 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:37 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:37.630+0000 7f34e26ba640 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:38.312 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:37 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:37.963+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:38.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:38.144+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:38.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:38.144+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:38.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:38 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:38.245+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:38.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:38 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:38.103+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:38.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:38 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:38.103+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:38.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:38 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:38.310+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:38.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:38 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:38.310+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:38.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:38.651+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:38.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:38 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:38.651+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:38.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:38 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:38.626+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:38.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:38 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:38.626+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:39.327 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:38 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:38.995+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:39.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:39.171+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:39.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:39.171+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:39.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:39 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:39.260+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:39.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:39 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:39.112+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:39.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:39 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:39.112+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:39.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:39 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:39.326+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:39.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:39 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:39.326+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:39.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:39.656+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:39.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:39.656+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:39.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:39 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:39.666+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:39.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:39 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:39.666+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:40.317 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:40 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:40.002+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:40.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:40 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:40.166+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:40.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:40 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:40.166+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:40.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:40.266+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:40.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:40.098+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:40.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:40.098+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:40.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:40 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:40.316+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:40.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:40 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:40.316+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:40.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:40 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:40.316+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:40.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:40 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:40.642+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:40.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:40 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:40.642+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:40.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:40.645+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:40.993 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:40.645+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:40.993 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:40 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:40.645+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.603628+0000 front 2024-09-10T22:03:16.603648+0000 (oldest deadline 2024-09-10T22:03:40.103772+0000) 2024-09-10T22:03:41.364 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:40 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:40.996+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:41.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:41.242+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:41.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:41.101+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:41.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:41.101+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:41.612 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:41 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:41.197+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:41.612 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:41 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:41.197+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:41.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:41 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:41.363+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:41.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:41 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:41.363+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:41.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:41 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:41.363+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:41.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:41 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:41.610+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:41.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:41 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:41.610+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:41.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:41 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:41.610+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:41.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:41.687+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.401716+0000 front 2024-09-10T22:03:01.401869+0000 (oldest deadline 2024-09-10T22:03:23.701616+0000) 2024-09-10T22:03:41.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:41.687+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.703183+0000 front 2024-09-10T22:03:10.703198+0000 (oldest deadline 2024-09-10T22:03:36.603243+0000) 2024-09-10T22:03:41.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:41 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5[47194]: 2024-09-10T22:03:41.687+0000 7f34deccf640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.603628+0000 front 2024-09-10T22:03:16.603648+0000 (oldest deadline 2024-09-10T22:03:40.103772+0000) 2024-09-10T22:03:42.382 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:41 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:41.975+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:42.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:42.246+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:42.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:42.130+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:42.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:42.130+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:42.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:42 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:42.130+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:42.566 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:42 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:42.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:42.566 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:42 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:42.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:42.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:42 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:42.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:42.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:42 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:42.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:42.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:42 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:42.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:42.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:42 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:42.565+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:42.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:42 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:42.565+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:42.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:42 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:42.565+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:43.333 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:43 smithi173 podman[69732]: 2024-09-10 22:03:43.052470401 +0000 UTC m=+5.547211216 container died 9587ce4b9db1fccf3ff4fb03102e91822c4293329fc81fbf58cb42f659613210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:03:43.333 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:43.289+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:43.334 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:43.151+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:43.334 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:43.151+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:43.334 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:43 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:43.151+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:43.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:43.017+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:43.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:43.017+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:43.522 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:43.194+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:43.522 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:43.194+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:43.674 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:43 smithi173 podman[69732]: 2024-09-10 22:03:43.442122697 +0000 UTC m=+5.936863511 container cleanup 9587ce4b9db1fccf3ff4fb03102e91822c4293329fc81fbf58cb42f659613210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T22:03:43.674 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:43 smithi173 bash[69732]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5 2024-09-10T22:03:43.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:43.428+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:43.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:43.428+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:43.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:43 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:43.428+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:43.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:43.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:43.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:43.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:43.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:43 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:43.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:43.992 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:43 smithi173 podman[69747]: 2024-09-10 22:03:43.673570412 +0000 UTC m=+0.618690871 container remove 9587ce4b9db1fccf3ff4fb03102e91822c4293329fc81fbf58cb42f659613210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:03:44.261 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:44 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:44.142+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:44.261 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:44 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:44.142+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:44.261 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:44 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:44.142+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:44.262 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:43.9120189 +0000 UTC m=+0.016013715 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:44.262 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:44.0327486 +0000 UTC m=+0.136743403 container create c019be5c8eba9e2dc6a8affad630c3d450b7e29fd6c17cc1d5dea308db7fe6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T22:03:44.262 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:44.243506327 +0000 UTC m=+0.347501130 container init c019be5c8eba9e2dc6a8affad630c3d450b7e29fd6c17cc1d5dea308db7fe6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:03:44.262 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:44.246846887 +0000 UTC m=+0.350841691 container start c019be5c8eba9e2dc6a8affad630c3d450b7e29fd6c17cc1d5dea308db7fe6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T22:03:44.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:44 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:44.051+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:44.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:44 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:44.051+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:44.511 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:44.205+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:44.511 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:44.205+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:44.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:44 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:44.259+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:44.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:44 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:44.259+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:44.743 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:44.352122126 +0000 UTC m=+0.456116939 container attach c019be5c8eba9e2dc6a8affad630c3d450b7e29fd6c17cc1d5dea308db7fe6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:03:44.743 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 10 22:03:44 smithi173 podman[69835]: 2024-09-10 22:03:44.436840928 +0000 UTC m=+0.540835744 container died c019be5c8eba9e2dc6a8affad630c3d450b7e29fd6c17cc1d5dea308db7fe6e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T22:03:44.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:44 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:44.455+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:44.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:44 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:44.455+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:44.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:44 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:44.455+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:44.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:44.509+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:44.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:44.509+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:44.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:44.509+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:45.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T22:03:45.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:45.081 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T22:03:45.081 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T22:03:45.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.6 2024-09-10T22:03:45.379 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 systemd[1]: Stopping Ceph osd.6 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:45.379 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:45.195+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:45.379 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:45.195+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:45.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:45.041+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:45.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:45.041+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:45.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:45 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:45.213+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:45.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:45 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:45.213+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:45.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:45 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:45.098+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:45.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:45 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:45.098+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:45.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:45 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:45.098+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.376+0000 7fbcf43a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.376+0000 7fbcf43a5640 -1 osd.6 77 *** Got signal Terminated *** 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.376+0000 7fbcf43a5640 -1 osd.6 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.554+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.554+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:45.674 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:45 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:45.554+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:45.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:45.495+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:45.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:45.495+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:45.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:45 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:45.495+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:46.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:46 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:46.074+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:46.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:46 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:46.074+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:46.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:46 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:46.236+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:46.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:46 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:46.236+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:46.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:46 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:46.066+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:46.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:46 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:46.066+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:46.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:46 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:46.066+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:46.553 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:46.185+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:46.553 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:46.185+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:46.553 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:46.185+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:46.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:46 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:46.458+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:46.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:46 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:46.458+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:46.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:46 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:46.458+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:46.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:46.552+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:46.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:46.552+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:46.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:46 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:46.552+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:47.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:47.060+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:47.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:47.060+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:47.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:47 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:47.202+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:47.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:47 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:47.202+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:47.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:47 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:47.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:47.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:47 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:47.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:47.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:47 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:47.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:47.521 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:47.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:47.521 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:47.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:47.521 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:47.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:47.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:47.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:47.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:47.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:47.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:47.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:47.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:47.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:47.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:47.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:47.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:47 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:47.520+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:48.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:48.061+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:48.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:48.061+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:48.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:48.061+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:48.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:48 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:48.219+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:48.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:48 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:48.219+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:48.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:48 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:48.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:48.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:48 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:48.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:48.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:48 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:48.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:48.518 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:48.184+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:48.518 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:48.184+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:48.518 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:48.184+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:48.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:48.429+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:48.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:48.429+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:48.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:48 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:48.429+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:48.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:48.517+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:48.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:48.517+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:48.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:48 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:48.517+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:49.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.017+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:49.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.017+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:49.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.017+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:49.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:49 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:49.254+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:49.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:49 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:49.254+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:49.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:49 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:49.071+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:49.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:49 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:49.071+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:49.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:49 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:49.071+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:49.534 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:49.183+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:49.534 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:49.183+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:49.534 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:49.183+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:49.534 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:49.183+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:49.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:49.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:49.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:49.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:49.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:49.444+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:49.923 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:49.532+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.056627+0000 front 2024-09-10T22:03:02.056596+0000 (oldest deadline 2024-09-10T22:03:24.356914+0000) 2024-09-10T22:03:49.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:49.532+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:10.659146+0000 front 2024-09-10T22:03:10.659268+0000 (oldest deadline 2024-09-10T22:03:34.159298+0000) 2024-09-10T22:03:49.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:49.532+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:15.860701+0000 front 2024-09-10T22:03:15.860651+0000 (oldest deadline 2024-09-10T22:03:41.160451+0000) 2024-09-10T22:03:49.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:49 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6[60982]: 2024-09-10T22:03:49.532+0000 7fbcec9b2640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:23.461364+0000 front 2024-09-10T22:03:23.461382+0000 (oldest deadline 2024-09-10T22:03:48.761444+0000) 2024-09-10T22:03:50.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.973+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:50.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.973+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:50.406 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:49 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:49.973+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:50.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:50.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:50.088+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:50.227+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:50.227+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:50.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:50 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:50.227+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:50.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:50.189+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:50.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:50.189+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:50.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:50.189+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:50.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:50 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:50.189+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:50.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:50.424+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:50.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:50.424+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:50.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:50.424+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:50.906 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:50.424+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:51.145 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:50 smithi039 podman[105788]: 2024-09-10 22:03:50.815368949 +0000 UTC m=+5.533865897 container died a58864d9ec25bc44c54e33a13e01ce01d414f4f6517c30ac3afc52afb4a98d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:03:51.377 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:50.978+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:51.377 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:50.978+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:51.377 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:50 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:50.978+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:51 smithi039 podman[105788]: 2024-09-10 22:03:51.353444447 +0000 UTC m=+6.071941394 container cleanup a58864d9ec25bc44c54e33a13e01ce01d414f4f6517c30ac3afc52afb4a98d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:51 smithi039 bash[105788]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:51 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:51.143+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:51 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:51.143+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:51 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:51.143+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:51.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:51 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:51.143+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:51.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:51.257+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:51.257+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:51.257+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:51.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:51.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:51.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:51.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:51 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:51.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:51.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:51.374+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:51.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:51.374+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:51.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:51.374+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:51.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:51.374+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:51.924 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:51 smithi039 podman[105807]: 2024-09-10 22:03:51.530066701 +0000 UTC m=+0.714846367 container remove a58864d9ec25bc44c54e33a13e01ce01d414f4f6517c30ac3afc52afb4a98d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T22:03:52.284 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:51 smithi039 podman[105895]: 2024-09-10 22:03:51.981008532 +0000 UTC m=+0.109659238 container create 85a93cd5c9fa57a07a2d25a3463fbc3bcec7d1f8937eec9e09e742cc68a51775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:51 smithi039 podman[105895]: 2024-09-10 22:03:51.88801707 +0000 UTC m=+0.016667748 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:52 smithi039 podman[105895]: 2024-09-10 22:03:52.192175264 +0000 UTC m=+0.320825944 container init 85a93cd5c9fa57a07a2d25a3463fbc3bcec7d1f8937eec9e09e742cc68a51775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:52 smithi039 podman[105895]: 2024-09-10 22:03:52.195764528 +0000 UTC m=+0.324415198 container start 85a93cd5c9fa57a07a2d25a3463fbc3bcec7d1f8937eec9e09e742cc68a51775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:52 smithi039 podman[105895]: 2024-09-10 22:03:52.283460527 +0000 UTC m=+0.412111204 container attach 85a93cd5c9fa57a07a2d25a3463fbc3bcec7d1f8937eec9e09e742cc68a51775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:52 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:52.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:52 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:52.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:52 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:52.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:52.285 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:52 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:52.179+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:52.362 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:51.982+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:52.362 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:51.982+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:52.362 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:51 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:51.982+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:52.297+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:52.297+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:52.297+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:52.068+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:52.068+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:52.068+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:52.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:52 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:52.068+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:52.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:52.360+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:52.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:52.360+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:52.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:52.360+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:52.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:52.360+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:52.670 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 10 22:03:52 smithi039 podman[105895]: 2024-09-10 22:03:52.387246706 +0000 UTC m=+0.515897373 container died 85a93cd5c9fa57a07a2d25a3463fbc3bcec7d1f8937eec9e09e742cc68a51775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:03:52.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T22:03:53.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:03:53.005 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T22:03:53.005 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T22:03:53.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.7 2024-09-10T22:03:53.281 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:53 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:53.145+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:53.281 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:53 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:53.145+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:53.281 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:53 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:53.145+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:53.282 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:53 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:53.145+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:53.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:52.935+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:53.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:52.935+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:53.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:52.935+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:53.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 systemd[1]: Stopping Ceph osd.7 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:03:53.331 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:53.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:53.331 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:53.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:53.331 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:53.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:53.331 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:53.038+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:53.656 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.297+0000 7fb4421ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:03:53.656 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.297+0000 7fb4421ae640 -1 osd.7 77 *** Got signal Terminated *** 2024-09-10T22:03:53.657 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.297+0000 7fb4421ae640 -1 osd.7 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:03:53.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:53.382+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:53.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:53.382+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:53.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:53.382+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:53.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:53.382+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:53.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:53.330+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:53.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:53.330+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:53.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:53 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:53.330+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:54.342 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.910+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:54.342 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.910+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:54.342 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:53 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:53.910+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:54.053+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:54.053+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:54.053+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:54.053+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:54.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:54.339+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:54.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:54.339+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:54.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:54.339+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:54.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:54.339+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:54.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:54 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:54.186+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:54.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:54 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:54.186+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:54.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:54 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:54.186+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:54.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:54 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:54.186+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:54.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:54.370+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:54.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:54.370+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:54.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:54 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:54.370+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:55.156 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:54.898+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:55.156 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:54.898+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:55.156 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:54 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:54.898+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:55.329 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:55.078+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:55.329 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:55.078+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:55.330 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:55.078+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:55.330 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:55.078+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:55.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:55 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:55.158+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:55.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:55 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:55.158+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:55.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:55 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:55.158+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:55.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:55 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:55.158+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:55.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:55.306+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:55.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:55.306+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:55.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:55.306+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:55.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:55.306+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:55.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:55.329+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:55.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:55.329+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:55.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:55.329+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:55.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:55 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:55.329+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:03:56.317 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:55.943+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:56.317 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:55.943+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:56.317 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:55 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:55.943+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:56.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:56.282+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:56.282+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:56.282+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:56.282+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:56.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:56.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:56.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:56.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:56 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:56.095+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:56.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:56.315+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:56.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:56.315+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:56.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:56.315+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:56.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:56.315+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:56.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:56 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:56.181+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:56.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:56 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:56.181+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:56.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:56 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:56.181+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:56.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:56 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:56.181+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:57.337 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:56.970+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:57.337 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:56.970+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:57.337 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:56.970+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:57.337 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:56.970+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:33.746868+0000 front 2024-09-10T22:03:33.746889+0000 (oldest deadline 2024-09-10T22:03:56.547483+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:57.267+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:57.267+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:57.267+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:57.267+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:57.107+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:57.107+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:57.107+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:57.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:57.107+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:57.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:57 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:57.107+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:03:57.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:57 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:57.335+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:57.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:57 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:57.335+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:57.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:57 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:57.335+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:57.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:57 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:57.335+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:57.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:57 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:57.206+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:57.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:57 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:57.206+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:57.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:57 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:57.206+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:57.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:57 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:57.206+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:58.299 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:58.006+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:08.242153+0000 front 2024-09-10T22:03:08.242128+0000 (oldest deadline 2024-09-10T22:03:33.542261+0000) 2024-09-10T22:03:58.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:58.006+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:16.943672+0000 front 2024-09-10T22:03:16.943704+0000 (oldest deadline 2024-09-10T22:03:42.744363+0000) 2024-09-10T22:03:58.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:58.006+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:22.744930+0000 front 2024-09-10T22:03:22.744954+0000 (oldest deadline 2024-09-10T22:03:47.444955+0000) 2024-09-10T22:03:58.300 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7[52386]: 2024-09-10T22:03:58.006+0000 7fb43e7c3640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:33.746868+0000 front 2024-09-10T22:03:33.746889+0000 (oldest deadline 2024-09-10T22:03:56.547483+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:58.292+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:58.292+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:58.292+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:58.292+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:58.155+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:58.155+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:58.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:58.155+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:58.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:58.155+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:58.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:58 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:58.155+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:03:58.641 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:58.297+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:58.642 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:58.297+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:58.642 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:58.297+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:58.642 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:58.297+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:58.642 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:58 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:58.297+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:03:58.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:58.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:58.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:58.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:58.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:58.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:58.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:58.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:58.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:58 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:58.228+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:03:58.906 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:58 smithi070 podman[68806]: 2024-09-10 22:03:58.640750029 +0000 UTC m=+5.447043492 container died 51e245292b2eaa76d3cbb937dc76ae09f6397700ee5d0012e0976eecbde4d98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:03:59.275 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68806]: 2024-09-10 22:03:59.015015663 +0000 UTC m=+5.821309168 container cleanup 51e245292b2eaa76d3cbb937dc76ae09f6397700ee5d0012e0976eecbde4d98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:03:59.275 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 bash[68806]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7 2024-09-10T22:03:59.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:59.276+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:59.276+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:59.276+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:03:59.276+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:59.185+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:59.185+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:59.185+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:59.185+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:03:59.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:03:59 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:03:59.185+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:03:59.628 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68821]: 2024-09-10 22:03:59.27439563 +0000 UTC m=+0.628026100 container remove 51e245292b2eaa76d3cbb937dc76ae09f6397700ee5d0012e0976eecbde4d98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T22:03:59.629 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:59 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:59.333+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:03:59.629 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:59 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:59.333+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:03:59.629 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:59 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:59.333+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:03:59.629 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:59 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:59.333+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:03:59.629 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:03:59 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:03:59.333+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:03:59.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:59.270+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:03:59.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:59.270+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:03:59.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:59.270+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:03:59.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:59.270+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:03:59.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:03:59 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:03:59.270+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:03:59.906 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68911]: 2024-09-10 22:03:59.530201331 +0000 UTC m=+0.015601433 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:03:59.907 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68911]: 2024-09-10 22:03:59.666917396 +0000 UTC m=+0.152317550 container create e35be5dbc488f1435a1d856590dde9b987b8682e96bdfd03b7c6cfd7b5e05c2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:04:00.334 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68911]: 2024-09-10 22:03:59.927920469 +0000 UTC m=+0.413320578 container init e35be5dbc488f1435a1d856590dde9b987b8682e96bdfd03b7c6cfd7b5e05c2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:04:00.335 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:03:59 smithi070 podman[68911]: 2024-09-10 22:03:59.931434842 +0000 UTC m=+0.416834938 container start e35be5dbc488f1435a1d856590dde9b987b8682e96bdfd03b7c6cfd7b5e05c2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T22:04:00.335 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:04:00 smithi070 podman[68911]: 2024-09-10 22:04:00.010682991 +0000 UTC m=+0.496083088 container attach e35be5dbc488f1435a1d856590dde9b987b8682e96bdfd03b7c6cfd7b5e05c2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-10T22:04:00.335 INFO:journalctl@ceph.osd.7.smithi070.stdout:Sep 10 22:04:00 smithi070 podman[68911]: 2024-09-10 22:04:00.115732394 +0000 UTC m=+0.601132496 container died e35be5dbc488f1435a1d856590dde9b987b8682e96bdfd03b7c6cfd7b5e05c2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:04:00.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:00.308+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:00.308+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:00.308+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:00.308+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:00.212+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:00.212+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:00.212+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:00.212+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:00.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:00 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:00.212+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:00.589 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:00.332+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:00.589 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:00.332+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:00.589 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:00.332+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:00.589 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:00.332+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:00.589 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:00.332+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:00.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:00 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:00.295+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:00.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:00 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:00.295+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:00.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:00 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:00.295+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:00.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:00 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:00.295+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:00.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:00 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:00.295+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:00.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T22:04:00.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:00.810 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T22:04:00.810 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T22:04:00.810 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.8 2024-09-10T22:04:01.110 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:00 smithi173 systemd[1]: Stopping Ceph osd.8 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:01.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:01.258+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:01.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:01.258+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:01.258+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:01.258+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:01.258+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.107+0000 7fe5cb454640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.107+0000 7fe5cb454640 -1 osd.8 77 *** Got signal Terminated *** 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.107+0000 7fe5cb454640 -1 osd.8 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:01.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:01 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:01.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:01.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:01 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:01.346+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:01.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:01 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:01.346+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:01.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:01 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:01.346+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:01.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:01 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:01.346+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:01.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:01 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:01.346+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:01.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:01 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:01.327+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:01.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:01 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:01.327+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:01.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:01 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:01.327+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:01.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:01 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:01.327+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:01.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:01 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:01.327+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:02.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:02.312+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:02.312+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:02.312+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:02.312+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:02.219+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:02.219+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:02.219+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:02.219+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:02.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:02 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:02.219+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:02.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:02.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:02.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:02.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:02.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:02.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:02.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:02.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:02.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:02 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:02.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:02.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:02 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:02.338+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:02.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:02 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:02.338+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:02.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:02 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:02.338+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:02.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:02 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:02.338+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:02.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:02 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:02.338+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:03.358+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:03.358+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:03.358+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:03.358+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:03.233+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:03.233+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:03.233+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:03.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:03.233+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:03.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:03 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:03.233+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:03.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:03 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:03.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:03.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:03 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:03.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:03.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:03 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:03.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:03.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:03 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:03.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:03.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:03 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:03.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:03.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:03.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:03.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:03.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:03.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:03.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:03 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:03.377+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:04.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:04 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:04.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:04.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:04 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:04.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:04.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:04 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:04.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:04.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:04 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:04.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:04.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:04 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:04.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:04.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:04 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:04.375+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:04.742 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:04.336+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:04.336+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:04.336+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:04.336+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:04.271+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:04.271+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:04.271+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:04.271+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:04.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:04.271+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:05.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:00.810732+0000 front 2024-09-10T22:03:00.810610+0000 (oldest deadline 2024-09-10T22:03:24.910710+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:05.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:18.913725+0000 front 2024-09-10T22:03:18.913752+0000 (oldest deadline 2024-09-10T22:03:43.613905+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:05.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.315058+0000 front 2024-09-10T22:03:25.315007+0000 (oldest deadline 2024-09-10T22:03:50.014938+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:05.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.015573+0000 front 2024-09-10T22:03:30.015487+0000 (oldest deadline 2024-09-10T22:03:55.315377+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8[53721]: 2024-09-10T22:04:05.324+0000 7fe5c7a69640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:40.016277+0000 front 2024-09-10T22:03:40.016234+0000 (oldest deadline 2024-09-10T22:04:04.716354+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:05.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:05.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:05.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:05.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:05.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:05 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:05.224+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:05.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:05 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:05.295+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:05.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:05 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:05.295+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:05.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:05 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:05.295+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:05.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:05 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:05.295+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:05.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:05 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:05.295+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:05.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:05.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:05.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:05.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:05.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:05.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:05 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:05.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:06.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:06 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:06.189+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:06.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:06.340+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:06.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:06.340+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:06.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:06.340+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:06.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:06.340+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:06.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:06 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:06.340+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:06.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:06.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:06.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:06.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:06.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:06.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:06 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:06.407+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:06.902 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:06 smithi173 podman[69938]: 2024-09-10 22:04:06.624228006 +0000 UTC m=+5.620974406 container died 430f7a3c3d1ad028dadc346a265e98ea9569aad2db2b0377427be4c80b75b4ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T22:04:07.201 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[69938]: 2024-09-10 22:04:07.006089073 +0000 UTC m=+6.002835466 container cleanup 430f7a3c3d1ad028dadc346a265e98ea9569aad2db2b0377427be4c80b75b4ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T22:04:07.201 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 bash[69938]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8 2024-09-10T22:04:07.492 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[69965]: 2024-09-10 22:04:07.302392406 +0000 UTC m=+0.678461571 container remove 430f7a3c3d1ad028dadc346a265e98ea9569aad2db2b0377427be4c80b75b4ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:07.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:07 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:07.199+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:07.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:07 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:07.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:07.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:07 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:07.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:07.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:07 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:07.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:07.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:07 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:07.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:07.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:07 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:07.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:07.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:07 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:07.448+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:07.964 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[70052]: 2024-09-10 22:04:07.562304784 +0000 UTC m=+0.016293452 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:04:07.965 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[70052]: 2024-09-10 22:04:07.678415898 +0000 UTC m=+0.132404560 container create 2e5e145649531c2d2067f5d7ba42b45202c8db7b34a4fb0430c25f6955c684cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T22:04:07.965 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[70052]: 2024-09-10 22:04:07.880993775 +0000 UTC m=+0.334982448 container init 2e5e145649531c2d2067f5d7ba42b45202c8db7b34a4fb0430c25f6955c684cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T22:04:07.965 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[70052]: 2024-09-10 22:04:07.884409251 +0000 UTC m=+0.338397914 container start 2e5e145649531c2d2067f5d7ba42b45202c8db7b34a4fb0430c25f6955c684cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:04:07.965 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:07 smithi173 podman[70052]: 2024-09-10 22:04:07.964001638 +0000 UTC m=+0.417990309 container attach 2e5e145649531c2d2067f5d7ba42b45202c8db7b34a4fb0430c25f6955c684cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 10 22:04:08 smithi173 podman[70052]: 2024-09-10 22:04:08.079241661 +0000 UTC m=+0.533230325 container died 2e5e145649531c2d2067f5d7ba42b45202c8db7b34a4fb0430c25f6955c684cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:08.243 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:08.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:08.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:08 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:08.328+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:08.712 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T22:04:08.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:08.752 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T22:04:08.752 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T22:04:08.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.9 2024-09-10T22:04:08.781 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:08.782 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:08.782 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:08.782 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:08.782 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:08.782 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:08.487+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:09.058 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:08 smithi039 systemd[1]: Stopping Ceph osd.9 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:09.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.056+0000 7f8d5a29c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:09.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.056+0000 7f8d5a29c640 -1 osd.9 77 *** Got signal Terminated *** 2024-09-10T22:04:09.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.056+0000 7f8d5a29c640 -1 osd.9 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:04:09.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:09.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:09.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:09.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:09.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:09.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:09 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:09.169+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:09.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:09.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:09.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:09.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:09.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:09.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:09 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:09.321+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:09.923 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:09.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:09.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:09.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:09.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:09.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:09 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:09.492+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:10.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:10 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:10.144+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:10.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:10.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:10.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:10.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:10.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:10.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:10 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:10.344+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:10.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:10 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:10.450+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:11.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:11.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:11.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:11.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:11.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:11.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:11 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:11.126+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:11.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:11.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:11.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:11.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:11.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:11.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:11 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:11.354+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:11.924 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:11 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:11.446+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:47.897380+0000 front 2024-09-10T22:03:47.897357+0000 (oldest deadline 2024-09-10T22:04:11.397334+0000) 2024-09-10T22:04:12.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:12.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:12.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:12.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:12.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:12.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:12.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:12.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:12.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:12.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:12.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:12.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:12.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:12.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:12 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:12.312+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:12.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:12 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:12.404+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:47.897380+0000 front 2024-09-10T22:03:47.897357+0000 (oldest deadline 2024-09-10T22:04:11.397334+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:13.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:13 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:13.206+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:13.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:13.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:13.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:13.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:13.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:13.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:13.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:13 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:13.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:13.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:01.290384+0000 front 2024-09-10T22:03:01.290533+0000 (oldest deadline 2024-09-10T22:03:27.190608+0000) 2024-09-10T22:04:13.673 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.491620+0000 front 2024-09-10T22:03:09.491571+0000 (oldest deadline 2024-09-10T22:03:32.991643+0000) 2024-09-10T22:04:13.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.692636+0000 front 2024-09-10T22:03:14.692694+0000 (oldest deadline 2024-09-10T22:03:45.293466+0000) 2024-09-10T22:04:13.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.293888+0000 front 2024-09-10T22:03:25.293939+0000 (oldest deadline 2024-09-10T22:03:48.193892+0000) 2024-09-10T22:04:13.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.695802+0000 front 2024-09-10T22:03:32.695856+0000 (oldest deadline 2024-09-10T22:03:57.995705+0000) 2024-09-10T22:04:13.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.096465+0000 front 2024-09-10T22:03:39.096488+0000 (oldest deadline 2024-09-10T22:04:03.196413+0000) 2024-09-10T22:04:13.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:13 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9[67758]: 2024-09-10T22:04:13.415+0000 7f8d568b1640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:47.897380+0000 front 2024-09-10T22:03:47.897357+0000 (oldest deadline 2024-09-10T22:04:11.397334+0000) 2024-09-10T22:04:14.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:14.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:14.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:14.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:14.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:14.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:14 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:14.221+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:14.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:14.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:14.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:14.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:14.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:14.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:14.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:14 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:14.283+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:14.674 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:14 smithi039 podman[106009]: 2024-09-10 22:04:14.41809107 +0000 UTC m=+5.457702904 container died 394b966b871598f6314c7b5d78f14871a3c4a83755bfc77d5fbf4dc5cf5ee9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:04:15.034 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:14 smithi039 podman[106009]: 2024-09-10 22:04:14.840550288 +0000 UTC m=+5.880162121 container cleanup 394b966b871598f6314c7b5d78f14871a3c4a83755bfc77d5fbf4dc5cf5ee9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T22:04:15.034 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:14 smithi039 bash[106009]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9 2024-09-10T22:04:15.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106028]: 2024-09-10 22:04:15.033519316 +0000 UTC m=+0.607786435 container remove 394b966b871598f6314c7b5d78f14871a3c4a83755bfc77d5fbf4dc5cf5ee9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T22:04:15.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:15.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:15.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:15.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:15.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:15.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:15 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:15.172+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:15.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:15.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:15 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:15.320+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:15.761 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.459604428 +0000 UTC m=+0.102676098 container create 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T22:04:15.761 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.373144638 +0000 UTC m=+0.016216321 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:04:15.761 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.67045865 +0000 UTC m=+0.313530329 container init 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:04:15.762 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.673831538 +0000 UTC m=+0.316903209 container start 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:04:15.762 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.760688484 +0000 UTC m=+0.403760184 container attach 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T22:04:16.149 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:15 smithi039 podman[106112]: 2024-09-10 22:04:15.870314965 +0000 UTC m=+0.513386649 container died 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:04:16.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T22:04:16.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:16 smithi039 podman[106135]: 2024-09-10 22:04:16.349205072 +0000 UTC m=+0.472637145 container remove 9c2323c3cdb2fa0219acc62a294aa36f43544648ed87777e76b1fa8e2e1e4a06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T22:04:16.423 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:16 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.9.service: Deactivated successfully. 2024-09-10T22:04:16.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:16 smithi039 systemd[1]: Stopped Ceph osd.9 for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:04:16.424 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 10 22:04:16 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.9.service: Consumed 46.207s CPU time. 2024-09-10T22:04:16.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:16.454 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T22:04:16.455 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T22:04:16.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.10 2024-09-10T22:04:16.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:16.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:16.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:16.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:16.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:16.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:16.132+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:16.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.293+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:16.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 systemd[1]: Stopping Ceph osd.10 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:17.156 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.748+0000 7f83e9b21640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:17.156 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.748+0000 7f83e9b21640 -1 osd.10 77 *** Got signal Terminated *** 2024-09-10T22:04:17.156 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:16 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:16.748+0000 7f83e9b21640 -1 osd.10 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:04:17.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:17.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:17.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:17.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:17.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:17.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:17 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:17.145+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:17.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:17.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:17 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:17.304+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:18.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:18 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:18.143+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:18.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:18.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:18.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:18.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:18.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:18.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:18.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:18 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:18.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:19.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:19.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:19.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:19.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:19.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:19.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:19 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:19.128+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:19.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:19.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:19 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:19.381+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:20.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:20.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:20.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:20.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:20.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:20.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:20 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:20.168+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:20.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:20.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:20.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:20.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:20.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:20.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:20.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:20 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:20.343+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:21.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:21 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:21.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:21.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:02:59.987776+0000 front 2024-09-10T22:02:59.987864+0000 (oldest deadline 2024-09-10T22:03:24.087959+0000) 2024-09-10T22:04:21.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:09.889281+0000 front 2024-09-10T22:03:09.889339+0000 (oldest deadline 2024-09-10T22:03:33.989404+0000) 2024-09-10T22:04:21.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:14.990603+0000 front 2024-09-10T22:03:14.990693+0000 (oldest deadline 2024-09-10T22:03:40.290671+0000) 2024-09-10T22:04:21.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:25.492376+0000 front 2024-09-10T22:03:25.492471+0000 (oldest deadline 2024-09-10T22:03:50.092931+0000) 2024-09-10T22:04:21.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:32.993742+0000 front 2024-09-10T22:03:32.993720+0000 (oldest deadline 2024-09-10T22:03:57.693894+0000) 2024-09-10T22:04:21.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:42.295726+0000 front 2024-09-10T22:03:42.295607+0000 (oldest deadline 2024-09-10T22:04:07.595608+0000) 2024-09-10T22:04:21.657 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:21 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10[58936]: 2024-09-10T22:04:21.392+0000 7f83e6136640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-10T22:03:48.096674+0000 front 2024-09-10T22:03:48.096689+0000 (oldest deadline 2024-09-10T22:04:11.596498+0000) 2024-09-10T22:04:22.384 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:22 smithi070 podman[69026]: 2024-09-10 22:04:22.112632007 +0000 UTC m=+5.469241499 container died aab0dd44d5e3c5db36d30288d9a786ee688fb196bfc3fa255eb384cab81a8964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:22.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:22 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:22.171+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:22.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:22 smithi070 podman[69026]: 2024-09-10 22:04:22.489406379 +0000 UTC m=+5.846015871 container cleanup aab0dd44d5e3c5db36d30288d9a786ee688fb196bfc3fa255eb384cab81a8964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T22:04:22.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:22 smithi070 bash[69026]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10 2024-09-10T22:04:23.066 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:22 smithi070 podman[69042]: 2024-09-10 22:04:22.765415665 +0000 UTC m=+0.650287975 container remove aab0dd44d5e3c5db36d30288d9a786ee688fb196bfc3fa255eb384cab81a8964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:04:23.386 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:23.066051915 +0000 UTC m=+0.107138089 container create ce4f96c0cd9891bb00e1c77e014b6ea1a79b66fe2ecae998d613a11e54fb027b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T22:04:23.386 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:22.974451774 +0000 UTC m=+0.015537960 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:04:23.386 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:23.302064764 +0000 UTC m=+0.343150939 container init ce4f96c0cd9891bb00e1c77e014b6ea1a79b66fe2ecae998d613a11e54fb027b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T22:04:23.386 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:23.305321913 +0000 UTC m=+0.346408087 container start ce4f96c0cd9891bb00e1c77e014b6ea1a79b66fe2ecae998d613a11e54fb027b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:04:23.386 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:23.385170052 +0000 UTC m=+0.426256239 container attach ce4f96c0cd9891bb00e1c77e014b6ea1a79b66fe2ecae998d613a11e54fb027b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:04:23.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:23.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:23 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:23.175+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:23.656 INFO:journalctl@ceph.osd.10.smithi070.stdout:Sep 10 22:04:23 smithi070 podman[69131]: 2024-09-10 22:04:23.502121757 +0000 UTC m=+0.543207940 container died ce4f96c0cd9891bb00e1c77e014b6ea1a79b66fe2ecae998d613a11e54fb027b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:04:24.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T22:04:24.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:24.168 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T22:04:24.168 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T22:04:24.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.11 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:24.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.162+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:24.494 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 systemd[1]: Stopping Ceph osd.11 for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:24.992 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.538+0000 7fecbe27b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:24.992 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.538+0000 7fecbe27b640 -1 osd.11 77 *** Got signal Terminated *** 2024-09-10T22:04:24.993 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:24 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:24.538+0000 7fecbe27b640 -1 osd.11 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:04:25.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:25.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:25 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:25.204+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:26.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:26.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:26 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:26.202+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:27.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:27.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:27 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:27.197+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-10T22:04:05.068068+0000 front 2024-09-10T22:04:05.068081+0000 (oldest deadline 2024-09-10T22:04:26.768175+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:28.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:28 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:28.194+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-10T22:04:05.068068+0000 front 2024-09-10T22:04:05.068081+0000 (oldest deadline 2024-09-10T22:04:26.768175+0000) 2024-09-10T22:04:29.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-10T22:03:02.059479+0000 front 2024-09-10T22:03:02.059370+0000 (oldest deadline 2024-09-10T22:03:27.260072+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6804 osd.1 since back 2024-09-10T22:03:07.260707+0000 front 2024-09-10T22:03:07.260623+0000 (oldest deadline 2024-09-10T22:03:31.960641+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-10T22:03:17.261730+0000 front 2024-09-10T22:03:17.261761+0000 (oldest deadline 2024-09-10T22:03:41.961882+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-10T22:03:24.263079+0000 front 2024-09-10T22:03:24.263149+0000 (oldest deadline 2024-09-10T22:03:50.163001+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6812 osd.4 since back 2024-09-10T22:03:30.163478+0000 front 2024-09-10T22:03:30.163580+0000 (oldest deadline 2024-09-10T22:03:56.563881+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-10T22:03:39.965002+0000 front 2024-09-10T22:03:39.965105+0000 (oldest deadline 2024-09-10T22:04:04.665038+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.70:6820 osd.7 since back 2024-09-10T22:03:56.366865+0000 front 2024-09-10T22:03:56.366883+0000 (oldest deadline 2024-09-10T22:04:20.466777+0000) 2024-09-10T22:04:29.493 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11[60292]: 2024-09-10T22:04:29.215+0000 7fecb6888640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-10T22:04:05.068068+0000 front 2024-09-10T22:04:05.068081+0000 (oldest deadline 2024-09-10T22:04:26.768175+0000) 2024-09-10T22:04:30.139 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:29 smithi173 podman[70154]: 2024-09-10 22:04:29.87028222 +0000 UTC m=+5.505612728 container died 0cf0ecb06eac1a262c2a696581fe670defd836578ad42589de29000db324afb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:04:30.489 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:30 smithi173 podman[70154]: 2024-09-10 22:04:30.245714403 +0000 UTC m=+5.881044914 container cleanup 0cf0ecb06eac1a262c2a696581fe670defd836578ad42589de29000db324afb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:04:30.490 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:30 smithi173 bash[70154]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11 2024-09-10T22:04:30.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:30 smithi173 podman[70173]: 2024-09-10 22:04:30.488700889 +0000 UTC m=+0.616106515 container remove 0cf0ecb06eac1a262c2a696581fe670defd836578ad42589de29000db324afb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T22:04:31.134 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:30 smithi173 podman[70260]: 2024-09-10 22:04:30.715392138 +0000 UTC m=+0.015938535 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:04:31.134 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:30 smithi173 podman[70260]: 2024-09-10 22:04:30.823105643 +0000 UTC m=+0.123652030 container create cf753641a670b6371d54d202f64e4c24456a3e7b560e03bea60b9c878e229c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T22:04:31.135 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:31 smithi173 podman[70260]: 2024-09-10 22:04:31.042390192 +0000 UTC m=+0.342936578 container init cf753641a670b6371d54d202f64e4c24456a3e7b560e03bea60b9c878e229c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T22:04:31.135 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:31 smithi173 podman[70260]: 2024-09-10 22:04:31.045663879 +0000 UTC m=+0.346210268 container start cf753641a670b6371d54d202f64e4c24456a3e7b560e03bea60b9c878e229c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:04:31.135 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:31 smithi173 podman[70260]: 2024-09-10 22:04:31.133801959 +0000 UTC m=+0.434348359 container attach cf753641a670b6371d54d202f64e4c24456a3e7b560e03bea60b9c878e229c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T22:04:31.492 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 10 22:04:31 smithi173 podman[70260]: 2024-09-10 22:04:31.230509233 +0000 UTC m=+0.531055623 container died cf753641a670b6371d54d202f64e4c24456a3e7b560e03bea60b9c878e229c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T22:04:31.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T22:04:31.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:31.870 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T22:04:31.870 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T22:04:31.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.a 2024-09-10T22:04:32.173 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:31 smithi039 systemd[1]: Stopping Ceph mds.a for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:32.674 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:32 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: 2024-09-10T22:04:32.207+0000 7f743b97a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:32.674 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:32 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a[74754]: 2024-09-10T22:04:32.207+0000 7f743b97a640 -1 mds.a *** got signal Terminated *** 2024-09-10T22:04:35.424 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:35 smithi039 podman[106216]: 2024-09-10 22:04:35.162475739 +0000 UTC m=+3.090255189 container died 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T22:04:35.886 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:35 smithi039 podman[106216]: 2024-09-10 22:04:35.617357246 +0000 UTC m=+3.545136693 container cleanup 618407c2c4073c31b8dd6c56b870e648092066664b6344b8182df840be278b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T22:04:35.886 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 10 22:04:35 smithi039 bash[106216]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-a 2024-09-10T22:04:36.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T22:04:36.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:36.053 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T22:04:36.053 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T22:04:36.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.d 2024-09-10T22:04:36.424 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:36 smithi039 systemd[1]: Stopping Ceph mds.d for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:36.424 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d[73579]: 2024-09-10T22:04:36.370+0000 7f4511748640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:36.424 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:36 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d[73579]: 2024-09-10T22:04:36.370+0000 7f4511748640 -1 mds.d *** got signal Terminated *** 2024-09-10T22:04:38.007 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:37 smithi039 podman[106347]: 2024-09-10 22:04:37.75495502 +0000 UTC m=+1.468278300 container died 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:04:38.374 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:38 smithi039 podman[106347]: 2024-09-10 22:04:38.172380218 +0000 UTC m=+1.885703524 container cleanup 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T22:04:38.375 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:38 smithi039 bash[106347]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d 2024-09-10T22:04:38.625 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 10 22:04:38 smithi039 podman[106361]: 2024-09-10 22:04:38.373937424 +0000 UTC m=+0.620162562 container remove 89fbf827c7054e3ccbb3284d46471e129b008bb233d5db9cd6e48b857e19100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:04:38.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T22:04:38.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:38.664 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T22:04:38.664 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T22:04:38.664 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.g 2024-09-10T22:04:38.923 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:38 smithi039 systemd[1]: Stopping Ceph mds.g for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:39.424 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: 2024-09-10T22:04:39.000+0000 7f11feb86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:39.424 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:39 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g[74343]: 2024-09-10T22:04:39.000+0000 7f11feb86640 -1 mds.g *** got signal Terminated *** 2024-09-10T22:04:43.303 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:43 smithi039 podman[106468]: 2024-09-10 22:04:43.013426405 +0000 UTC m=+4.127825064 container died bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T22:04:43.673 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:43 smithi039 podman[106468]: 2024-09-10 22:04:43.485213537 +0000 UTC m=+4.599612197 container cleanup bf6b7abae1b22db0988a90b46ba5844d1aefd88547de934c309699767748b286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T22:04:43.674 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 10 22:04:43 smithi039 bash[106468]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-g 2024-09-10T22:04:43.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T22:04:43.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:43.953 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T22:04:43.954 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T22:04:43.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.j 2024-09-10T22:04:44.282 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:44 smithi039 systemd[1]: Stopping Ceph mds.j for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:44.673 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j[73162]: 2024-09-10T22:04:44.281+0000 7f886fd5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:44.674 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:44 smithi039 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j[73162]: 2024-09-10T22:04:44.281+0000 7f886fd5b640 -1 mds.j *** got signal Terminated *** 2024-09-10T22:04:46.566 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:46 smithi039 podman[106589]: 2024-09-10 22:04:46.308232372 +0000 UTC m=+2.123341104 container died 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T22:04:46.924 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:46 smithi039 podman[106589]: 2024-09-10 22:04:46.72367464 +0000 UTC m=+2.538783413 container cleanup 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T22:04:46.924 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:46 smithi039 bash[106589]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j 2024-09-10T22:04:47.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T22:04:47.175 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:46 smithi039 podman[106602]: 2024-09-10 22:04:46.924844179 +0000 UTC m=+0.609266316 container remove 1466b813816853701c7f334142ad9f6dfff4a3636cbd32ed5ffd739b22f2299b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:04:47.175 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:47 smithi039 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-10T22:04:47.176 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 10 22:04:47 smithi039 systemd[1]: Stopped Ceph mds.j for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:04:47.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:47.185 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T22:04:47.185 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T22:04:47.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.b 2024-09-10T22:04:47.480 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:47 smithi070 systemd[1]: Stopping Ceph mds.b for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:47.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T22:04:47.478+0000 7f81d09c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:47.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:47 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b[64287]: 2024-09-10T22:04:47.478+0000 7f81d09c7640 -1 mds.b *** got signal Terminated *** 2024-09-10T22:04:51.564 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:51 smithi070 podman[69233]: 2024-09-10 22:04:51.27258551 +0000 UTC m=+3.898886834 container died 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:04:51.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:51 smithi070 podman[69233]: 2024-09-10 22:04:51.661059419 +0000 UTC m=+4.287360748 container cleanup 4db4ee9e02a15c0a0d6c0c78bdde756dfbe9856874553db56db80ca5c2a3c4ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T22:04:51.906 INFO:journalctl@ceph.mds.b.smithi070.stdout:Sep 10 22:04:51 smithi070 bash[69233]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-b 2024-09-10T22:04:52.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T22:04:52.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:52.136 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T22:04:52.136 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T22:04:52.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.e 2024-09-10T22:04:52.475 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:52 smithi070 systemd[1]: Stopping Ceph mds.e for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:52.906 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: 2024-09-10T22:04:52.473+0000 7fef5402d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:52.906 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:52 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e[63690]: 2024-09-10T22:04:52.473+0000 7fef5402d640 -1 mds.e *** got signal Terminated *** 2024-09-10T22:04:55.441 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:55 smithi070 podman[69368]: 2024-09-10 22:04:55.180440874 +0000 UTC m=+2.826631517 container died 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T22:04:55.824 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:55 smithi070 podman[69368]: 2024-09-10 22:04:55.539631941 +0000 UTC m=+3.185822579 container cleanup 14d89c334065178ff2c2d8c8eb53cb7ad9897d4d38d75d79472117f9bdc1e4ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:04:55.825 INFO:journalctl@ceph.mds.e.smithi070.stdout:Sep 10 22:04:55 smithi070 bash[69368]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-e 2024-09-10T22:04:55.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T22:04:55.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:04:55.975 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T22:04:55.975 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T22:04:55.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.h 2024-09-10T22:04:56.156 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:56 smithi070 systemd[1]: Stopping Ceph mds.h for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:04:56.656 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: 2024-09-10T22:04:56.292+0000 7f1dfbc6f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:04:56.656 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:56 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h[63990]: 2024-09-10T22:04:56.292+0000 7f1dfbc6f640 -1 mds.h *** got signal Terminated *** 2024-09-10T22:04:59.445 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:59 smithi070 podman[69489]: 2024-09-10 22:04:59.166031938 +0000 UTC m=+2.976462798 container died c978537ba4a858c7d4ce85f17c5612eb16f6e0437eaadddbc9250de265261a2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T22:04:59.771 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:59 smithi070 podman[69489]: 2024-09-10 22:04:59.525757155 +0000 UTC m=+3.336188014 container cleanup c978537ba4a858c7d4ce85f17c5612eb16f6e0437eaadddbc9250de265261a2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T22:04:59.772 INFO:journalctl@ceph.mds.h.smithi070.stdout:Sep 10 22:04:59 smithi070 bash[69489]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-h 2024-09-10T22:04:59.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T22:05:00.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:00.027 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T22:05:00.027 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T22:05:00.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.k 2024-09-10T22:05:00.364 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:00 smithi070 systemd[1]: Stopping Ceph mds.k for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:05:00.656 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: 2024-09-10T22:05:00.361+0000 7fe1f808d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:05:00.656 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:00 smithi070 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k[63377]: 2024-09-10T22:05:00.361+0000 7fe1f808d640 -1 mds.k *** got signal Terminated *** 2024-09-10T22:05:03.439 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:03 smithi070 podman[69611]: 2024-09-10 22:05:03.181055475 +0000 UTC m=+2.937469073 container died 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T22:05:03.722 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:03 smithi070 podman[69611]: 2024-09-10 22:05:03.512282936 +0000 UTC m=+3.268696524 container cleanup 27151c6160989cd532acd50e9309f65c35b14fe90ca75734f72907166909c377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T22:05:03.722 INFO:journalctl@ceph.mds.k.smithi070.stdout:Sep 10 22:05:03 smithi070 bash[69611]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-k 2024-09-10T22:05:03.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T22:05:03.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:03.959 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T22:05:03.959 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T22:05:03.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.c 2024-09-10T22:05:04.242 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:04 smithi173 systemd[1]: Stopping Ceph mds.c for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:05:04.502 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: 2024-09-10T22:05:04.353+0000 7f89472cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:05:04.503 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:04 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c[65506]: 2024-09-10T22:05:04.353+0000 7f89472cd640 -1 mds.c *** got signal Terminated *** 2024-09-10T22:05:07.493 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:07 smithi173 podman[70363]: 2024-09-10 22:05:07.167152493 +0000 UTC m=+3.016962752 container died a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:05:08.089 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:07 smithi173 podman[70363]: 2024-09-10 22:05:07.820732176 +0000 UTC m=+3.670542431 container cleanup a6b9726171ddc81d6d8416333d8faa86d56ed01e20d4688a77ff4267ad3bacb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T22:05:08.089 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 10 22:05:07 smithi173 bash[70363]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-c 2024-09-10T22:05:08.254 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T22:05:08.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:08.291 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T22:05:08.291 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T22:05:08.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.f 2024-09-10T22:05:08.609 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:08 smithi173 systemd[1]: Stopping Ceph mds.f for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:05:08.992 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: 2024-09-10T22:05:08.608+0000 7fd15b512640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:05:08.992 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:08 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f[65203]: 2024-09-10T22:05:08.608+0000 7fd15b512640 -1 mds.f *** got signal Terminated *** 2024-09-10T22:05:11.427 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:11 smithi173 podman[70496]: 2024-09-10 22:05:11.167773565 +0000 UTC m=+2.657882105 container died ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T22:05:11.742 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:11 smithi173 podman[70496]: 2024-09-10 22:05:11.52513566 +0000 UTC m=+3.015244194 container cleanup ad6e525ff2ccba75da758779a8fd4753a98cddebdb60eaf3a0eaacd54e40cd86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:05:11.743 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 10 22:05:11 smithi173 bash[70496]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-f 2024-09-10T22:05:12.007 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T22:05:12.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:12.040 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T22:05:12.041 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T22:05:12.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.i 2024-09-10T22:05:12.363 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:12 smithi173 systemd[1]: Stopping Ceph mds.i for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:05:12.742 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: 2024-09-10T22:05:12.362+0000 7f15d3dd7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:05:12.743 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:12 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i[65812]: 2024-09-10T22:05:12.362+0000 7f15d3dd7640 -1 mds.i *** got signal Terminated *** 2024-09-10T22:05:15.242 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 podman[70617]: 2024-09-10 22:05:15.167580173 +0000 UTC m=+2.914026046 container died 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T22:05:15.731 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 podman[70617]: 2024-09-10 22:05:15.503794375 +0000 UTC m=+3.250240300 container cleanup 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:05:15.731 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 bash[70617]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i 2024-09-10T22:05:15.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T22:05:15.992 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 podman[70629]: 2024-09-10 22:05:15.730134444 +0000 UTC m=+0.561551636 container remove 52c6d0a17a0825cde89ded2156e743ae8a22c17f9820b8dcfc379825d42066ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-10T22:05:15.992 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-10T22:05:15.992 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 systemd[1]: Stopped Ceph mds.i for c8786c20-6fbd-11ef-bcea-c7b262605968. 2024-09-10T22:05:15.992 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 10 22:05:15 smithi173 systemd[1]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.i.service: Consumed 20.465s CPU time. 2024-09-10T22:05:16.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:16.009 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T22:05:16.009 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T22:05:16.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.l 2024-09-10T22:05:16.309 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:16 smithi173 systemd[1]: Stopping Ceph mds.l for c8786c20-6fbd-11ef-bcea-c7b262605968... 2024-09-10T22:05:16.742 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: 2024-09-10T22:05:16.307+0000 7f155271e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:05:16.742 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:16 smithi173 ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l[64898]: 2024-09-10T22:05:16.307+0000 7f155271e640 -1 mds.l *** got signal Terminated *** 2024-09-10T22:05:19.426 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:19 smithi173 podman[70739]: 2024-09-10 22:05:19.166102814 +0000 UTC m=+2.944919073 container died fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:05:19.743 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:19 smithi173 podman[70739]: 2024-09-10 22:05:19.525015631 +0000 UTC m=+3.303831882 container cleanup fafc271d58f1aa88e140c73765cece52adea93d0299872c779de50137806ce03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T22:05:19.743 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 10 22:05:19 smithi173 bash[70739]: ceph-c8786c20-6fbd-11ef-bcea-c7b262605968-mds-l 2024-09-10T22:05:20.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c8786c20-6fbd-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T22:05:20.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:05:20.033 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T22:05:20.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:05:20.249 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:05:22.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:05:23.101 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:05:25.626 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:05:25.829 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:05:28.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:05:28.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:05:28.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:05:28.261 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T22:05:28.263 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi039/crash 2024-09-10T22:05:28.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:05:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:05:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:05:28.294 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi070/crash 2024-09-10T22:05:28.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:05:28.333 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:05:28.333 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:05:28.335 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi173/crash 2024-09-10T22:05:28.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:05:28.378 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:05:28.378 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:05:28.379 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T22:05:28.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:05:28.424 INFO:teuthology.orchestra.run.smithi039.stdout:2024-09-10T22:01:22.150081+0000 mds.b (mds.0) 44 : cluster [WRN] Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details 2024-09-10T22:05:28.424 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T22:05:28.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[SEC\]' /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:05:28.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]' /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:05:28.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[WRN\]' /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:05:28.659 INFO:teuthology.orchestra.run.smithi039.stdout:2024-09-10T22:01:22.150081+0000 mds.b (mds.0) 44 : cluster [WRN] Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details 2024-09-10T22:05:28.659 INFO:tasks.cephadm:Compressing logs... 2024-09-10T22:05:28.659 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:05:28.702 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:05:28.704 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:05:28.725 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T22:05:28.725 INFO:teuthology.orchestra.run.smithi039.stderr:: No such file or directory 2024-09-10T22:05:28.725 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T22:05:28.725 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:05:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:05:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T22:05:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.9.log: /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:05:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T22:05:28.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T22:05:28.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.7%gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T22:05:28.729 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:05:28.729 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:05:28.732 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:05:28.732 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T22:05:28.736 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr: 82.6% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr: 90.4% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:05:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log: 86.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:05:28.738 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T22:05:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T22:05:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T22:05:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:05:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi173.stderr: 90.9% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T22:05:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T22:05:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:05:28.752 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.j.log: 95.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T22:05:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:05:28.753 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T22:05:28.753 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T22:05:28.765 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:05:28.780 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:05:28.789 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:05:28.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T22:05:28.897 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:05:29.005 INFO:teuthology.orchestra.run.smithi039.stderr: 90.4% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T22:05:29.066 INFO:teuthology.orchestra.run.smithi039.stderr: 95.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T22:05:29.103 INFO:teuthology.orchestra.run.smithi039.stderr: 94.9% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T22:05:29.134 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T22:05:29.134 INFO:teuthology.orchestra.run.smithi070.stderr: 90.9% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:05:29.211 INFO:teuthology.orchestra.run.smithi173.stderr: 95.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T22:05:29.591 INFO:teuthology.orchestra.run.smithi039.stderr: 90.4% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T22:05:29.674 INFO:teuthology.orchestra.run.smithi070.stderr: 90.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:05:30.348 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T22:05:30.371 INFO:teuthology.orchestra.run.smithi070.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:05:30.378 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:05:33.408 INFO:teuthology.orchestra.run.smithi039.stderr: 94.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T22:05:34.611 INFO:teuthology.orchestra.run.smithi039.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T22:05:35.580 INFO:teuthology.orchestra.run.smithi039.stderr: 94.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T22:05:36.125 INFO:teuthology.orchestra.run.smithi173.stderr: 94.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T22:05:36.282 INFO:teuthology.orchestra.run.smithi039.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T22:05:36.284 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-10T22:05:36.284 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m7.569s 2024-09-10T22:05:36.284 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m25.917s 2024-09-10T22:05:36.284 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m0.882s 2024-09-10T22:05:36.352 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T22:05:36.523 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T22:05:36.852 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T22:05:37.508 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T22:05:37.913 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T22:05:38.442 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T22:05:38.444 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-10T22:05:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m9.724s 2024-09-10T22:05:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m57.207s 2024-09-10T22:05:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m1.752s 2024-09-10T22:05:39.291 INFO:teuthology.orchestra.run.smithi070.stderr: 95.3% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T22:05:51.567 INFO:teuthology.orchestra.run.smithi070.stderr: 94.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T22:06:01.817 INFO:teuthology.orchestra.run.smithi070.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T22:06:07.608 INFO:teuthology.orchestra.run.smithi070.stderr: 94.1% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T22:06:08.901 INFO:teuthology.orchestra.run.smithi070.stderr: 94.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T22:06:20.909 INFO:teuthology.orchestra.run.smithi070.stderr: 94.2% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T22:06:51.674 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T22:11:05.744 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/c8786c20-6fbd-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T22:11:05.744 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T22:11:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:real 5m37.023s 2024-09-10T22:11:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:user 4m49.487s 2024-09-10T22:11:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m10.787s 2024-09-10T22:11:05.745 INFO:tasks.cephadm:Archiving logs... 2024-09-10T22:11:05.746 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi039/log 2024-09-10T22:11:05.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:11:09.145 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi070/log 2024-09-10T22:11:09.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:11:52.459 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi173/log 2024-09-10T22:11:52.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:11:58.353 INFO:tasks.cephadm:Removing cluster... 2024-09-10T22:11:58.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force 2024-09-10T22:11:58.569 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:11:58.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force 2024-09-10T22:11:59.201 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:11:59.736 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c8786c20-6fbd-11ef-bcea-c7b262605968 --force 2024-09-10T22:11:59.941 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: c8786c20-6fbd-11ef-bcea-c7b262605968 2024-09-10T22:12:00.273 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T22:12:00.274 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:12:00.291 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:12:00.309 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:12:00.325 INFO:tasks.cephadm:Teardown complete 2024-09-10T22:12:00.325 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T22:12:00.336 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T22:12:00.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:12:00.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:12:00.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:12:00.501 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T22:12:00.511 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T22:12:00.512 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:12:00.514 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:12:00.517 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:12:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:12:00.531 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:12:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:12:00.532 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:12:00.532 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-10T22:12:00.532 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -322us[ -309us] +/- 45ms 2024-09-10T22:12:00.532 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 +1245us[+1259us] +/- 65ms 2024-09-10T22:12:00.532 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -917us[ -903us] +/- 78ms 2024-09-10T22:12:00.533 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -310us[ -328us] +/- 45ms 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +1247us[+1247us] +/- 65ms 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -890us[ -890us] +/- 78ms 2024-09-10T22:12:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:12:00.556 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:12:00.556 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-10T22:12:00.556 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -331us[ -328us] +/- 45ms 2024-09-10T22:12:00.556 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +1232us[+1232us] +/- 65ms 2024-09-10T22:12:00.556 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -917us[ -917us] +/- 78ms 2024-09-10T22:12:00.557 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:12:00.557 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T22:12:00.582 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T22:12:00.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T22:12:00.615 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:12:00.696 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:12:00.777 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:12:00.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:12:00.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:00.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:12:00.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:00.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:12:00.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:00.934 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T22:12:00.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T22:12:00.981 INFO:teuthology.task.internal:Duration was 2030.189971 seconds 2024-09-10T22:12:00.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T22:12:01.015 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T22:12:01.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:12:01.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:12:01.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:12:01.056 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:12:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:12:01.092 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:12:01.534 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T22:12:01.534 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-10T22:12:01.534 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:12:01.557 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T22:12:01.557 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:12:01.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-10T22:12:01.591 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:12:01.615 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T22:12:01.616 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:12:01.618 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:12:01.634 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:12:01.683 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T22:12:01.683 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:12:01.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:12:01.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:12:02.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T22:12:02.620 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T22:12:02.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:12:02.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:12:02.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:12:02.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T22:12:02.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.738 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-10T22:12:02.767 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-10T22:12:02.770 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-10T22:12:02.800 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:02.815 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:02.831 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:12:02.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:12:02.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T22:12:02.856 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T22:12:02.857 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi039 2024-09-10T22:12:02.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:12:02.911 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi070 2024-09-10T22:12:02.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:12:02.951 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899693/remote/smithi173 2024-09-10T22:12:02.951 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:12:02.987 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T22:12:02.988 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:12:02.990 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:12:02.993 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:12:03.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T22:12:03.049 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T22:12:03.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T22:12:03.098 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T22:12:03.098 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:12:03.100 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:12:03.103 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:12:03.113 INFO:teuthology.orchestra.run.smithi039.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:12 /home/ubuntu/cephtest 2024-09-10T22:12:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:12 /home/ubuntu/cephtest 2024-09-10T22:12:03.117 INFO:teuthology.orchestra.run.smithi173.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:12 /home/ubuntu/cephtest 2024-09-10T22:12:03.126 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T22:12:03.137 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T22:12:03.202 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 2030.1899712085724 failure_reason: '"2024-09-10T22:01:22.150081+0000 mds.b (mds.0) 44 : cluster [WRN] Scrub error on inode 0x10000004e00 (/volumes/qa/sv_1/1c5cf619-2a7d-4f36-ae2f-c8ce151e2876/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-73) see mds.b log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-09-10T22:12:03.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:12:03.298 INFO:teuthology.run:FAIL